Search NASA⌕ Search

SEARCH · Search NASA

Results for “parallel data structures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Phenomenological Model of Hydrophobic and Hydrophilic Interactions

Hydration forces acting between macroscopic bodies at distances L ≤ 3 nm in pure water are calculated based on the phenomenological model of polar liquids. It is shown that depending on the properties of the bodies, the interacting surfaces polarize the liquid differently, and wetting properties of the surfaces are completely characterized by two parameters. If the surfaces are hydrophilic, liquid molecules are polarized at right angles to the surfaces, and the interaction is the short-range repulsion (the forces of interaction decrease exponentially over the characteristic length λ ≈ 0.2 nm). The interaction between the hydrophobic surfaces is more diversified and has been studied less. For L ≤ 3 nm, the interaction exhibits universal properties, while for L ≤ 3 nm, it considerably depends on the properties of the surfaces and on the distances between them, as well as on the composition of the polar liquid. In full agreement with the available experimental results we find that if the interfaces are mostly hydrophobic, then the interaction is attractive and long-range (the interaction forces diminish exponentially with decay length 1.2 nm). In this case, the resultant polarization of water molecules is parallel to the surface. It is shown that hydration forces are determined by nonlinear effects of polarization of the liquid in the bulk or by analogous nonlinearity of the interaction of water with a submerged body. This means that the forces of interaction cannot be calculated correctly in the linear response approximation. The forces acting between hydrophobic or hydrophilic surfaces are of the entropy type or electrostatic, respectively. It is shown that hydrophobic and hydrophilic surfaces for L ≤ 3 nm repel each other. The calculated intensity of their interaction is in agreement with experimental data. We predict the existence of an intermediate regime in which a body cannot order liquid molecules, which results in a much weaker attraction that decreases in inverse proportion to the squared distance between the surfaces of bodies. The difference between the microscopic structures of liquids confined in nanovolumes from liquids in large volumes is considered. The proposed model is applicable for a quantitative description of the properties of water at temperatures T satisfying the condition 0 < (T–T{sub c})/T{sub c} ≪ 1, where T{sub c} ≈ 230 K is the temperature of the ferroelectric phase transition observed in supercooled water. Under standard conditions, the model can be used for obtaining qualitative estimates.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Modern Integrated Decommissioning at Chalk River Laboratories - 19401

Canadian Nuclear Laboratories (CNL), formerly Atomic Energy of Canada Limited (AECL) is Canada's premier nuclear science and technology (S and T) organization in Canada. Over the next decade, CNL will be transforming its many different sites through the revitalization of essential site infrastructure, the decommissioning of aging infrastructure and a significant investment in new, world-class science facilities. In particular, the main site for CNL resides at the Chalk River Laboratories (CRL), where the majority of parallel activities of revitalization and decommissioning will take place. In 2016, CRL started an ambitious ten year plan to decommission more than 120 buildings. In order to ensure this project remains on track and the ALARA (as low as reasonably achievable) principle is maintained, a strategy is required. This strategy is to focus on integrated activities, which meet/exceed international best practices, to ensure the work is carried out as efficiently as possible. Given the complexity of CRL operations and the legacy issues accumulated over 60 years of operation, CNL needed to adopt a modern and integrated approach to handle competing project priorities. As a starting point, achieving complete radiological characterization of many building structures is required. CNL engaged various vendors to modernize radiological surveys from paper records to electronic documentation, deploying modern survey tools such as data-logging instruments, gamma cameras, robotic surveying tools, and introducing tablets to improve the flow of information while workers are in the field. Once fully implemented, these improvements will ensure that quality information is readily available at all stages of decommissioning, which greatly reduces project schedules and results in important company savings. These techniques will ensure that, during planning, historic radiological survey data is easily searchable from the electronic documentation system. Any additional data required can be quickly and safety collected using robotic surveying tools in areas of higher radiation to reduce possible exposure to individuals. As decommissioning progresses, individuals in the field can use tablets, gamma cameras and data-logging instruments to accurately retrieve, collect and share data. As a result of these efforts, CNL is progressing towards becoming a leader in the field of decommissioning within Canada, applying modern techniques and best practices to reduce decommissioning project risk. Access to high quality information results in improved decommissioning plans, which will reduce the amount of rework and scheduling delays required and improve worker safety as the project is executed. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Thermal expansion of 4H and 6H SiC from 5 K to 340 K

The first thermal expansion measurements of the 4H and 6H polytypes of SiC below room temperature are reported. The measurements were carried out on single-crystal specimens using high-resolution capacitive-based dilatometry. For both polytypes, the thermal expansion coefficient is below 2.4 × 10 -6 1/K near room temperature. No phase transitions are observed over the 5 K to 340 K temperature range of the measurements. The thermal expansion coefficient α of 4H SiC is slightly anisotropic for measurements parallel and perpendicular to the crystallographic c axis with α ∥ about 2.2 × 10 -7 1/K larger than α ⟂ near room temperature. For 6H SiC no discernible anisotropy is observed. The differences in anisotropy can be understood by considering the ratio of hexagonal to cubic bonds of each polytype. Narrow regions with negative thermal expansion that are within the limits of our resolution (~ 1 x 10 -8 ) are observed in the vicinity of 30 K for both specimens. In conclusion, tabulated data, polynomial fits, fit parameters, and comparison to data based on lattice-parameter measurements are provided.

36 MATERIALS SCIENCE↗

Lynx x-ray microcalorimeter

Lynx is an x-ray telescope, one of four large satellite mission concepts currently being studied by NASA to be a flagship mission. One of Lynx’s three instruments is an imaging spectrometer called the Lynx x-ray microcalorimeter (LXM), an x-ray microcalorimeter behind an x-ray optic with an angular resolution of 0.5 arc sec and ~2 m 2 of area at 1 keV. The LXM will provide unparalleled diagnostics of distant extended structures and, in particular, will allow the detailed study of the role of cosmic feedback in the evolution of the Universe. We discuss the baseline design of LXM and some parallel approaches for some of the key technologies. The baseline sensor technology uses transition-edge sensors, but we also consider an alternative approach using metallic magnetic calorimeters. We discuss the requirements for the instrument, the pixel layout, and the baseline readout design, which uses microwave superconducting quantum interference devices and high-electron mobility transistor amplifiers and the cryogenic cooling requirements and strategy for meeting these requirements. For each of these technologies, we discuss the current technology readiness level and our strategy for advancing them to be ready for flight. We also describe the current system design, including the block diagram, and our estimate for the mass, power, and data rate of the instrument.

47 OTHER INSTRUMENTATION↗

Study of the second magnetization peak and the pinning behaviour in Ba(Fe 0.935 Co 0.065 ) 2 As 2 pnictide superconductor

Isothermal magnetic field dependence of magnetization and magnetic relaxation measurements were performed for the $H\parallel {\rm{c}}$ axis on a single crystal of Ba(Fe 0.935 Co 0.065 ) 2 As 2 pnictide superconductor having T c = 21.7 K. The second magnetization peak (SMP) for each isothermal M(H) was observed in a wide temperature range from T c to the lowest temperature of measurement (2 K). The magnetic field dependence of relaxation rate R(H), showed a peak (H spt) between H on (onset of SMP in M(H)) and H p (peak field of SMP in M(H)), which is likely to be related to a vortex-lattice structural phase transition, as suggested in the literature for a similar sample. In addition, the magnetic relaxation measured for magnetic fields near H spt showed some noise, which might be the signature of the structural phase transition of the vortex lattice. Analysis of the magnetic relaxation data using Maley's criterion and the collective pinning theory suggested that the SMP in the sample was due to the collective (elastic) to plastic creep crossover, which was also accompanied by a rhombic to square vortex lattice phase transition. The analysis of the pinning force density suggested a single dominating pinning mechanism in the sample, which did not showing the usual $\delta {l}$ and $\delta {T}_{{\rm{c}}}$ nature of pinning. Furthermore, the critical current density (J c ), estimated using the Bean critical state model, was found to be 5 × 10 5 A cm - 2 at 2 K in the zero magnetic field limit. Surprisingly, the maximum of the pinning force density was not responsible for the maximum value of the critical current density in the sample.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Quantitative spatiotemporal mapping of thermal runaway propagation rates in lithium-ion cells using cross-correlated Gabor filtering

Abuse testing of lithium-ion batteries is widely performed in order to develop new safety standards and strategies. However, testing methodologies are not standardised across the research community, especially with failure mechanisms being inherently difficult to reproduce. High-speed X-ray radiography is proven to be a valuable tool to capture events occurring during cell failure, but the observations made remain largely qualitative. We have therefore developed a robust image processing toolbox that can quantify, for the first time, the rate of propagation of battery failure mechanisms revealed by high-speed X-ray radiography. Using Gabor filter, the toolbox selectively tracks the electrode structure at the onset of failure. This facilitated the estimation of the displacement of electrodes undergoing abuse via nail penetration, and also the tracking of objects, such as the nail, as it propagates through a cell. Further, by cross-correlating the Gabor signals, we have produced practical, illustrative spatiotemporal maps of the failure events. From these, we can quantify the propagation rates of electrode displacement prior to the onset of thermal runaway. The highest recorded acceleration (≈514 mm s -2 ) was when a nail penetrated a cell radially (perpendicular to the electrodes) as opposed to axially (parallel to the electrodes). The initiation of thermal runaway was also resolved in combination with electrode displacement, which occurred at a lower acceleration (≈108 mm s -2 ). Our assistive toolbox can also be used to study other types of failure mechanisms, extracting otherwise unattainable kinetic data. Ultimately, this tool can be used to not only validate existing theoretical mechanical models, but also standardise battery failure testing procedures.

25 ENERGY STORAGE↗

A rheological model for loose sands with insights from DEM

A rheological model for loose granular media is developed to capture both solid-like and fluid-like responses during shearing. The proposed model is built by following the mathematical structure of an extended Kelvin–Voigt model, where an elastic spring and plastic slider act in parallel to a viscous damper. This arrangement requires the partition of the total stress into rate-independent and rate-dependent stress components. To model the solid-like behavior, a simple frictional plasticity model is adopted without modifications, thus contributing to the rate-independent stress. Instead, the fluid-like or rate-dependent stress is further decomposed into deviatoric and volumetric parts, by proposing a new formulation based on a combination of the μ(I) relation, originally developed under pressure-controlled shear, with a pressure-shear rate relation derived under volume-controlled shear. The proposed formulation allows the model to capture both the increase in the friction coefficient and the enhanced dilation at high shear rates. High-fidelity simulation data, obtained from discrete element method and multiscale modelling, are used to evaluate the performance of the proposed constitutive model. The model provides accurate results under both drained and undrained simple shear paths across a wide range of shear rates. Furthermore, it successfully reproduces at much lower computational cost the flowslide mobility computed through multiscale simulations, which is primarily regulated by the shear rate dependence of the material properties during the dynamic runout stage.

Elasticity↗

Regional-scale fault-to-structure earthquake simulations with the EQSIM framework: Workflow maturation and computational performance on GPU-accelerated exascale platforms

Continuous advancements in scientific and engineering understanding of earthquake phenomena, combined with the associated development of representative physics-based models, is providing a foundation for high-performance, fault-to-structure earthquake simulations. However, regional-scale applications of high-performance models have been challenged by the computational requirements at the resolutions required for engineering risk assessments. The EarthQuake SIMulation (EQSIM) framework, a software application development under the US Department of Energy (DOE) Exascale Computing Project, is focused on overcoming the existing computational barriers and enabling routine regional-scale simulations at resolutions relevant to a breadth of engineered systems. This multidisciplinary software development—drawing upon expertise in geophysics, engineering, applied math and computer science—is preparing the advanced computational workflow necessary to fully exploit the DOE’s exaflop computer platforms coming online in the 2023 to 2024 timeframe. Achievement of the computational performance required for high-resolution regional models containing upward of hundreds of billions to trillions of model grid points requires numerical efficiency in every phase of a regional simulation. This includes run time start-up and regional model generation, effective distribution of the computational workload across thousands of computer nodes, efficient coupling of regional geophysics and local engineering models, and application-tailored highly efficient transfer, storage, and interrogation of very large volumes of simulation data. This article summarizes the most recent advancements and refinements incorporated in the workflow design for the EQSIM integrated fault-to-structure framework, which are based on extensive numerical testing across multiple graphics processing unit (GPU)-accelerated platforms, and demonstrates the computational performance achieved on the world’s first exaflop computer platform through representative regional-scale earthquake simulations for the San Francisco Bay Area in California, USA.

58 GEOSCIENCES↗

Optimizing High-Throughput Inference on Graph Neural Networks at Shared Computing Facilities with the NVIDIA Triton Inference Server

Abstract With machine learning applications now spanning a variety of computational tasks, multi-user shared computing facilities are devoting a rapidly increasing proportion of their resources to such algorithms. Graph neural networks (GNNs), for example, have provided astounding improvements in extracting complex signatures from data and are now widely used in a variety of applications, such as particle jet classification in high energy physics (HEP). However, GNNs also come with an enormous computational penalty that requires the use of GPUs to maintain reasonable throughput. At shared computing facilities, such as those used by physicists at Fermi National Accelerator Laboratory (Fermilab), methodical resource allocation and high throughput at the many-user scale are key to ensuring that resources are being used as efficiently as possible. These facilities, however, primarily provide CPU-only nodes, which proves detrimental to time-to-insight and computational throughput for workflows that include machine learning inference. In this work, we describe how a shared computing facility can use the NVIDIA Triton Inference Server to optimize its resource allocation and computing structure, recovering high throughput while scaling out to multiple users by massively parallelizing their machine learning inference. To demonstrate the effectiveness of this system in a realistic multi-user environment, we use the Fermilab Elastic Analysis Facility augmented with the Triton Inference Server to provide scalable and high-throughput access to a HEP-specific GNN and report on the outcome.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Pseudo-dynamic Aspen Plus{sup R} Model of the Defense Waste Processing Facility - 18475

The Defense Waste Processing Facility (DWPF) at the Savannah River Site converts legacy high-level waste from the Cold War into borosilicate glass for permanent disposal in a geological repository. The waste sludge is chemically adjusted by the addition of acid, mixed with frit, and concentrated in the DWPF Chemical Process Cell (CPC) to ensure that the final glass has the desired properties. The resulting mixture is fed into the melter where the waste is melted and poured into stainless steel storage canisters. We present an Aspen Plus{sup R} model of the DWPF CPC, which is being developed to aid chemical processing decisions pertaining to the current flowsheet and to aid decisions regarding optimizing future processing. Given a waste feed composition with acid and frit additions, the model will predict the sludge and off-gas compositions throughout the processing, as well as the final melter feed composition. This allows different processing scenarios to be investigated easily, reducing the reliance on experimental testing, and hence saving time and money. The model has multiple potential applications, including calculating the acid and frit additions required to give acceptable glass properties, off-gas permitting, tracking mercury steam-stripped from the waste in the off-gas system, tracking flammable gases in the offgas system, investigating the effect of reducing air purges in the condensers, and general process optimization. The waste is processed in the CPC in batches, requiring dynamic simulation to track the time-dependent operations. Accurate modeling of the processing also requires calculations of phase and electrolyte chemical equilibria and parallel rate-dependent reactions. Due to existing technical limitations with dynamic simulation of the complex chemical system, we have adopted a pseudo-dynamic approach in which time intervals are treated as consecutive steady-state operations in Aspen Plus{sup R}. Thus, the model consists of ∼100 replicas of the processing vessel and its off-gas system, with the sludge output by one replica (representing one time interval) becoming the feed to the next (representing the next time interval). By examining the results from these replicas in sequence, one can see the time evolution of the model. This general approach can be used wherever simultaneous calculation of phase and electrolyte chemical equilibria in a dynamically evolving system is needed. In addition to describing the general structure and chemistry of the model, we present results from tests of the model against experimental data. These data are from laboratory-scale process simulations of the CPC with a nonradioactive waste sludge simulant. These tests include the model's predictions of the offgas composition, the sludge pH, and the final sludge composition. We will also discuss planned future developments of the model. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

S4PST: Sustainability for Programming Systems and Tools: May Workshop Report

The US Department of Energy (DOE) Exascale Computing Project (ECP) has fostered and strengthened the use of modern software engineering practices for developing applications and libraries, and this effort has resulted in the coordinated and interoperable E4S1 and xSDK2 ecosystems. Although this approach is cost-effective, it relies on robust programming systems and tools (PST) as the underlying foundation for our HPC software. At present, our primary PST stack consists of traditional high-performance computing (HPC) languages, namely Fortran, C, C++, and the popular Python language for data analysis and AI workflows. These languages support various programming frameworks and run-time abstractions that enable parallelism and concurrency across multiple node architectures and thousands of nodes through a variety of interconnect systems. However, to accommodate users’ diverse needs, certain aspects of the HPC ecosystem are delegated to vendor-specific or third-party implementations that extend beyond a particular scientific domain. This broader scope results in a multitude of specifications and variations, which leads to a complex orchestration of many-ecosystems. Unfortunately, this complexity in the ecosystem imposes additional overhead costs on consumers during the latter stages of the development cycle. In addition to the software ecosystem challenge, the upcoming conclusion of the ECP by December 2023 has raised significant concerns within the HPC programming systems community, from both the economic and social perspectives. The ECP has implemented a management structure for software development and funding decisions across all ECP participants by following a conventional hierarchical and centralized approach. However, this structure has prompted certain considerations within the community, particularly in anticipation of the Software Sustainability initiative by the DOE’s Advanced Scientific Computing Research Program (ASCR). For the success of this new initiative, it is of utmost importance to secure consistent funding and foster close engagement with researchers and core developers of existing programming-system products. This collaboration is vital to maintaining the critical capabilities of the current software during the transition phase while proactively adapting to future technology and workforce trends. The community recognizes the significance of adapting to emerging trends and is aware of the inherent fragility of the HPC software ecosystem, particularly in relation to programming systems that cater to all users. The ability to adapt and evolve is essential to staying relevant and effectively addressing these technical, economic, and social challenges. The S4PST team, which represents one of the six ASCR Software Sustainability seedling projects, is dedicated to tackling these challenges through community-based approaches that go beyond the scope of the DOE. This involves collaboration between national laboratories with academia, non-DOE institutions, hardware and system vendors, and international partners. By fostering these partnerships, we aim to create a robust and sustainable HPC software ecosystem that can effectively meet the needs of the community. This new community effort, driven by the eight DOE labs, will take on the responsibility of guiding funding decisions for programming-systems development and maintenance with transparency and consistency across all decisions. Additionally, the team will offer common technical services to the programming systems community, irrespective of their funding situations, and facilitate community-wide incubation to proactively nurture the software ecosystem. By actively engaging with stakeholders and employing a collaborative approach, we can collectively shape the future of programming systems and ensure a robust and thriving HPC software landscape. On May 11–12, 2023, the S4PST team conducted its inaugural kick-off workshop at the Innovative Computing Laboratory (ICL) in the University of Tennessee, Knoxville, hosted by Hartwig Anzt. The workshop encompassed various sessions dedicated to presentations and discussions, with the aim of comprehending the team members’ perspectives on the vision of software sustainability. Additionally, the workshop aimed to identify the technical, economic, and social requirements for sustaining the programming-systems community in the field of HPC. This report provides a summary of the S4PST effort by highlighting five major thrust areas discussed during the workshop: (i) community, (ii) technical support, (iii) training and diversity, (iv) verification, validation and correctness, and (v) emerging technologies. It also encompasses an overview of the presentations and discussions held throughout the event, our views and potential synergies with other seedling efforts, along with the outcomes and key takeaways from our initial discussions.

97 MATHEMATICS AND COMPUTING↗

AMR-Wind: A Performance-Portable, High-Fidelity Flow Solver for Wind Farm Simulations

We present AMR-Wind, a verified and validated high-fidelity computational-fluid-dynamics code for wind farm flows. AMR-Wind is a block-structured, adaptive-mesh, incompressible-flow solver that enables predictive simulations of the atmospheric boundary layer and wind plants. It is a highly scalable code designed for parallel high-performance computing with a specific focus on performance portability for current and future computing architectures, including graphical processing units (GPUs). In this paper, we detail the governing equations, the numerical methods, and the turbine models. Establishing a foundation for the correctness of the code, we present the results of formal verification and validation. The verification studies, which include a novel actuator line test case, indicate that AMR-Wind is spatially and temporally second-order accurate. The validation studies demonstrate that the key physics capabilities implemented in the code, including actuator disk models, actuator line models, turbulence models, and large eddy simulation (LES) models for atmospheric boundary layers, perform well in comparison to reference data from established computational tools and theory. We conclude with a demonstration simulation of a 12-turbine wind farm operating in a turbulent atmospheric boundary layer, detailing computational performance and realistic wake interactions.

17 WIND ENERGY↗

ArborX

ArborX library tackles a problem of efficiently finding geometric objects that are close in space. Variations of this problem, such as finding the nearest neighbors of a point, or finding all objects within a certain distance, are inherent components of applications in many fields. The data may be large so that solving the problem efficiently may require significant computational resources, such as multiple processors or accelerators such as general purpose GPUs. ArborX' main advantage in its ability to solve large problems efficiently utilizing a combination of distributed and on-node parallelism. ArborX can be run efficiently on a wide variety of hardware, including GPUs from different vendors, which distinguishes it from other available libraries which typically choose only few of these. The other advantage is that it supports both types of user problems: spatial problems (useful for intersections and finding objects within certain distance), and nearest neighbor problems. ArborX also supports flexible interface in its interaction with a user. Particularly, it allows a user to call user's own function on a positive match, a functionality not rarely available in other libraries. ArborX implements construction and traversal algorithms using efficient tree structures, such as bounding volume hierarchy (BVH). At its core, it uses linear BVH for its low construction cost and sufficient quality. ArborX is written using C++, and is parallelized using the message passing interface (MPI) for the distributed communication, and the Kokkos library for on-node parallelism. This approach allows ArborX to be run on a wide variety of hardware, from common laptops and desktops to supercomputers while using the same codebase. ArborX also implements several advanced algorithms using geometric search, such as density-based clustering algorithm DBSCAN.

ECP↗

ArborX 2.0

ArborX library tackles a problem of efficiently finding geometric objects that are close in space. Variations of this problem, such as finding the nearest neighbors of a point, or finding all objects within a certain distance, are inherent components of applications in many fields. The data may be large so that solving the problem efficiently may require significant computational resources, such as multiple processors or accelerators such as general purpose GPUs. ArborX' main advantage in its ability to solve large problems efficiently utilizing a combination of distributed and on-node parallelism. ArborX can be run efficiently on a wide variety of hardware, including GPUs from different vendors, which distinguishes it from other available libraries which typically choose only few of these. The other advantage is that it supports both types of user problems: spatial problems (useful for intersections and finding objects within certain distance), and nearest neighbor problems. ArborX also supports flexible interface in its interaction with a user. Particularly, it allows a user to call user's own function on a positive match, a functionality not rarely available in other libraries. ArborX implements construction and traversal algorithms using efficient tree structures, such as bounding volume hierarchy (BVH). At its core, ArborX uses linear BVH for its low construction cost and sufficient quality. ArborX implements both spatial and nearest-neighbor traversal algorithms. ArborX also provides several clustering algorithms (minimum spanning tree, DBSCAN, HDBSCAN*), interpolation using minimum least squares and ray tracing. ArborX is written using C++, and is parallelized using the message passing interface (MPI) for the distributed communication, and the Kokkos library for on-node parallelism. This approach allows ArborX to be run on a wide variety of hardware, from common laptops and desktops to supercomputers while using the same codebase.

Prokopenko, Andrey [Oak Ridge National Laboratory ↗

Wide-angle effects for peculiar velocities

ABSTRACT The line-of-sight peculiar velocities of galaxies contribute to their observed redshifts, breaking the translational invariance of galaxy clustering down to a rotational invariance around the observer. This becomes important when the line-of-sight direction varies significantly across a survey, leading to what are known as ‘wide-angle’ effects in redshift-space distortions. Wide-angle effects will also be present in measurements of the momentum field, i.e. the galaxy density-weighted velocity field, in upcoming peculiar velocity surveys. In this work, we study how wide-angle effects modify the predicted correlation function and power spectrum for momentum statistics, both in autocorrelation and in cross-correlation with the density field. Using both linear theory and the Zel'dovich approximation, we find that deviations from the plane-parallel limit are large and could become important in data analysis for low-redshift surveys. We point out that even multipoles in the cross-correlation between density and momentum are non-zero regardless of the choice of line of sight, and therefore contain new cosmological information that could be exploited. We discuss configuration space, Fourier space, and spherical analyses; providing exact expressions in each case rather than relying on an expansion in small angles. We hope these expressions will be of use in the analysis of upcoming surveys for redshift-space distortions and peculiar velocities.

79 ASTRONOMY AND ASTROPHYSICS↗

Improved renormalization group computation of likelihood functions for cosmological data sets

Evaluation of likelihood functions for cosmological large scale structure data sets (including CMB, galaxy redshift surveys, etc.) naturally involves marginalization, i.e., integration, over an unknown underlying random signal field. Recently, I showed how a renormalization group method can be used to carry out this integration efficiently by first integrating out the smallest scale structure, i.e., localized structure on the scale of differences between nearby data cells, then combining adjacent cells in a coarse graining step, then repeating this process over and over until all scales have been integrated. Here I extend the formulation in several ways in order to reduce the prefactor on the method's linear scaling with data set size. The key improvement is showing how to integrate out the difference between specific adjacent cells before summing them in the coarse graining step, compared to the original formulation in which small-scale fluctuations were integrated more generally. I suggest some other improvements in details of the scheme, including showing how to perform the integration around a maximum likelihood estimate for the underlying random field. In the end, an accurate likelihood computation for a million-cell Gaussian test data set runs in two minutes on my laptop, with room for further optimization and straightforward parallelization.

79 ASTRONOMY AND ASTROPHYSICS↗

Towards Superior Software Portability with SHAD and HPX C++ Libraries

As hardware architectures and software stacks complexity grows, development productivity, performance and software portability, quickly evolve from desirable features to actual needs. SHAD, the Scalable High-performance Algorithms and Data-structures C++ library is designed to mitigate these issues: it provides general purpose building blocks as well as high-level custom utilities, and offers a shared-memory programming abstraction which facilitates the programming of complex systems, scaling up to High Performance Computing clusters. SHAD’s portability is achieved through an abstract runtime interface, which decouples the upper layers of the library and hides the low level details of the underlying architecture. This layer enables SHAD to interface with different runtime/threading systems, e.g. Intel TBB and Global Memory and Threading (GMT). However, current backends targeting distributed systems, rely on a centralized controller which may possibly limit scalability up to hundreds of nodes and creates a network hot spot due to all to one communication for synchronization, and possibly resulting in degraded performance at high process counts. In this research, we explore HPX, the C++ standard library for parallelism and concurrency, as an additional backend in support of the SHAD library, and present the methodologies in support of local and remote task executions in SHAD with respect to HPX. Finally, we evaluate the proposed system by comparing against existing backends of SHAD and analyzing their performance on C++ Standard Template Library algorithms.

Wu, Nanmiao↗

Understanding Lustre Internals. Second Edition

The Lustre file system has become a preferred storage resource for systems on the Top500 list, and it is often the file system of choice for small- to medium-sized HPC systems that require parallel shared access to data. Several resources exist to help users deploy and configure Lustre, but the same cannot be said for resources that explain the inner workings of the Lustre source code. A previous ORNL technical report entitled "Understanding Lustre Filesystem Internals" (ORNL/TM-2009/117) provided an excellent summary of Lustre subsystem operations. However, that report is over a decade old and is based on Lustre version 1.6. Since that report was published, Lustre has evolved significantly. Several subsystems underwent significant code changes and many new features have been added to the file system, bringing the current Lustre version up to 2.15.This report aims to document and explain the internal workings of the latest version of the Lustre file system. It will provide more complete and up-to-date information than the previous technical report and should serve as a foundational document for anyone interested in Lustre software development. Key data structures will be described along with the APIs used for interaction among the various Lustre subsystems. Although the Lustre software is constantly being developed, the details in this document should remain relevant for the forseeable future.

97 MATHEMATICS AND COMPUTING↗