Search NASA⌕ Search

SEARCH · Search NASA

Results for “data parallel”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Profiling the Usage of an Extreme-Scale Archival Storage System

Profiling the archival storage system in scientific computing environments has received much less attention compared to the parallel file system, but is equally important since it stores the final data products safely, for a long duration. In this paper, we analyze eight years worth of data transfer logs for accessing the archival file system (HPSS) in the Oak Ridge Leadership Computing Facility (OLCF), which has been hosting the world's largest supercomputers and file systems. Our analysis encompasses about 135 million data transfer activities to the 80 PB High Performance Storage System (HPSS), between 2010 and 2017. We analyze the logs from several dimensions, including studying the workload characteristics (e.g., access patterns, frequency of accesses and temporal behavior), file system characteristics (e.g., directory depth, file system scaling trends, file types), and scientific user behavior (e.g., domain-specific usage and organization). Based on the analysis, we derive insights into the future evolution of the archive in terms of provisioning, desired features and functionality from the archive software, role and right sizing of the archive tiers, quota management, and the importance of smart and efficient metadata and storage management. We believe our study will prove useful for both operating current archival storage and better provisioning future systems.

Sim, Hyogi↗
DOE OSTI2016

Knowledge Discovery for Smart Grid Operation, Control, and Situation Awareness -- A Big Data Visualization Platform

In this paper, a big data visualization platform is designed to discover the hidden useful knowledge for smart grid (SG) operation, control and situation awareness. The spawn of smart sensors at both grid side and customer side can provide large volume of heterogeneous data that collect information in all time spectrums. Extracting useful knowledge from this big-data poll is still challenging. In this paper, the Apache Spark, an open source cluster computing framework, is used to process the big-data to effectively discover the hidden knowledge. A high-speed communication architecture utilizing the Open System Interconnection (OSI) model is designed to transmit the data to a visualization platform. This visualization platform uses Google Earth, a global geographic information system (GIS) to link the geological information with the SG knowledge and visualize the information in user defined fashion. The University of Denver's campus grid is used as a SG test bench and several demonstrations are presented for the proposed platform.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

MARBLES (Multi-scale Adaptively Refined Boltzmann LatticE Solver) [SWR-23-37]

MARBLES (Multi-scale Adaptively Refined Boltzmann LatticE Solver) is an open-source computational fluid dynamics package powered by the lattice Boltzmann equations and built on AMReX. In the lattice Boltzmann method, local collisions between meso-scale fictitious particles drive the governing equations which enables MARBLES to easily simulate flow around complex and/or moving geometry without the generation of a body-conforming mesh. Using AMReX data structures and operations ensures a high level of computational performance and parallel scaling on heterogenous architectures while also naturally supporting locally enhanced grid resolution and fidelity through automatic mesh refinement. New domains and problem definitions are easily specified through an input file with examples and guidance on all options and variables provided in the MARBLES documentation.

Henry de Frahan, Marc↗
DOE OSTI2021

Efficient exascale discretizations: High-order finite element methods

Efficient exploitation of exascale architectures requires rethinking of the numerical algorithms used in many large-scale applications. These architectures favor algorithms that expose ultra fine-grain parallelism and maximize the ratio of floating point operations to energy intensive data movement. One of the few viable approaches to achieve high efficiency in the area of PDE discretizations on unstructured grids is to use matrix-free/partially assembled high-order finite element methods, since these methods can increase the accuracy and/or lower the computational time due to reduced data motion. In this paper we provide an overview of the research and development activities in the Center for Efficient Exascale Discretizations (CEED), a co-design center in the Exascale Computing Project that is focused on the development of next-generation discretization software and algorithms to enable a wide range of finite element applications to run efficiently on future hardware. CEED is a research partnership involving more than 30 computational scientists from two US national labs and five universities, including members of the Nek5000, MFEM, MAGMA and PETSc projects. We discuss the CEED co-design activities based on targeted benchmarks, miniapps and discretization libraries and our work on performance optimizations for large-scale GPU architectures. We also provide a broad overview of research and development activities in areas such as unstructured adaptive mesh refinement algorithms, matrix-free linear solvers, high-order data visualization, and list examples of collaborations with several ECP and external applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

PeleLMeX: an AMR Low Mach Number Reactive Flow Simulation Code without level sub-cycling

PeleLMeX simulates chemically reacting low Mach number flows with block-structured adaptive mesh refinement (AMR). The code is built upon the AMReX library, which provides the underlying data structures and tools to manage and operate on them across massively parallel computing architectures. PeleLMeX algorithmic features are inherited from its predecessor PeleLM but key improvements allow representation of more complex physical processes. Together with its compressible flow counterpart PeleC, the thermo-chemistry library PelePhysics and the multi-physics library PeleMP, it forms the Pele suite of open-source reactive flow simulation codes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

An Experimental Investigation of Distributed Acoustic Sensing (DAS) on Lake Ice

A vibration-sensitive, Distributed Acoustic Sensor (DAS) array, using fiber-optic cables, was deployed in a triangularly shaped geometry on the frozen surface of Lake Mendota in Madison, Wisconsin, USA. The purpose of the array and testing program was to analyze the DAS response and to utilize the high spatial density of the distributed array for system response characterization in a well-constrained, small, surface array. A geophone array was also deployed to provide a reference system. The design of the array allowed us to assess the response of DAS with respect to distance from the seismic sources, the degradation of the response with length of the cable, the directivity of the fiber response with respect of the direction of the particle motion, and the quality of the signal with respect to cable type. The DAS array was examined for different cable constructions and orientations relative to the source propagation direction. Tight-buffered and loose-tube fiber-optic cable constructions were used, with both having good signal responses when well-coupled to the ice. In general, the tight-buffered cable was better suited for DAS applications. Directional sensitivity of the DAS was also inspected for several directions of wave propagation and particle motion. The results showed that the strongest DAS signals were recorded when the direction of the fiber was oriented parallel to the direction of particle motion. Lastly, the DAS and geophone data sets were examined together to qualitatively determine, in conjunction with established DAS best practices, how the high spatial density offered by DAS could improve results over traditional point sensor arrays in certain situations.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Practical procedures for sensor quality assessment

Sensors are increasingly deployed for process monitoring and control. These produce on-line measurements at a high frequency, in parallel with low-frequency laboratory measurements. Compared to laboratory practices, sensor data quality assessment and control practices are far less structured at most utilities. This leads to inaccurate sensor data with unknown uncertainty factors.This chapter shows how to establish standard operating procedures (SOPs) to support sensor data quality assessment and control and subsequent maintenance actions by producing relevant sensor metadata. Furthermore, SOPs are provided for the most commonly used wastewater quality sensors, inspired by utility and academic best practices. This chapter builds on definitions provided in Chapter 3 and provides additional definitions specifically related to sensors maintenance. Chapter 6 complements the methods in this chapter, which are based on reference measurements, with data-analytical techniques.

Alferes, Janelcy↗
DOE OSTI2015

The role of carbonic anhydrase in C 4 photosynthesis

Current pressures on the global food supply have accelerated the urgency for a second green revolution using novel and sustainable approaches to increase crop yield and efficiency. This proposal outlines experiments to address fundamental questions regarding the biology of C 4 photosynthesis, the method of carbon fixation utilized by the most productive food, feed and bioenergy crops. Carbonic anhydrase (CA) has been implicated in multiple cellular functions including nitrogen metabolism, water use efficiency, and photosynthesis. CA catalyzes the first dedicated step in C 4 photosynthesis, the hydration of CO 2 into bicarbonate, and is potentially rate limiting in C 4 grasses. Using insertional mutagenesis, we have generated CA mutants in maize, and propose the characterization of these mutants using phenotypic, physiological, and transcriptomic profiling to assay the plant’s response to altered CA activity. In addition, florescent protein tagging experiments will be employed to study the subcellular localization of CA paralogs, providing critical data for modeling carbon fixation in C 4 plants. Finally, I propose parallel experiments in Setaria viridis to explore its relevance as model C 4 grass. Using a multifaceted approach, this proposal addresses important questions in basic biology, as well as the need for translation research in response to looming global food challenges.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Indirect reactions and connection with R-matrix theory

It is often the case that nuclear reactions that are important for societal applications or basic science are difficult to measure directly in existing facilities for accelerated beams. The difficulty might be associated with an exceedingly small cross section, as the ones obtained at beam energies well below the Coulomb barrier, or with the impossibility of devising a short-lived target, as is the case for neutron-induced reactions on unstable isotopes. The fruitful line of experimental research addressing this issue with alternative (indirect) reactions has been developed in parallel to the theory needed to make the connection between the observed data and the desired cross sections of the (direct) reaction under study. Within this context, we present here an explicit connection between the indirect cross section and the R-matrix parameters which describe the energy-dependent cross section of the desired direct reaction.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Turbulence, Waves, and Taylor’s Hypothesis for Heliosheath Observations

Magnetic field fluctuations measured in the heliosheath by the Voyager spacecraft are often characterized as compressible, as indicated by a strong fluctuating component parallel to the mean magnetic field. However, the interpretation of the turbulence data faces the caveat that the standard Taylor’s hypothesis is invalid because the solar wind flow velocity in the heliosheath becomes subsonic and slower than the fast magnetosonic speed, given the contributions from hot pickup ions (PUIs) in the heliosheath. We attempt to overcome this caveat by introducing a 4D frequency-wavenumber spectral modeling of turbulence, which is essentially a decomposition of different wave modes following their respective dispersion relations. Isotropic Alfvén and fast mode turbulence are considered to represent the heliosheath fluctuations. We also include two dispersive fast wave modes derived from a three-fluid theory. We find that (1) magnetic fluctuations in the inner heliosheath are less compressible than previously thought, an isotropic turbulence spectral model with about 25% in compressible fluctuation power is consistent with the observed magnetic compressibility in the heliosheath; (2) the hot PUI component and the relatively cold solar wind ions induce two dispersive fast magnetosonic wave branches in the perpendicular propagation limit, PUI fast wave may account for the spectral bump near the proton gyrofrequency in the observable spectrum; (3) it is possible that the turbulence wavenumber spectrum is not Kolmogorov-like although the observed frequency spectrum has a −5/3 power-law index, depending on the partitioning of power among the various wave modes, and this partitioning may change with wavenumber.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Integration of Titan supercomputer at OLCF with ATLAS Production System

The PanDA (Production and Distributed Analysis) workload management system was developed to meet the scale and complexity of distributed computing for the ATLAS experiment. PanDA managed resources are distributed worldwide, on hundreds of computing sites, with thousands of physicists accessing hundreds of Petabytes of data and the rate of data processing already exceeds Exabyte per year. While PanDA currently uses more than 200,000 cores at well over 100 Grid sites, future LHC data taking runs will require more resources than Grid computing can possibly provide. Additional computing and storage resources are required. Therefore ATLAS is engaged in an ambitious program to expand the current computing model to include additional resources such as the opportunistic use of supercomputers. In this paper we will describe a project aimed at integration of ATLAS Production System with Titan supercomputer at Oak Ridge Leadership Computing Facility (OLCF). Current approach utilizes modified PanDA Pilot framework for job submission to Titan's batch queues and local data management, with lightweight MPI wrappers to run single node workloads in parallel on Titan's multi-core worker nodes. It provides for running of standard ATLAS production jobs on unused resources (backfill) on Titan. The system already allowed ATLAS to collect on Titan millions of core-hours per month, execute hundreds of thousands jobs, while simultaneously improving Titans utilization efficiency. We will discuss the details of the implementation, current experience with running the system, as well as future plans aimed at improvements in scalability and efficiency.

Megino, F. Barreiro↗
DOE OSTI2020

Uncovering Access, Reuse, and Sharing Characteristics of I/O-Intensive Files on Large-Scale Production HPC Systems

Large-scale high-performance computing (HPC) applications running on supercomputers produce large amounts of data routinely and store it in files on multi-PB shared parallel storage systems. Unfortunately, storage community has a limited understanding of the access and reuse patterns of these files. This paper investigates the access and reuse patterns of I/O-intensive files on a production-scale supercomputer.

Patel, Tirthak↗
DOE OSTI2021

AXEAP (ARGONNE X-RAY EMISSION PACKAGE)

Argonne X-ray Emission Package (AXEAP), a singular purpose software package for processing X-ray emission (XES) images collected with a 2-dimensional position sensitive pixel array detector, has been developed. AXEAP can rapidly convert XES image files into a spectral form by applying parallel computation and unsupervised machine learning to compute vast amount of image data. Special focus has been placed on designing user-friendly-interface for processing multiple edges, non-resonant and resonant x-ray emission image analysis, in order to make data processing quick and easy. AXEAP is free software and is written in MATLAB, armed with powerful libraries and toolboxes. The software runs on all common operating systems such as Linux, Window, and Mac.

SUN, CHENGJUN↗
DOE OSTI2016

Scale-dependent normalized amplitude and weak spectral anisotropy of magnetic field fluctuations in the solar wind turbulence

Turbulence in the solar wind was recently reported to be anisotropic, with the average power spectral index close to −2 when sampling parallel to the local mean magnetic field B{sub 0} and close to −5/3 when sampling perpendicular to the local B{sub 0}. This result was widely considered to be observational evidence for the critical balance theory (CBT), which is derived by making the assumption that the turbulence strength is close to one. However, this basic assumption has not yet been checked carefully with observational data. Here we present for the first time the scale-dependent magnetic-field fluctuation amplitude, which is normalized by the local B{sub 0} and evaluated for both parallel and perpendicular sampling directions, using two 30-day intervals of Ulysses data. From our results, the turbulence strength is evaluated as much less than one at small scales in the parallel direction. An even stricter criterion is imposed when selecting the wavelet coefficients for a given sampling direction, so that the time stationarity of the local B{sub 0} is better ensured during the local sampling interval. The spectral index for the parallel direction is then found to be −1.75, whereas the spectral index in the perpendicular direction remains close to −1.65. These two new results, namely that the value of the turbulence strength is much less than one in the parallel direction and that the angle dependence of the spectral index is weak, cannot be explained by existing turbulence theories, like CBT, and thus will require new theoretical considerations and promote further observations of solar-wind turbulence.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

2016 High Performance Computing Annual Report

Sandia National Laboratories’ California site is celebrating its 60th anniversary (1956 to 2016), and high performance computing has been a key enabler for its scientists and engineers throughout much of its history. Since its founding, Sandia California has helped pioneer the use of HPC platforms including hosting Sandia’s first Cray-1 supercomputer in the 1970s and supporting development of scalable cluster computing platforms to create a new paradigm for cost-effective supercomputing in the 1990s. Recent decades of investment in creation of scalable application frameworks for scientific computing have also enabled new generations of modeling and simulation codes. These resources have facilitated computational analysis of complex phenomena in diverse applications spanning national defense, energy, and homeland security. Today, Sandia California researchers work with partners in academia, industry, and national labs to evolve the state-of-the-art in HPC, modeling, and data analysis (including foundational capabilities for exascale computing platforms) and apply them in transformational ways. Research efforts include mitigating the effects of silent hardware failures that can jeopardize the results of large-scale computations, developing exascale-capable asynchronous task-parallel programming models and runtime systems, formulating new techniques to better explore and analyze extreme-scale data sets, and increasing our understanding of materials and chemical sciences which has applications spanning nuclear weapons stockpile stewardship to more efficient automobile engines. The following section highlights some of these research and applications projects and further illustrates the breadth of our HPC capabilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Compressing unstructured mesh data from simulations using machine learning

The amount of data output from a computer simulation has grown to terabytes and petabytes as increasingly complex simulations are being run on massively parallel systems. As we approach exaflop computing in the next decade, it is expected that the I/O subsystem will not be able to write out these large volumes of data. In this paper, we explore the use of machine learning to compress the data before it is written out. Despite the computational constraints that limit us to using very simple learning algorithms, our results show that machine learning is a viable option for compressing unstructured data. Furthermore, we demonstrate that by simply using a better sampling algorithm to generate the training set, we can obtain more accurate results compared to random sampling, but at no extra cost. Further, by carefully selecting and incorporating points with high prediction error, we can improve reconstruction accuracy without sacrificing the compression rate.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

THE ROLE OF ERUPTING SIGMOID IN TRIGGERING A FLARE WITH PARALLEL AND LARGE-SCALE QUASI-CIRCULAR RIBBONS

In this paper, we present observations and analysis of an interesting sigmoid formation, eruption, and the associated flare that occurred on 2014 April 18 using multi-wavelength data sets. We discuss the possible role of the sigmoid eruption in triggering the flare, which consists of two different sets of ribbons: parallel ribbons and a large-scale quasi-circular ribbon. Several observational evidence and nonlinear force-free field extrapolation results show the existence of a large-scale fan-spine type magnetic configuration with a sigmoid lying under a section of the fan dome. The event can be explained with the following two phases. During the preflare phase, we observed the formation and appearance of the sigmoid via tether-cutting reconnection between the two sets of sheared fields under the fan dome. The second, main flare phase features the eruption of the sigmoid, the subsequent flare with parallel ribbons, and a quasi-circular ribbon. We propose the following multi-stage successive reconnection scenario for the main flare. First, tether-cutting reconnection is responsible for the formation and the eruption of the sigmoid structure. Second, the reconnection occurring in the wake of the erupting sigmoid produces the parallel flare ribbons on the both sides of the circular polarity inversion line. Third, the null-type reconnection higher in the corona, possibly triggered by the erupting sigmoid, leads to the formation of a large quasi-circular ribbon. For the first time, we suggest a mechanism for this type of flare consisting of a double set of ribbons triggered by an erupting sigmoid in a large-scale fan-spine-type magnetic configuration.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Mechanistic Studies of the Oxidation of Cyclohexene to 2-Cyclohexen-1-one over ALD Prepared Titania Supported Vanadia

Selective oxidation of cyclohexene to 2-cyclohexen-1-one over titania supported vanadia (VO x /TiO 2 ) has been studied using temperature dependent in-situ FTIR spectroscopy in both the presence and absence of oxygen. The VO x /TiO 2 samples were prepared using one atomic layer deposition (ALD) cycle and characterized by Raman spectroscopy. In-situ FTIR data for the oxidation of cyclohexene and perdeuterocyclohexene allow for the formulation of a molecular level reaction mechanism, which is initiated by the transfer of an allyl hydrogen. Oxidation of perdeuterocyclohexene provides a direct probe of the formation of OD and HDO moieties that support the involvement of specific steps in the proposed mechanism. The presence of gas phase oxygen does not lead to a change in the products versus anaerobic conditions. However, gas phase oxygen is significantly incorporated in the CO 2 over-oxidation product above ~250 °C. Data were also obtained with cyclohexene epoxide as the reactant in an effort to determine whether there is a parallel reaction pathway, which is initiated by C=C activation in cyclohexene, that involves cyclohexene epoxide as an intermediate. Furthermore, though a minor pathway involving a cyclohexene epoxide intermediate cannot be ruled out, these data demonstrate that, under experimental conditions, the dominant pathway from cyclohexene to cyclohexene-1-one is initiated by an allyl-H activation step and does not involve an epoxide intermediate.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗