Search NASA⌕ Search

SEARCH · Search NASA

Results for “granular data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Zircon, Baddeleyite, and Reidite Found in Ries Crater Suevite

Introduction: Impact events can generate superheated impact melts and even vapor [1]. In the past decade, evidence of the high temperatures and high pressures of the impact process has been found in the impact melt from terrestrial craters (e.g., Mistastin Lake [2], Meteor Crater [3]) and even on the Moon [4–5]. Often, these studies involve zircon or zirconium-bearing phases. Zircon is a particularly useful mineral, due to its robustness and durability against weathering. It is used principally for chronology, but it has a multitude of geologic applications, including geothermometry and fingerprinting magma sources. Here we focus on its capability of recording impact conditions. Grains of zircon (ZrSiO4) are converted at high temperature and/or pressure during an impact event to reidite (a high-pressure polymorph of ZrSiO4) or to tetragonal-ZrO2 + SiO2 [6]. Reidite and tertragonal-ZrO2 leave identifying relicts in the rocks, markers of the high pressures and/or temperatures these rocks underwent. Ries Crater is a 26-km-diameter peak ring crater in southern Germany that formed approximately 15 Ma [7–9]. Ries is the type locality of the polymict impact breccia known as suevite. Here, we report a microanalytical study of suevite from the Ries impact structure. These analyses are used to inform our understanding of the pressure and temperature conditions involved in creating a polymict impact breccia such as suevite in a peak ring crater. Sample Description: The sample, denoted 16RS08, originates from Otting Quarry, at 48.8777° N, 10.7921° E, approximately 17 km from the center of the Ries Crater in Germany (approximately 4 km outside the crater rim). The material recorded in sample 16RS08 is therefore considered an outer suevite. The outer suevite is a discontinuous layer of polymict impact breccia that occurs outside the central ring of Ries, up to 22 km from the center of the crater [9]. Lithic clasts in the outer suevite consist primarily of crystalline basement rocks (gneiss, granite, amphibolite), with less than 5% of lithic clasts being overlying sedimentary rocks (limestone, sandstone, shale) [9]. The thin section studied contains variably shocked lithic and mineral clasts, impact glass, and interstitial minerals that make up the matrix of the breccia (Fig. 1) [9]. Methods: We used a Cameca SX100 electron probe microanalyzer (EPMA) located in the Kuiper Materials Imaging and Characterization Facility (KMICF) at the University of Arizona to obtain 15 elemental X-ray maps of 16RS08. We next used the JEOL 7900F SEM at the Astromaterials Research & Exploration Science (ARES) at NASA Johnson Space Center (JSC) to obtain electron backscatter diffraction (EBSD) maps and energy dispersive X-ray spectroscopy (EDS) maps of select portions of the section. The EBSD data were collected under beam conditions of 20 kV, and ~9 μA, with step sizes varying from 0.05 to 2 μm. Following EBSD data collection, we processed the data using AZtecCrystal and MTEX, a free MATLAB toolbox. Results: We used the elemental X-ray maps to identify the areas of interest in the section, particularly phosphates and Zr-bearing grains. These areas of interest were then targeted for follow up EBSD and EDS analyses. We have identified, through combined EBSD and EDS analysis, the presence of zircon, reidite, and monoclinic-ZrO2 (baddeleyite) in 16RS08. In 16RS08, we have found singular grains of zircon, zircon with a vermicular baddeleyite halo (Fig. 2a), and granular zircon with reidite (Fig. 2b). The different Zr-rich phases and their corresponding textures signifies that this sample underwent a broad spectrum of pressure and temperature conditions during the impact event. For example, zircons surrounded by a vermicular baddeleyite and SiO2 intergrowth (i.e., Fig. 2a) have been shown to preserve evidence of the extremely high temperatures of impact melt, upwards of 2370 °C [2, 6]. Similarly, reidite and granular zircon (i.e., Fig. 2b) have been shown to preserve evidence of high pressure, as the transition to reidite occurs >30 GPa [3, 6]. Future Work: Next, we will process the EBSD and EDS data for these Zr-rich grains, specifically looking for indicators of cubic- or tetragonal-ZrO2 in the baddeleyite remnants and of shock-precursors to the reidite. To further inform our work, we will also obtain BSE images of these grains using a Hitachi S-4800 SEM in KMICF at the University of Arizona, as well as geochemical spot analyses via EPMA. The data collected will be used to constrain the formation conditions of the Ries Crater outer suevite. Acknowledgments: We thank Ken Domanik and Jerry Chang for their support with data collection. This work was supported by a University of Arizona RII Core Facilities Pilot Program grant and start-up funds to JJB. TME thanks A. Cavosie and N. Timms for assistance during field sampling. We acknowledge support from NASA’s Planetary Science Research program for analysis performed at JSC. References: [1] Melosh H. J. (1989) Oxf. U. Press. [2] Timms et al. (2017) EPSL 477, 52–58. [3] Cavosie et al. (2016) Geology 44:9, 703–706. [4] White et al. (2020) Nature Astr. 4, 974–978. [5] Crow C. A. et al. (2017) GCA 202, 264–284. [6] Timms et al. (2017) Earth-Sci. Rev. 165, 185–202. [7] Schmieder M. et al. (2018) GCA 220, 146–157. [8] Schwarz W. H. et al. (2020) M&PS 55:2, 312–325. [9] Stöffler et al. (2013) M&PS 43:4, 515–589.

Zircon↗

Performance Model of MapReduce Iterative Applications for Hybrid Cloud Bursting

Hybrid cloud bursting (i.e., leasing temporary off-premise cloud resources to boost the overall capacity during peak utilization) can be a cost-effective way to deal with the increasing complexity of big data analytics, especially for iterative applications. However, the low throughput, high latency network link between the on-premise and off-premise resources (“weak link”) makes maintaining scalability difficult. While several data locality techniques have been designed for big data bursting on hybrid clouds, their effectiveness is difficult to estimate in advance. Yet such estimations are critical, because they help users decide whether the extra pay-as-you-go cost incurred by using the off-premise resources justifies the runtime speed-up. To this end, the current paper presents a performance model and methodology to estimate the runtime of iterative MapReduce applications in a hybrid cloud-bursting scenario. The paper focuses on the overhead incurred by the weak link at fine granularity, for both the map and the reduce phases. This approach enables high estimation accuracy, as demonstrated by extensive experiments at scale using a mix of real-world iterative MapReduce applications from standard big data benchmarking suites that cover a broad spectrum of data patterns. As a result, not only are the produced estimations accurate in absolute terms compared with experimental results, but they are also up to an order of magnitude more accurate than applying state-of-art estimation approaches originally designed for single-site MapReduce deployments.

97 MATHEMATICS AND COMPUTING↗

Evaluating the sustainability of the 2017 US biofuel industry with an integrated techno-economic analysis and life cycle assessment

The United States produced more than 66.2 billion Liters of biofuel, primarily in the form of corn ethanol (61 billion Liters) and soybean biodiesel (6 billion Liters), for the transportation industry in 2017. No work currently exists that evaluates both the economic and environmental outcomes of this industry with adequate geospatial resolution and national scope. In this study, a model framework is constructed to perform Techno-Economic Analysis and Life Cycle Assessment using high-resolution input datasets to provide a granular estimation of corn ethanol and soybean biodiesel sustainability performance in most counties in the United States in 2017 (the most recent year for which data is available). Results show a total life cycle, greenhouse gas emission volume of 99.5 million Mg CO 2-eq produced in 2017 by these two biofuels (94.8 million Mg from corn ethanol, and 4.7 million Mg from soybean biodiesel), excluding indirect land use change emissions. Further, this volume corresponds to a combined carbon intensity of 65.3 gCO 2-eq /MJ, which is a greenhouse gas improvement compared to petroleum-based gasoline (the carbon intensity of conventional gasoline is 93.0 gCO 2-eq /MJ). However, these biofuels are produced at an additional economic cost ($1.8 billion over the displaced gas/diesel). Additionally, these biofuels generate unfavorable impacts in other environmental categories when compared to petroleum-based fuels, particularly in areas of water, land, and nitrogen intensity. This work enables stakeholders to assess the specific value of biofuels as a means of emission reduction and determine if the attained improvements are worth the associated opportunity costs.

09 BIOMASS FUELS↗

Fixed-rate compressed floating-point arrays

ZFP is a library for lossy compression of single- and double-precision floating-point data. One of the unique features of ZFP is its support for fixed-rate compression, which enables random read and write access at the granularity of small blocks of values. Using a C++ interface, this allows declaring compressed arrays (1D, 2D, and 3D arrays are supported) that through operator overloading can be treated just like conventional, uncompressed arrays, but which allow the user to specify the exact number of bits to allocate to the array. ZFP also has variable-rate fixed-precision and fixed-accuracy modes, which allow the user to specify a tolerance on the relative or absolute error.

ECP↗

Mechanical properties of granular materials: A variational approach to grain-scale simulations

The mechanical properties of cohesionless granular materials are evaluated from grain-scale simulations. A three-dimensional pack of spherical grains is loaded by incremental displacements of its boundaries. The deformation is described as a sequence of equilibrium configurations. Each configuration is characterized by a minimum of the total potential energy. This minimum is computed using a modification of the conjugate gradient algorithm. Our simulations capture the nonlinear, path-dependent behavior of granular materials observed in experiments. Micromechanical analysis provides valuable insight into phenomena such as hysteresis, strain hardening and stress-induced anisotropy. Estimates of the effective bulk modulus, obtained with no adjustment of material parameters, are in agreement with published experimental data. The model is applied to evaluate the effects of hydrate dissociation in marine sediments. Weakening of the sediment is quantified as a reduction in the effective elastic moduli.

54 ENVIRONMENTAL SCIENCES↗

Synthesizing realistic sand assemblies with denoising diffusion in latent space

Abstract The shapes and morphological features of grains in sand assemblies have far‐reaching implications in many engineering applications, such as geotechnical engineering, computer animations, petroleum engineering, and concentrated solar power. Yet, our understanding of the influence of grain geometries on macroscopic response is often only qualitative, due to the limited availability of high‐quality 3D grain geometry data. In this paper, we introduce a denoising diffusion algorithm that uses a set of point clouds collected from the surface of individual sand grains to generate grains in the latent space. By employing a point cloud autoencoder, the three‐dimensional point cloud structures of sand grains are first encoded into a lower‐dimensional latent space. A generative denoising diffusion probabilistic model is trained to produce synthetic sand that maximizes the log‐likelihood of the generated samples belonging to the original data distribution measured by a Kullback‐Leibler divergence. Numerical experiments suggest that the proposed method is capable of generating realistic grains with morphology, shapes and sizes consistent with the training data inferred from an F50 sand database. We then use a rigid contact dynamic simulator to pour the synthetic sand in a confined volume to form granular assemblies in a static equilibrium state with targeted distribution properties. To ensure third‐party validation, 50,000 synthetic sand grains and the 1542 real synchrotron microcomputed tomography (SMT) scans of the F50 sand, as well as the granular assemblies composed of synthetic sand grains are made available in an open‐source repository.

Vlassis, Nikolaos N.↗

Incorporating space and time into random forest models for analyzing geospatial patterns of drug-related crime incidents in a major U.S. metropolitan area

The opioid crisis has hit American cities hard, and research on spatial and temporal patterns of drug-related activities including detecting and predicting clusters of crime incidents involving particular types of drugs is useful for distinguishing hot zones where drugs are present that in turn can further provide a basis for assessing and providing related treatment services. In this study, we investigated spatiotemporal patterns of more than 52,000 reported incidents of drug-related crime at block group granularity in Chicago, IL between 2016 and 2019. We applied a space-time analysis framework and machine learning approaches to build a model using training data that identified whether certain locations and built environment and sociodemographic factors were correlated with drug-related crime incident patterns, and establish the top contributing factors that underlaid the trends. Space and time, together with multiple driving factors, were incorporated into a random forest model to analyze these changing patterns. We accommodated both spatial and temporal autocorrelation in the model learning process to assist with capturing the changes over time and tested the capabilities of the space-time random forest model by predicting drug-related activity hot zones. Overall, we focused particularly on crime incidents that involved heroin and synthetic drugs as these have been key drug types that have highly impacted cities during the opioid crisis in the U.S.

97 MATHEMATICS AND COMPUTING↗

Ontology based molecular signatures for immune cell types via gene expression analysis

Background: New technologies are focusing on characterizing cell types to better understand their heterogeneity. With large volumes of cellular data being generated, innovative methods are needed to structure the resulting data analyses. Here, we describe an ‘Ontologically BAsed Molecular Signature’ (OBAMS) method that identifies novel cellular biomarkers and infers biological functions as characteristics of particular cell types. This method finds molecular signatures for immune cell types based on mapping biological samples to the Cell Ontology (CL) and navigating the space of all possible pairwise comparisons between cell types to find genes whose expression is core to a particular cell type’s identity. Results: We illustrate this ontological approach by evaluating expression data available from the Immunological Genome project (IGP) to identify unique biomarkers of mature B cell subtypes. We find that using OBAMS, candidate biomarkers can be identified at every strata of cellular identity from broad classifications to very granular. Furthermore, we show that Gene Ontology can be used to cluster cell types by shared biological processes in order to find candidate genes responsible for somatic hypermutation in germinal center B cells. Moreover, through in silico experiments based on this approach, we have identified genes sets that represent genes overexpressed in germinal center B cells and identify genes uniquely expressed in these B cells compared to other B cell types. Conclusions: This work demonstrates the utility of incorporating structured ontological knowledge into biological data analysis – providing a new method for defining novel biomarkers and providing an opportunity for new biological insights.

59 BASIC BIOLOGICAL SCIENCES↗

Initial Demonstration of the Real-Time Safety Monitoring Framework for the National Airspace System Using Flight Data

As new operational paradigms and additional aircraft are being introduced into the National Airspace System (NAS), maintaining safety in such a rapidly growing environment becomes more challenging. It is therefore desirable to have an automated framework to provide an overview of the current safety of the airspace at different levels of granularity, as well an understanding of how the state of the safety will evolve into the future given the anticipated flight plans, weather forecast, predicted health of assets in the airspace, and so on. Towards this end, as part of our earlier work, we formulated the Real-Time Safety Monitoring (RTSM) framework for monitoring and predicting the state of safety and to predict unsafe events. In our previous work, the RTSM framework was demonstrated in simulation on three different constructed scenarios. In this paper, we further develop the framework and demonstrate it on real flight data from multiple data sources. Specifically, the flight data is obtained through the Shadow Mode Assessment using Realistic Technologies for the National Airspace System (SMART-NAS) Testbed that serves as a central point of collection, integration, and access of information from these different data sources. By testing and evaluating using real-world scenarios, we may accelerate the acceptance of the RTSM framework towards deployment. In this paper we demonstrate the framework's capability to not only estimate the state of safety in the NAS, but predict the time and location of unsafe events such as a loss of separation between two aircraft, or an aircraft encountering convective weather. The experimental results highlight the capability of the approach, and the kind of information that can be provided to operators to improve their situational awareness in the context of safety.

Real-time Safety Monitoring↗

Internship Tasks Associated With CIF Icy Regolith Excavation and Volatile Capture Under Vacuum Conditions

Understanding the surface and atmosphere of Mars is critical to current and future development of exploration systems. Dealing with the Martian regolith-the top layer of soil-remains a significant challenge, and much research is still needed. Addressing this need, the Cryogenics Test Lab and Granular Mechanics and Regolith Operations Lab at NASA's Kennedy Space Center are partnering to develop an apparatus that utilizes simulated Martian regolith in an analogous atmospheric environment to gather data about how the material behaves when exposed to water vapor. Martian surface temperatures range from 128 K (-145 C) to 308 K (35 C), and the average pressure is approximately 4.5 Torr; which presents an environment where water can potentially exist in vapor, solid or liquid form. And based on prior Mars missions such as the Phoenix Lander, it is known that water-ice exists just below the surface. This test apparatus will attempt to recreate the conditions that contributed to the Martian ice deposits by exposing a sample to water vapor at low pressure and temperature; thereby forming ice inside the simulant via diffusion. From this, we can better understand the properties and behavior of the regolith, and have more knowledge concerning its ability to store water-and subsequently, how to dig up and extract that water-which will be crucial to sample gathering when the first manned Mars mission takes place.

Thermal-Vacuum Testing↗

The Jefferson Lab Eta Factory Experiment and Applications of PbWO4 Calorimeters in Future Experimental Facilities

The goal of the new JLab Eta Factory (JEF) experiment, conducted with the GlueX detector in Hall D at Jefferson Lab, is to perform measurements of various ¿(') decays with a primary focus on rare neutral modes. The experiment’s physics program ranges from precision tests of low-energy QCD to searches for gauge bosons with masses below 1 GeV that could couple the Standard Model (SM) sector to the dark sector. The experiment will collect a high-statistics data sample of ¿(') mesons produced via a beam of tagged photons. The GlueX detector features a large, nearly uniform acceptance for both neutral and charged particles, enabling efficient identification of complex multi-particle final states. To meet the requirements of the JEF experiment, the inner section of the forward lead-glass calorimeter in the GlueX detector has been upgraded with lead tungstate (PbWO4) scintillating crystals. PbWO4 offers exceptional characteristics, such as a small radiation length and Molire radius, and large light yield, that make it ideal for constructing high- granularity, high-resolution, radiation-hard detectors. These properties enable excellent spatial separation and energy resolution of reconstructed electromagnetic showers, establishing PbWO4 as the material of choice for many high-precision experiments. The JEF experiment began data collection in April 2025 and will operate concurrently with the GlueX experiment, whose primary objective is the search for gluonic excitations in the meson spectrum. I will give an overview of the JEF experiment, the GlueX detector, and the feasibility of further upgrades to support future ¿ physics studies. Special attention will be given to the newly constructed PbWO4 scintillating calorimeter and recent advancements in calorimeter instrumentation.

Somov, Alexander↗

Open-source MFIX-DEM software for gas-solids flows: Part II — Validation studies

With rapid advancements in computer hardware and numerical algorithms, computational fluid dynamics (CFD) has been increasingly employed as a useful tool for investigating the complex hydrodynamics inherent in multiphase flows. An important step during the development of a CFD model and prior to its application is conducting careful and comprehensive verification and validation studies. Accordingly, efforts to verify and validate the open-source MFIX-DEM software, which can be used for simulating the gas–solids flow using an Eulerian reference frame for the continuum fluid and a Lagrangian discrete framework (Discrete Element Method) for the particles, have been made at the National Energy Technology Laboratory (NETL). In part I of this paper, extensive verification studies were presented and in this part, detailed validation studies of MFIX-DEM are presented. A series of test cases covering a range of gas–solids flow applications were conducted. In particular the numerical results for the random packing of a binary particle mixture, the repose angle of a sandpile formed during a side charge process, velocity, granular temperature, and voidage profiles from a bounded granular shear flow, lateral voidage and velocity profiles from a monodisperse bubbling fluidized bed, lateral velocity profiles from a spouted bed, and the dynamics of segregation of a binary mixture in a bubbling bed were compared with available experimental data, and in some instances with empirical correlations. In addition, sensitivity studies were conducted for various parameters to quantify the error in the numerical simulation.

42 ENGINEERING↗

An efficient and reliable predictive method for fluidized bed simulation

In past decades, the continuum approach was the only practical technique to simulate large-scale fluidized bed reactors because discrete approaches suffer from the cost of tracking huge numbers of particles and their collisions. This study significantly improved the computation speed of discrete particle methods in two steps: First, the time-driven hard-sphere (TDHS) algorithm with a larger time-step is proposed allowing a speedup of 20-60 times; second, the number of tracked particles is reduced by adopting the coarse-graining technique gaining an additional 2-3 orders of magnitude speedup of the simulations. A new velocity correction term was introduced and validated in TDHS to solve the over-packing issue in dense granular flow. The TDHS was then coupled with the coarse-graining technique to simulate a pilot-scale riser. The simulation results compared well with experiment data and proved that this new approach can be used for efficient and reliable simulations of large-scale fluidized bed systems.

42 ENGINEERING↗

High-precision measurement of the W boson mass with the CMS experiment

In the standard model of particle physics, the masses of the W and Z bosons, the carriers of the weak interaction, are uniquely related. A precise determination of their masses is important because quantum loops of heavy, undiscovered particles could modify this relationship. Although the Z mass is known to the remarkable precision of 22 parts per million (2.0 MeV), the W mass is known much less precisely. A global fit to measured electroweak observables predicts the W mass with 6 MeV uncertainty [1$-$3]. Reaching a comparable experimental precision would be a sensitive and fundamental test of the standard model, made even more urgent by a recent challenge to the global fit prediction by a measurement from the CDF Collaboration at the Fermilab Tevatron collider [4]. Here we report the measurement of the W mass by the CMS Collaboration at the CERN LHC, based on a large data sample of $W \to \mu \nu$ events collected in 2016 at the proton-proton collision energy of 13 TeV. The measurement exploits a high-granularity maximum likelihood fit to the kinematic properties of muons produced in W decays. By combining an accurate determination of experimental effects with marked in situ constraints of theoretical inputs, we reach a precise measurement of the W mass, of 80 360.2 $\pm$ 9.9 MeV, in agreement with the standard model prediction.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Smart pixel sensors: towards on-sensor filtering of pixel clusters with deep learning

Highly granular pixel detectors allow for increasingly precise measurements of charged particle tracks. Next-generation detectors require that pixel sizes will be further reduced, leading to unprecedented data rates exceeding those foreseen at the High- Luminosity Large Hadron Collider. Signal processing that handles data incoming at a rate of $\mathcal{O}$(40 MHz) and intelligently reduces the data within the pixelated region of the detector at rate will enhance physics performance at high luminosity and enable physics analyses that are not currently possible. Using the shape of charge clusters deposited in an array of small pixels, the physical properties of the traversing particle can be extracted with locally customized neural networks. In this first demonstration, we present a neural network that can be embedded into the on-sensor readout and filter out hits from low momentum tracks, reducing the detector's data volume by 57.1%–75.7%. The network is designed and simulated as a custom readout integrated circuit with 28 nm CMOS technology and is expected to operate at less than 300 μW with an area of less than 0.2 mm 2 . The temporal development of charge clusters is investigated to demonstrate possible future performance gains, and there is also a discussion of future algorithmic and technological improvements that could enhance efficiency, data reduction, and power per area.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Ammonia-Removal Efficiency By Full-Scale Carbon-Based Trace-Contaminant Sorbent Monoliths Integrated With the Rapid-Cycle Amine (RCA) Swing Bed

Results are presented on full-scale performance testing of vacuum-regenerable, carbon based sorbent monoliths for trace-contaminant (TC) removal integrated with the Rapid-Cycle Amine (RCA) swing bed for use in the Portable Life Support System (PLSS) during Extravehicular Activities (EVAs). The current state-of-art in TC-control technology involves the use of a packed bed of acid-impregnated granular charcoal, which is difficult to regenerate. The carbon-based sorbent under development in this project can be regenerated by exposure to vacuum at room temperature. Data on cyclic sorption-desorption of ammonia, which is a major TC of concern, were collected in a simulated PLSS ventilation loop which involved the RCA placed upstream of the Trace Contaminant Control System (TCCS). Results of testing involving pressure-swing operation of the integrated TCCS/RCA system indicate ammonia-removal efficiency exceeding 80% throughout multiple sorption-desorption cycles. This paper presents an overview of the TCCS research, the favorable results obtained, and provides insight into future work needed to further the technology development.

Marek A Wójtowicz↗

MROrchestrator: A Fine-Grained Resource Orchestration Framework for MapReduce Clusters

Efficient resource management in data centers and clouds running large distributed data processing frameworks like MapReduce is crucial for enhancing the performance of hosted applications and boosting resource utilization. However, existing resource scheduling schemes in Hadoop MapReduce allocate resources at the granularity of fixed-size, static portions of nodes, called slots. In this work, we show that MapReduce jobs have widely varying demands for multiple resources, making the static and fixed-size slot-level resource allocation a poor choice both from the performance and resource utilization standpoints. Furthermore, lack of co-ordination in the management of mul- tiple resources across nodes prevents dynamic slot reconfigura- tion, and leads to resource contention. Motivated by this, we propose MROrchestrator, a MapReduce resource Orchestrator framework, which can dynamically identify resource bottlenecks, and resolve them through fine-grained, co-ordinated, and on- demand resource allocations. We have implemented MROrches- trator on two 24-node native and virtualized Hadoop clusters. Experimental results with a suite of representative MapReduce benchmarks demonstrate up to 38% reduction in job completion times, and up to 25% increase in resource utilization. We further show how popular resource managers like NGM and Mesos when augmented with MROrchestrator can hike up their performance.

99 GENERAL AND MISCELLANEOUS↗

Lightweight Provenance Service for High-Performance Computing

Provenance describes detailed information about the history of a piece of data, containing the relationships among elements such as users, processes, jobs, and workflows that contribute to the existence of data. Provenance is key to supporting many data management functionalities that are increasingly important in operations such as identifying data sources, parameters, or assumptions behind a given result; auditing data usage; or understanding details about how inputs are transformed into outputs. Despite its importance, however, provenance support is largely underdeveloped in highly parallel architectures and systems. One major challenge is the demanding requirements of providing provenance service in situ. The need to remain lightweight and to be always on often conflicts with the need to be transparent and offer an accurate catalog of details regarding the applications and systems. To tackle this challenge, we introduce a lightweight provenance service, called LPS, for high-performance computing (HPC) systems. LPS leverages a kernel instrument mechanism to achieve transparency and introduces representative execution and flexible granularity to capture comprehensive provenance with controllable overhead. Extensive evaluations and use cases have confirmed its efficiency and usability. We believe that LPS can be integrated into current and future HPC systems to support a variety of data management needs.

Dai, Dong↗