Search NASA⌕ Search

SEARCH · Search NASA

Results for “data repartitioning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

16 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1997

Efficient Load Balancing and Data Remapping for Adaptive Grid Calculations

Mesh adaption is a powerful tool for efficient unstructured- grid computations but causes load imbalance among processors on a parallel machine. We present a novel method to dynamically balance the processor workloads with a global view. This paper presents, for the first time, the implementation and integration of all major components within our dynamic load balancing strategy for adaptive grid calculations. Mesh adaption, repartitioning, processor assignment, and remapping are critical components of the framework that must be accomplished rapidly and efficiently so as not to cause a significant overhead to the numerical simulation. Previous results indicated that mesh repartitioning and data remapping are potential bottlenecks for performing large-scale scientific calculations. We resolve these issues and demonstrate that our framework remains viable on a large number of processors.

Oliker, Leonid↗
NASA NTRS1994

Convective flow effects on protein crystal growth

A high-resolution microscopic interferometric setup for the monitoring of protein morphologies has been developed. Growth or dissolution of a crystal can be resolved with a long-term depth resolution of 200 A and a lateral resolution of 2 microns. This capability of simultaneously monitoring the interfacial displacement with high local depth resolution has yielded several novel results. We have found with lysozyme that (1) the normal growth rate is oscillatory, and (2) depending on the impurity content of the solution, the growth step density is either greater or lower at the periphery of a facet than in its center. The repartitioning of Na plus and Cl minus ions between lysozyme solutions and crystals was studied for a wide range of crystallization conditions. A nucleation-growth-repartitioning model was developed, to interpret the large body of data in unified way. The results strongly suggest that (1) the ion to lysozyne ratio in the crystal depends mostly on kinetic rather than crystallographic parameters, and (2) lysozyme crystals possess a salt-rich core with a diameter electron microscopy results appear to confirm this finding, which could have far-reaching consequences for x-ray diffraction studies. A computational model for diffusive-convective transport in protein crystallization has been applied to a realistic growth cell geometry, taking into account the findings of the above repartitioning studies and our kinetics data for the growth of lysozyme. The results show that even in the small cell employed, protein concentration nonuniformities and gravity-driven solutal convection can be significant. The calculated convection velocities are of the same order to magnitude as those found in earlier experiments. As expected, convective transport, i.e., at Og, lysozyme crystal growth remains kinetically limited. The salt distribution in the crystal is predicted to be non-uniform at both 1g and 0g, as a consequence of protein depletion in the solution. Static and dynamic light scattering studies in undersaturated and supersaturated solutions have been performed. Diffusivities in undersaturated solutions, were found to vary with lysozyme concentrations. Depending on the salt concentration, the diffusivities either increase or decrease. Interestingly, the corresponding static scattering intensities behave oppositely, Our current analysis indicates that these changes are inconsistent with aggregation in undersaturated solutions. However, the data are compatible with concentration-dependent changes of the interactions between protein and salt.

Rosenberger, Franz↗
NASA NTRS1996

Repartitioning of NaCl and Protein Impurities in Lysozyme Crystallization

Nonuniform precipitant and impurity incorporation in protein crystals can cause lattice strain and, thus, possibly decrease the X-ray diffraction resolution. To address this issue, a series of crystallization experiments were carried out, in which initial supersaturation, NaCl concentration, protein purity level and crystallized fraction were varied. Lysozyme and protein impurities, as well as sodium and chloride were independently determined in the initial solution, supernatant and crystals. The segregation coefficients for Na(+) and Cl(-) were found to be independent of supersaturation and NaCl concentration, and decreased with crystallized fraction/crystal size. Numerical evaluation of the extensive body of data, based on a nucleation-growth- repartitioning model, suggests a core of approx. 40 microns in which salt is incorporated in much greater concentrations than during later growth. Small crystals containing higher amounts of incorporated NaCl also had higher protein impurity contents. This suggests that the excess salt is associated with the protein impurities in the core. X-ray topography revealed strain fields in the center of the crystals comparable in size to the inferred core. The growth rates of crystals smaller than 30-40 pm in size were consistently 1.5-2 times lower than those of larger crystals, presumably due to higher chemical potentials in the core.

Vekilov, Peter G.↗
NASA NTRS1994

Convective flow effects on protein crystal growth

The long-term stability of the interferometric setup for the monitoring of protein morphologies has been improved. Growth or dissolution of a crystal on a 100 A scale can now be clearly distinguished from dimensional changes occurring within the optical path of the interferometer. This capability of simultaneously monitoring the local interfacial displacement at several widely-spaced positions on the crystal surface with high local depth resolution, has already yielded novel results. We found with lysozyme that (1) the normal growth rate is oscillatory, and (2) the mean growth step density is greater at the periphery of a facet than in its center. The repartitioning of Na(+) and Cl(-) ions between lysozyme solutions and crystals was studied for a wide range of crystallization conditions. A nucleation-growth-repartitioning model was developed to interpret the large body of data in a unified way. The results strongly suggests that (1) the ion to lysozyme ratio in the crystal depends mostly on kinetic rather than crystallographic parameters, and (2) lysozyme crystals possess a salt-rich core with a diameter on the order of 10 microns. The computational model for diffusive-convective transport in protein crystallization (see the First Report) has been applied to a realistic growth cell geometry, taking into account the findings of the above repartitioning studies. These results show that some elements of a moving boundary problem must be incorporated into the model in order to obtain a more realistic description. Our experimental setup for light scattering investigations of aggregation and nucleation in protein solutions has been extensively tested. Scattering intensity measurements with a true Rayleigh scatterer produced systematically increased forward scattering, indicating problems with glare. These have been resolved. Preliminary measurements with supersaturated lysozyme solutions revealed that the scatterers grow with time. Work has begun on a computer program for the unified evaluation of simultaneously obtained, multi-angle static and dynamic light scattering data.

Rosenberger, Franz↗
NASA NTRS2016

Evaluating the Impact of Data Placement to Spark and SciDB with an Earth Science Use Case

We investigate the impact of data placement for two Big Data technologies, Spark and SciDB, with a use case from Earth Science where data arrays are multidimensional. Simultaneously, this investigation provides an opportunity to evaluate the performance of the technologies involved. Two datastores, HDFS and Cassandra, are used with Spark for our comparison. It is found that Spark with Cassandra performs better than with HDFS, but SciDB performs better yet than Spark with either datastore. The investigation also underscores the value of having data aligned for the most common analysis scenarios in advance on a shared nothing architecture. Otherwise, repartitioning needs to be carried out on the fly, degrading overall performance.

Spark↗
NASA NTRS1998

PLUM: Parallel Load Balancing for Adaptive Unstructured Meshes

Mesh adaption is a powerful tool for efficient unstructured-grid computations but causes load imbalance among processors on a parallel machine. We present a novel method called PLUM to dynamically balance the processor workloads with a global view. This paper presents the implementation and integration of all major components within our dynamic load balancing strategy for adaptive grid calculations. Mesh adaption, repartitioning, processor assignment, and remapping are critical components of the framework that must be accomplished rapidly and efficiently so as not to cause a significant overhead to the numerical simulation. A data redistribution model is also presented that predicts the remapping cost on the SP2. This model is required to determine whether the gain from a balanced workload distribution offsets the cost of data movement. Results presented in this paper demonstrate that PLUM is an effective dynamic load balancing strategy which remains viable on a large number of processors.

Oliker, Leonid↗
NASA NTRS1998

Parallel Load Balancing for Adaptive Unstructured Meshes

Mesh adaption is a powerful tool for efficient unstructured-grid computations but causes load imbalance among processors on a parallel machine. We describe a novel method to dynamically balance the processor workloads with a global view. Mesh question, repartitioning, processor assignment, and remapping are critical components of the framework that must be accomplished rapidly and efficiently so as not to cause a significant overhead to the numerical simulation. A data redistribution model will also be presented that predicts the remapping cost. This model is required to determine whether the gain from a balanced workload distribution offsets the cost of data movement. Results presented will demonstrate that this is an effective dynamic load balancing strategy which remains viable on a large number of processors.

Biswas, Rupak↗
NASA NTRS2010

Towards Global Simulation of Irrigation in a Land Surface Model: Multiple Cropping and Rice Paddy in Southeast Asia

Agricultural land use significantly influences the surface water and energy balances. Effects of irrigation on land surface states and fluxes include repartitioning of latent and sensible heat fluxes, an increase in net radiation, and an increase in soil moisture and runoff. We are working on representing irrigation practices in continental- to global-scale land surface simulation in NASA's Global Land Data Assimilation System (GLDAS). Because agricultural practices across the nations are diverse, and complex, we are attempting to capture the first-order reality of the regional practices before achieving a global implementation. This study focuses on two issues in Southeast Asia: multiple cropping and rice paddy irrigation systems. We first characterize agricultural practices in the region (i.e., crop types, growing seasons, and irrigation) using the Global data set of monthly irrigated and rainfed crop areas around the year 2000 (MIRCA2000) dataset. Rice paddy extent is identified using remote sensing products. Whether irrigated or rainfed, flooded fields need to be represented and treated explicitly. By incorporating these properties and processes into a physically based land surface model, we are able to quantify the impacts on the simulated states and fluxes.

Beaudoing, Hiroko Kato↗
NASA NTRS1999

Parallel Tetrahedral Mesh Adaptation with Dynamic Load Balancing

The ability to dynamically adapt an unstructured grid is a powerful tool for efficiently solving computational problems with evolving physical features. In this paper, we report on our experience parallelizing an edge-based adaptation scheme, called 3D_TAG. using message passing. Results show excellent speedup when a realistic helicopter rotor mesh is randomly refined. However. performance deteriorates when the mesh is refined using a solution-based error indicator since mesh adaptation for practical problems occurs in a localized region., creating a severe load imbalance. To address this problem, we have developed PLUM, a global dynamic load balancing framework for adaptive numerical computations. Even though PLUM primarily balances processor workloads for the solution phase, it reduces the load imbalance problem within mesh adaptation by repartitioning the mesh after targeting edges for refinement but before the actual subdivision. This dramatically improves the performance of parallel 3D_TAG since refinement occurs in a more load balanced fashion. We also present optimal and heuristic algorithms that, when applied to the default mapping of a parallel repartitioner, significantly reduce the data redistribution overhead. Finally, portability is examined by comparing performance on three state-of-the-art parallel machines.

Oliker, Leonid↗
NASA NTRS1995

Convective flow effects on protein crystal growth

During the fourth semi-annual period under this grant we have pursued the following activities: (1) crystal growth morphology and kinetics studies with tetragonal lysozyme. These clearly revealed the influence of higher molecular weight protein impurities on interface shape; (2) characterization of the purity and further purification of lysozyme solutions. These efforts have, for the first time, resulted in lysozyme free of higher molecular weight components; (3) continuation of the salt repartitioning studies with Seikagaku lysozyme, which has a lower protein impurity content that Sigma stock. These efforts confirmed our earlier findings of higher salt contents in smaller crystals. However, less salt is in corporated into the crystals grown from Seikagaku stock. This strongly suggests a dependence of salt repartitioning on the concentration of protein impurities in lysozyme. To test this hypothesis, repartitioning studies with the high purity lysozyme prepared in-house will be begun shortly; (4) numerical modelling of the interaction between bulk transport and interface kinetics. These simulations have produced interface shapes which are in good agreement with out experimental observations; and (5) light scattering studies on under- and supersaturated lysozyme solutions. A consistent interpretation of the static and dynamic data leaves little doubt that pre-nucleation clusters, claimed to exist even in undersaturated solutions, are not present. The article: 'Growth morphology response to nutrient and impurity nonuniformities' is attached.

Rosenberger, Franz↗
NASA NTRS1998

PLUM: Parallel Load Balancing for Unstructured Adaptive Meshes

Dynamic mesh adaption on unstructured grids is a powerful tool for computing large-scale problems that require grid modifications to efficiently resolve solution features. Unfortunately, an efficient parallel implementation is difficult to achieve, primarily due to the load imbalance created by the dynamically-changing nonuniform grid. To address this problem, we have developed PLUM, an automatic portable framework for performing adaptive large-scale numerical computations in a message-passing environment. First, we present an efficient parallel implementation of a tetrahedral mesh adaption scheme. Extremely promising parallel performance is achieved for various refinement and coarsening strategies on a realistic-sized domain. Next we describe PLUM, a novel method for dynamically balancing the processor workloads in adaptive grid computations. This research includes interfacing the parallel mesh adaption procedure based on actual flow solutions to a data remapping module, and incorporating an efficient parallel mesh repartitioner. A significant runtime improvement is achieved by observing that data movement for a refinement step should be performed after the edge-marking phase but before the actual subdivision. We also present optimal and heuristic remapping cost metrics that can accurately predict the total overhead for data redistribution. Several experiments are performed to verify the effectiveness of PLUM on sequences of dynamically adapted unstructured grids. Portability is demonstrated by presenting results on the two vastly different architectures of the SP2 and the Origin2OOO. Additionally, we evaluate the performance of five state-of-the-art partitioning algorithms that can be used within PLUM. It is shown that for certain classes of unsteady adaption, globally repartitioning the computational mesh produces higher quality results than diffusive repartitioning schemes. We also demonstrate that a coarse starting mesh produces high quality load balancing, at a fraction of the cost required a fine initial mesh. Results indicate that our parallel load balancing strategy will remain viable on large numbers of processors.

Oliker, Leonid↗
NASA NTRS2015

Water Distribution in the Continental and Oceanic Upper Mantle

Nominally anhydrous minerals such as olivine, pyroxene and garnet can accommodate tens to hundreds of ppm H2O in the form of hydrogen bonded to structural oxygen in lattice defects. Although in seemingly small amounts, this water can significantly alter chemical and physical properties of the minerals and rocks. Water in particular can modify their rheological properties and its distribution in the mantle derives from melting and metasomatic processes and lithology repartition (pyroxenite vs peridotite). These effects will be examined here using Fourier transform infrared spectrometry (FTIR) water analyses on minerals from mantle xenoliths from cratons, plume-influenced cratons and oceanic settings. In particular, our results on xenoliths from three different cratons will be compared. Each craton has a different water distribution and only the mantle root of Kaapvaal has evidence for dry olivine at its base. This challenges the link between olivine water content and survival of Archean cratonic mantle, and questions whether xenoliths are representative of the whole cratonic mantle. We will also present our latest data on Hawaii and Tanzanian craton xenoliths which both suggest the intriguing result that mantle lithosphere is not enriched in water when it interacts with melts from deep mantle upwellings (plumes).

Peslier, Anne H.↗
NASA NTRS2007

A New Modal Analysis Method to put Constraints on the Aqueous Alteration of CR Chondrites and Estimate the Unaltered CR Composition

CR carbonaceous chondrites are of the major interest since they contain one of the most primitive organic matters. However, aqueous alteration has more or less overprinted their original features in a way that needed to be assessed. That was done in the present study by comparing the mineralogy of the most altered CR1 chondrite, GRO 95577, to a less altered CR2, Renazzo. Their modal analyses were achieved thanks to a new method, based on X-ray elemental maps acquired on electron microprobe, and on IDL image treatment. It allowed the collection of new data on the composition of Renazzo and confirmed the classification of GRO 95577 as a CR1. New alteration products for CRs, vermiculite and clinochlore, were observed. The homogeneity of the Fe-poor clays in the CR1 and the distinctive matrix composition in the two chondrites suggest a wide-range of aqueous alteration on CRs. The preservation of the outlines of the chondrules in GRO 95577 and the elemental transfers of Al, Fe and Ca throughout the chondrule and of Fe and S from the matrix to the chondrule favor the idea of an asteroidal location of the aqueous alteration. From their mineralogical descriptions and modal abundances, the element repartitions in Renazzo and GRO 95577 were computed. It indicates a possible relationship between these two chondrites via an isochemical alteration process. Knowing the chemical reactions that occurred during the alteration, it was thus possible to decipher the mineralogical modal abundances in the unaltered CR body.

Perronnet, M.↗
NASA NTRS2007

A New Modal Analysis Method to put Constraints on the Aqueous Alteration of CR Chondrites and Estimate the Unaltered CR Composition

carbonaceous chondrites are of the major interest since they contain one of the most primitive organic matters. However, aqueous alteration has more or less overprinted their original features in a way that needed to be assessed. That was done in the present study by comparing the mineralogy of the most altered CR1 chondrite, GRO 95577, to a less altered CR2, Renazzo. Their modal analyses were achieved thanks to a new method, based on X-ray elemental maps acquired on electron microprobe, and on IDL image treatment. It allowed the collection of new data on the composition of Renazzo and confirmed the classification of GRO 95577 as a CR1. New alteration products for CRs, vermiculite and clinochlore, were observed. The homogeneity of the Fe-poor clays in the CR1 and the distinctive matrix composition in the two chondrites suggest a wide-range of aqueous alteration on CRs. The preservation of the outlines of the chondrules in GRO 95577 and the elemental transfers of Al, Fe and Ca throughout the chondrule and of Fe and S from the matrix to the chondrule favor the idea of an asteroidal location of the aqueous alteration. From their mineralogical descriptions and modal abundances, the element repartitions in Renazzo and GRO 95577 were computed. It indicates a possible relationship between these two chondrites via an isochemical alteration process. Knowing the chemical reactions that occurred during the alteration, it was thus possible to decipher the mineralogical modal abundances in the unaltered CR body.

Perronnet, M.↗
NASA NTRS1993

Convective flow effects on protein crystal growth

The experimental setup for the in-situ high resolution optical monitoring of protein crystal growth/dissolution morphologies was substantially improved. By augmenting the observation system with a temperature-controlled enclosure, laser illumination for the interferometric microscope, and software for pixel by pixel light intensity recording, a height resolution of about two unit cells for lysozyme can now be obtained. The repartitioning of Na(+) and Cl(-) ions between lysozyme solutions and crystals was studied. Quite unexpectedly, it was found that the longer crystals were in contact with their solution, the lower was their ion content. The development of a model for diffusive-convective transport and resulting distribution of the growth rate on facets was completed. Results obtained for a realistic growth cell geometry show interesting differences between 'growth runs' at 1g and 0g. The kinematic viscosity of lysozyme solutions of various supersaturations and salt concentrations was monitored over time. In contrast to the preliminary finding of other authors, no changes in viscosity were found over four days. The experimental setup for light scattering investigations of aggregation and nucleation in protein solutions was completed, and a computer program for the evaluation of multi-angle light scattering data was acquired.

Rosenberger, Franz↗
NASA NTRS2004

Version 8 SBUV Ozone Profile Trends Compared with Trends from a Zonally Averaged Chemical Model

Linear regression trends for the years 1979-2003 were computed using the new Version 8 merged Solar Backscatter Ultraviolet (SBUV) data set of ozone profiles. These trends were compared to trends computed using ozone profiles from the Goddard Space Flight Center (GSFC) zonally averaged coupled model. Observed and modeled annual trends between 50 N and 50 S were a maximum in the higher latitudes of the upper stratosphere, with southern hemisphere (SH) trends greater than northern hemisphere (NH) trends. The observed upper stratospheric maximum annual trend is -5.5 +/- 0.9 % per decade (1 sigma) at 47.5 S and -3.8 +/- 0.5 % per decade at 47.5 N, to be compared with the modeled trends of -4.5 +/- 0.3 % per decade in the SH and -4.0 +/- 0.2% per decade in the NH. Both observed and modeled trends are most negative in winter and least negative in summer, although the modeled seasonal difference is less than observed. Model trends are shown to be greatest in winter due to a repartitioning of chlorine species and the increasing abundance of chlorine with time. The model results show that trend differences can occur depending on whether ozone profiles are in mixing ratio or number density coordinates, and on whether they are recorded on pressure or altitude levels.

Rosenfield, Joan E.↗