A spatially explicit evolutionary algorithm for the spatial partitioning problem
Not Available
Liu, Yan Y. (ORCID:0000000322984728)↗
SEARCH · Search NASA
Results for “spatial partitioning”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A parallel evolutionary multiple-try metropolis Markov chain Monte Carlo algorithm for sampling spatial partitions
We develop an Evolutionary Markov Chain Monte Carlo (EMCMC) algorithm for sampling spatial partitions that lie within a large, complex, and constrained spatial state space. Our algorithm combines the advantages of evolutionary algorithms (EAs) as optimization heuristics for state space traversal and the theoretical convergence properties of Markov Chain Monte Carlo algorithms for sampling from unknown distributions. Local optimality information that is identified via a directed search by our optimization heuristic is used to adaptively update a Markov chain in a promising direction within the framework of a Multiple-Try Metropolis Markov Chain model that incorporates a generalized Metropolis-Hastings ratio. We further expand the reach of our EMCMC algorithm by harnessing the computational power afforded by massively parallel computing architecture through the integration of a parallel EA framework that guides Markov chains running in parallel.
97 MATHEMATICS AND COMPUTING↗
Limited evidence for spatial resource partitioning across temperate grassland biodiversity experiments
Locally, plant species richness supports many ecosystem functions. Yet, the mechanisms driving these often-positive biodiversity–ecosystem functioning relationships are not well understood. Spatial resource partitioning across vertical resource gradients is one of the main hypothesized causes for enhanced ecosystem functioning in more biodiverse grasslands. Spatial resource partitioning occurs if species differ in where they acquire resources and can happen both above- and belowground. However, studies investigating spatial resource partitioning in grasslands provide inconsistent evidence. We present the results of a meta-analysis of 21 data sets from experimental species-richness gradients in grasslands. We test the hypothesis that increasing spatial resource partitioning along vertical resource gradients enhances ecosystem functioning in diverse grassland plant communities above- and belowground. To test this hypothesis, we asked three questions. (1) Does species richness enhance biomass production or community resource uptake across sites? (2) Is there evidence of spatial resource partitioning as indicated by resource tracer uptake and biomass allocation above- and belowground? (3) Is evidence of spatial resource partitioning correlated with increased biomass production or community resource uptake? Although plant species richness enhanced community nitrogen and potassium uptake and biomass production above- and belowground, we found that plant communities did not meet our criteria for spatial resource partitioning, though they did invest in significantly more aboveground biomass in higher canopy layers in mixture relative to monoculture. Furthermore, the extent of spatial resource partitioning across studies was not positively correlated with either biomass production or community resource uptake. Our results suggest that spatial resource partitioning across vertical resource gradients alone does not offer a general explanation for enhanced ecosystem functioning in more diverse temperate grasslands.
54 ENVIRONMENTAL SCIENCES↗
Scaling neural simulations in STACS
Abstract As modern neuroscience tools acquire more details about the brain, the need to move towards biological-scale neural simulations continues to grow. However, effective simulations at scale remain a challenge. Beyond just the tooling required to enable parallel execution, there is also the unique structure of the synaptic interconnectivity, which is globally sparse but has relatively high connection density and non-local interactions per neuron. There are also various practicalities to consider in high performance computing applications, such as the need for serializing neural networks to support potentially long-running simulations that require checkpoint-restart. Although acceleration on neuromorphic hardware is also a possibility, development in this space can be difficult as hardware support tends to vary between platforms and software support for larger scale models also tends to be limited. In this paper, we focus our attention on Simulation Tool for Asynchronous Cortical Streams (STACS), a spiking neural network simulator that leverages the Charm++ parallel programming framework, with the goal of supporting biological-scale simulations as well as interoperability between platforms. Central to these goals is the implementation of scalable data structures suitable for efficiently distributing a network across parallel partitions. Here, we discuss a straightforward extension of a parallel data format with a history of use in graph partitioners, which also serves as a portable intermediate representation for different neuromorphic backends. We perform scaling studies on the Summit supercomputer, examining the capabilities of STACS in terms of network build and storage, partitioning, and execution. We highlight how a suitably partitioned, spatially dependent synaptic structure introduces a communication workload well-suited to the multicast communication supported by Charm++. We evaluate the strong and weak scaling behavior for networks on the order of millions of neurons and billions of synapses, and show that STACS achieves competitive levels of parallel efficiency.
59 BASIC BIOLOGICAL SCIENCES↗
Substrate Partitioning into Protein Macromolecular Frameworks for Enhanced Catalytic Turnover
Spatial partitioning of chemical processes is an important attribute of many biological systems, the effect of which is reflected in the high efficiency of enzymes found within otherwise chaotic cellular environments. Barriers, often provided through the formation of compartments or phase segregation, gate the access of macromolecules and small molecules within the cell and provide an added level of metabolic control. Taking inspiration from nature, we have designed virus-like particles (VLPs) as nanoreactor compartments that sequester enzyme catalysts and have used these as building blocks to construct 3D protein macromolecular framework (PMF) materials, which are structurally characterized using small-angle X-ray scattering (SAXS). Additionally, the highly charged PMFs form a separate phase in suspension, and by tuning the ionic strength, we show positively charged molecules preferentially partition into the PMF, while negatively charged molecules are excluded. This molecular partitioning was exploited to tune the catalytic activity of enzymes enclosed within the individual particles in the PMF, the results of which showed that positively charged substrates had turnover rates that were 8500× faster than their negatively charged counterparts. Moreover, the catalytic PMF led to cooperative behavior resulting in charge dependent trends opposite to those observed with individual P22 nanoreactor particles.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Investigating Thaw and Plant Productivity Constraints on Old Soil Carbon Respiration From Permafrost
Isotopic radiocarbon (Δ 14 C) signatures of ecosystem respiration (Reco) can identify old soil carbon (C) loss and serve as an early indicator of permafrost destabilization in a warming climate. Warming also stimulates plant productivity causing plant respiration to dominate Reco Δ 14 C signatures and potentially obscuring old soil C loss. Here, we investigate how a wide spatio-temporal gradient of permafrost thaw and plant productivity affects Reco Δ 14 C patterns and isotopic partitioning. Spatial gradients came from a warming experiment with doubling thaw depth and variable biomass, and a vegetation removal manipulation to eliminate plant contributions. We sampled in August and September to capture transitions from high to low plant productivity, decreased surface soil temperature, and relatively small seasonal thaw extensions. We found that surface processes dominate spatial variation in old soil C loss and a process-based partitioning approach was crucial for constraining old soil C loss. Resampling the same plots in different times of the year revealed that old soil C losses tripled with cooling surface temperature, and the largest old soil C losses were detected when the organic-to-mineral soil horizons thawed (~50–60 cm). We suggest that the measured increase in old soil respiration over the season and when the organic-to-mineral horizon thawed, may be explained by mobilization of nitrogen that stimulates microbial decomposition at depth. Our results suggest that soil C in the organic to mineral horizon may be an important source of soil C loss as the entire Arctic region warms and could lead to nonlinearities in projected permafrost climate feedbacks.
54 ENVIRONMENTAL SCIENCES↗
Hydrogeologic Setting and Groundwater Contaminant Conceptual Model, Los Alamos National Laboratory - 18681
Our understanding of the complex hydrogeologic setting at Los Alamos National Laboratory (LANL) has evolved significantly over the previous decade. The semi-arid, high-desert setting consists of generally dry drainages in canyons that head either in uplands to the west of the Laboratory or on the high mountain-front plateau where the Laboratory is spread across approximately 40 square miles. Some canyon drainages have spatially limited reaches with perennial surface water from natural runoff and spring sources and/or from permitted effluent sources. The Rio Grande rift basin-fill stratigraphy includes primary volcanic deposits from pyroclastic eruptions and intermediate composition lava flows, and fluvial and alluvial fan deposits. Highly complex and spatially variable stratigraphy governs the occurrences of three groundwater zones: shallow 'alluvial groundwater', deep perched groundwater, and a thick 'regional' aquifer that is the water supply for the community of Los Alamos and the Laboratory. The current understanding of the hydrogeologic framework was greatly expanded as part of a site hydrogeologic characterization program completed in 2005. Higher resolution information exists in area where more detailed groundwater characterization has been conducted to support specific project objectives. A conceptual model for occurrences of contaminants in each of the three groundwater zones is governed by four factors: contaminant solubility/mobility, the mass of historical release, presence of a continuous hydraulic driver, and 'breakthrough' geology, defined as geology conducive to infiltration of shallow groundwater to deeper groundwater zones. The Laboratory's operations were historically somewhat spatially partitioned. Most of the radionuclide work (and historical releases) was conducted in the northern portion of the Laboratory, high explosives work has taken place exclusively in the southwestern portion, and treated sanitary effluent was released at a limited number of outfalls. Historical material disposal areas (MDAs) are dispersed throughout the Laboratory, and active MDAs are all located on a single dry mesa at the eastern part of the Laboratory. Evidence exists of transport of anthropogenic constituents to the regional aquifer. However, years of groundwater characterization have identified only two cases for which all the key factors were present and a complete contaminant pathway to the regional aquifer has resulted in contamination at levels above an applicable standard. Hexavalent chromium contamination associated with historical use as a corrosion inhibitor in a power plant is present beneath Mortandad Canyon, and RDX contamination associated with high-explosives machining is present beneath Canon de Valle. Each of those project areas have refined conceptual and numerical models that address contaminant migration pathways, spatial extent of perched-intermediate groundwater, mass balance, and fate and transport within the regional aquifer. No known contamination is present in the regional aquifer associated with MDAs, and interestingly, much of the Laboratory's groundwater background dataset is from wells located beneath active MDAs. A comprehensive groundwater monitoring program is in place to track the evolution of chromium and RDX contamination, and to identify any other constituents that may be attributable to historical LANL operations. (authors)
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
The holographic entropy cone from marginal independence
The holographic entropy cone characterizes the relations between entanglement entropies for a spatial partitioning of the boundary spacetime of a holographic CFT in any state describing a classical bulk geometry. We argue that the holographic entropy cone, for an arbitrary number of parties, can be reconstructed from more fundamental data determined solely by subadditivity of quantum entropy. We formulate certain conjectures about graph models of holographic entanglement, for which we provide strong evidence, and rigorously prove that they all imply that such a reconstruction is possible. Our conjectures (except only for the weakest) further imply that the necessary data is remarkably simple. In essence, all one needs to know to reconstruct the holographic entropy cone, is a certain subset of the extreme rays of this simpler “subadditivity cone”, namely those which can be realized in holography. This recasting of the bewildering entanglement structure of geometric states into primal building blocks paves the way to distilling the essence of holography for the emergence of a classical bulk spacetime.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
A proximity‐based image‐processing algorithm for colloid assignment in segmented multiphase flow datasets
Summary Colloidal transport and deposition are of both environmental and engineering importance. Easier access to x‐ray microtomography (XMT) coupled with improved imaging resolution has made XMT a unique and viable tool for visualizing and quantifying these processes. Currently, there is scant information in the literature addressing colloid segmentation and analysis in saturated and unsaturated porous media, in particular related to spatial partitioning of colloids. To support this need, an approach to assign segmented colloidal particles and aggregates to different partitioning classes based on their proximity to different phases is presented here. The method uses different markers for each attachment site (e.g. wetting‐nonwetting phase interfaces). An example XMT dataset from a drainage experiment is used to demonstrate the efficacy of the image processing algorithms. Flow conditions, and fluid and colloid properties, can thus be compared to the behaviour of colloids within the porous medium. This algorithm can help elucidate colloidal deposition mechanisms and the importance of different attachment sites, explore the importance of fluid properties, as well as the arrangement and shape of the colloids.
BRUECK, C. L.↗
Spatially Accelerated Winding Numbers for Curved Geometry
The generalized winding number (GWN) is a scalar field that supports robust containment queries on curved geometry, including non-watertight, overlapping, and nested boundary representations. While queries can be easily parallelized over samples, direct evaluation on parametric curves and surfaces remains costly for large and complex models. Fast, state-of-the-art GWN approaches leverage a spatial index to approximate the GWN, typically coupled with a Taylor expansion which approximates the GWN contribution for far clusters of geometric primitives. However, such methods operate only on discrete inputs such as triangle meshes and point clouds, and would introduce containment errors near boundaries if applied to curved input. We extend support for fast GWN evaluation over arbitrary collections of NURBS curves in 2D and trimmed NURBS patches in 3D via a Bounding Volume Hierarchy that stores efficiently precomputed moment data in the hierarchy nodes. When querying the hierarchy, approximations for far clusters are used alongside direct evaluation for nearby NURBS primitives, achieving sub-linear complexity while preserving the geometric features in the vicinity of the query point. Central to our performance improvements is an adaptive subdivision strategy for NURBS primitives during a preprocessing phase, creating better spatial partitions while retaining the same accuracy for containment decisions as a direct evaluation. We demonstrate the performance and accuracy of our approach across a large collection of 2D and 3D datasets.
Computer science↗
Elucidating mechanisms of Photosystem I assembly and repair (Final Technical Report)
Oxygenic photosynthesis generates the carbohydrates and oxygen that support life on earth. Central to this process are photosystems I and II (PSI and PSII), large protein-pigment complexes that are among the most complex macromolecular structures in nature. Impressive advances have been made in understanding the structure and photochemical mechanisms of PSI and PSII. However, less is known about the mechanisms underlying their biogenesis. The overarching goal of this project was to elucidate mechanisms of photosystem assembly. Several proteins that are not found in mature PSI or PSII are essential for their assembly, but the assembly pathways and the role of each assembly factor are just starting to emerge. During the course of this project, we advanced understanding of this problem in several ways. First, we addressed the spatial organization of photosystem assembly by localizing many known assembly factors to specific subdomains of thylakoid membranes in plant chloroplasts. This work revealed that the "curvature" domain - the highly curved periphery of stacked granal membrane disks - is a center of photosystem assembly. However, whereas some PSI assembly factors localized exclusively to the curvature domain, another was found exclusively in granal margins and unstacked membranes. This spatial partitioning suggests an assembly line along which different assembly intermediates are physically segregated. Most assembly factors localized similarly in dark-adapted and illuminated plants, but one PSII assembly factor shifted from the curvature domain to unstacked membranes upon illumination, suggesting an unanticipated role in the repair of light-induced PSII damage. Whereas most PSII subunits were found primarily in grana stacks (as expected), one PSII subunit, PsbP, was prominent also in the curvature fraction, suggesting that PsbP has functions beyond its role in mature PSII, possibly in biogenesis or repair.
59 BASIC BIOLOGICAL SCIENCES↗
Length-Dependence and Spatial Structure of DNA Partitioning into a DNA Liquid
Not provided.
Chemistry↗
AutoAtlas: Neural Network for 3D Unsupervised Partitioning and Representation Learning
Here we present a novel neural network architecture called AutoAtlas for fully unsupervised partitioning and representation learning of 3D brain Magnetic Resonance Imaging (MRI) volumes. AutoAtlas consists of two neural network components: one neural network to perform multi-label partitioning based on local texture in the volume, and a second neural network to compress the information contained within each partition. We train both of these components simultaneously by optimizing a loss function that is designed to promote accurate reconstruction of each partition, while encouraging spatially smooth and contiguous partitioning, and discouraging relatively small partitions. We show that the partitions adapt to the subject specific structural variations of brain tissue while consistently appearing at similar spatial locations across subjects. AutoAtlas also produces very low dimensional features that represent local texture of each partition. We demonstrate prediction of metadata associated with each subject using the derived feature representations and compare the results to prediction using features derived from FreeSurfer anatomical parcellation. Since our features are intrinsically linked to distinct partitions, we can then map values of interest, such as partition-specific feature importance scores onto the brain for visualization.
42 ENGINEERING↗
Geometric Mapping of Tasks to Processors on Parallel Computers with Mesh or Torus Networks
We present a new method for reducing parallel applications' communication time by mapping their MPI tasks to processors in a way that lowers the distance messages travel and the amount of congestion in the network. Assuming geometric proximity among the tasks is a good approximation of their communication interdependence, we use a geometric partitioning algorithm to order both the tasks and the processors, assigning task parts to the corresponding processor parts. In this way, interdependent tasks are assigned to “nearby” cores in the network. We also present a number of algorithmic optimizations that exploit specific features of the network or application to further improve the quality of the mapping. We specifically address the case of sparse node allocation, where the nodes assigned to a job are not necessarily located in a contiguous block nor within close proximity to each other in the network. Furthermore, our methods generalize to contiguous allocations as well, and results are shown for both contiguous and non-contiguous allocations. We show that, for the structured finite difference mini-application MiniGhost, our mapping methods reduced communication time up to 75% relative to MiniGhost's default mapping on 128K cores of a Cray XK7 with sparse allocation. For the atmospheric modeling code E3SM/HOMME, our methods reduced communication time up to 31% on 16K cores of an IBM BlueGene/Q with contiguous allocation.
97 MATHEMATICS AND COMPUTING↗
Exploiting Geometric Partitioning in Task Mapping for Parallel Computes
We present a new method for mapping applications' MPI tasks to cores of a parallel computer such that applications' communication time is reduced. We address the case of sparse node allocation, where the nodes assigned to a job are not necessarily located in a contiguous block nor within close proximity to each other in the network, although our methods generalize to contiguous allocations as well. The goal is to assign tasks to cores so that interdependent tasks are performed by "nearby' cores, thus lowering the distance messages must travel, the amount of congestion in the network, and the overall cost of communication. Our new method applies a geometric partitioning algorithm to both the tasks and the processors, and assigns task parts to the corresponding processor parts. We also present a number of algorithmic optimizations that exploit specific features of the network or application. We show that, for the structured finite difference mini-application MiniGhost, our mapping methods reduced communication time up to 75% relative to MiniGhost's default mapping on 128K cores of a Cray XK7 with sparse allocation. For the atmospheric modeling code E3SM/HOMME, our methods reduced communication time up to 31% on 32K cores of an IBM BlueGene/Q with contiguous allocation.
97 MATHEMATICS AND COMPUTING↗
Variability of Snow and Rainfall Partitioning Into Evapotranspiration and Summer Runoff Across Nine Mountainous Catchments
Abstract Understanding the partitioning of snow and rain contributing to either catchment streamflow or evapotranspiration (ET) is of critical relevance for water management in response to climate change. To investigate this partitioning, we use endmember splitting and mixing analyses based on stable isotope ( 18 O) data from nine headwater catchments in the East River, Colorado. Our results show that one third of the snow partitions to ET and 13% of the snowmelt sustains summer streamflow. Only 8% of the rainfall contributes to the summer streamflow, because most of the rain (67%) partitions to ET. The spatial variability of precipitation partitioning is mainly driven by aspect and tree cover across the sub‐catchments. Catchments with higher tree cover have a higher share of snow becoming ET, resulting in less snow in summer streamflow. Summer streamflow did not contain more rain with higher rainfall sums, but more rain was taken up in ET.
58 GEOSCIENCES↗
The Case for Strong Scaling in Deep Learning: Training Large 3D CNNs with Hybrid Parallelism
Here, we present scalable hybrid-parallel algorithms for training large-scale 3D convolutional neural networks. Deep learning-based emerging scientific workflows often require model training with large, high-dimensional samples, which can make training much more costly and even infeasible due to excessive memory usage. We solve these challenges by extensively applying hybrid parallelism throughout the end-to-end training pipeline, including both computations and I/O. Our hybrid-parallel algorithm extends the standard data parallelism with spatial parallelism, which partitions a single sample in the spatial domain, realizing strong scaling beyond the mini-batch dimension with a larger aggregated memory capacity. We evaluate our proposed training algorithms with two challenging 3D CNNs, CosmoFlow and 3D U-Net. Our comprehensive performance studies show that good weak and strong scaling can be achieved for both networks using up to 2K GPUs. More importantly, we enable training of CosmoFlow with much larger samples than previously possible, realizing an order-of-magnitude improvement in prediction accuracy.
97 MATHEMATICS AND COMPUTING↗
Spatially Aware Linear Transformer (SAL-T) for Particle Jet Tagging
Transformers are very effective in capturing both global and local correlations within high-energy particle collisions, but they present deployment challenges in high-data-throughput environments, such as the CERN LHC. The quadratic complexity of transformer models demands substantial resources and increases latency during inference. In order to address these issues, we introduce the Spatially Aware Linear Transformer (SAL-T), a physics-inspired enhancement of the linformer architecture that maintains linear attention. Our method incorporates spatially aware partitioning of particles based on kinematic features, thereby computing attention between regions of physical significance. Additionally, we employ convolutional layers to capture local correlations, informed by insights from jet physics. In addition to outperforming the standard linformer in jet classification tasks, SAL-T also achieves classification results comparable to full-attention transformers, while using considerably fewer resources with lower latency during inference. Experiments on a generic point cloud classification dataset (ModelNet10) further confirm this trend. Our code is available at https://github.com/aaronw5/SAL-T4HEP.
Wang, Aaron [Illinois U., Chicago] (ORCID:00000003↗