Search NASA⌕ Search

SEARCH · Search NASA

Results for “Building clusters”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

SAXS Assistant: Automated SAXS analysis for structural discovery in biologics and polymeric nanoparticles

Small-angle x-ray scattering (SAXS) is a powerful technique for assessing macromolecular structure. High-throughput SAXS is limited by the time-consuming and, at times, subjective nature of SAXS data interpretation. Here, we present SAXS Assistant, a Python-based script that streamlines SAXS data analysis to extract features for machine learning (ML) and key structural parameters, including the Guinier radius of gyration (R g ), pair distance distribution function (PDDF)-derived R g , maximum particle dimension (D max ), and Kratky plots. The script builds upon BioXTAS RAW and validates reliability via Guinier/PDDF R g agreement, an important indicator of well-measured data sets. For assistance in D max estimation, a multilayer perceptron regressor was trained with 1940 data files from the Small Angle Scattering Biological Data Bank. The model achieved a test set performance R 2 = 0.90 and mean absolute error = 11.7 Å. Training exclusively with experimental data translates analyses from researchers, including experts in the field, to the ML model, which helps assess D max estimations from PDDF. Gaussian mixture model clustering was implemented to classify profiles into structural classes based on entries in the Small Angle Scattering Biological Data Bank. Users may therefore assess the similarity between experimental samples and known biomolecular shapes within the mapped repository entries. This probabilistic clustering aids in quantifying information from Kratky and generating shape-descriptive features. SAXS Assistant accelerates SAXS data analysis through enforced quality control, ML-ready outputs, and flags for low-confidence results. In addition to providing the ability to analyze large data sets at high throughput, this tool is versatile and may serve researchers in both biological and synthetic polymer research fields.

36 MATERIALS SCIENCE↗

De novo Nanopore read quality improvement using deep learning

BACKGROUND: Long read sequencing technologies such as Oxford Nanopore can greatly decrease the complexity of de novo genome assembly and large structural variation identification. Currently Nanopore reads have high error rates, and the errors often cluster into low-quality segments within the reads. The limited sensitivity of existing read-based error correction methods can cause large-scale mis-assemblies in the assembled genomes, motivating further innovation in this area. RESULTS: Here we developed a Convolutional Neural Network (CNN) based method, called MiniScrub, for identification and subsequent "scrubbing" (removal) of low-quality Nanopore read segments to minimize their interference in downstream assembly process. MiniScrub first generates read-to-read overlaps via MiniMap2, then encodes the overlaps into images, and finally builds CNN models to predict low-quality segments. Applying MiniScrub to real world control datasets under several different parameters, we show that it robustly improves read quality, and improves read error correction in the metagenome setting. Compared to raw reads, de novo genome assembly with scrubbed reads produces many fewer mis-assemblies and large indel errors. CONCLUSIONS: MiniScrub is able to robustly improve read quality of Oxford Nanopore reads, especially in the metagenome setting, making it useful for downstream applications such as de novo assembly. We propose MiniScrub as a tool for preprocessing Nanopore reads for downstream analyses. MiniScrub is open-source software and is available at https://bitbucket.org/berkeleylab/jgi-miniscrub .

59 BASIC BIOLOGICAL SCIENCES↗

Metagenomic insights into diazotrophic communities across Arctic glacier forefields

Microbial nitrogen fixation is crucial for building labile nitrogen stocks and facilitating higher plant colonisation in oligotrophic glacier forefield soils. Here, the diazotrophic bacterial community structure across four Arctic glacier forefields was investigated using metagenomic analysis. In total, 70 soil metagenomes were used for taxonomic interpretation based on 185 nitrogenase (nif) sequences, extracted from assembled contigs. The low number of recovered genes highlights the need for deeper sequencing in some diverse samples, to uncover the complete microbial populations. A key group of forefield diazotrophs, found throughout the forefields, was identified using a nifH phylogeny, associated with nifH Cluster I and III. Sequences related most closely to groups including Alphaproteobacteria, Betaproteobacteria, Cyanobacteria and Firmicutes. Using multiple nif genes in a Last Common Ancestor analysis revealed a diverse range of diazotrophs across the forefields. Key organisms identified across the forefields included Nostoc, Geobacter, Polaromonas and Frankia . Nitrogen fixers that are symbiotic with plants were also identified, through the presence of root associated diazotrophs, which fix nitrogen in return for reduced carbon. Additional nitrogen fixers identified in forefield soils were metabolically diverse, including fermentative and sulphur cycling bacteria, halophiles and anaerobes.

59 BASIC BIOLOGICAL SCIENCES↗

Searching for Induced Seismicity at Punggye-ri Nuclear Test Site Using Subspace Detectors

The most recent declared nuclear test (DPRK-6) at the North Korean Punggye-ri nuclear test site was an order of magnitude larger than any of the previous explosions, and for the first time was accompanied by additional seismicity large enough to be observed at regional distances. The first such event was a collapse about 8.5 min after the explosion, and this was followed by three earthquakes over the next several weeks. Signals from these earthquakes recorded at four stations were used to build subspace detectors, which were then used to scan the available data for previously unobserved events near the test site. The time period scanned extends from early 2009 until March 2018, and in that time four explosions, the collapse event, the three template events, and 30–37 additional template-matched events were detected. (Seven of the detections are low-reliability single-station detections at station MDJ.) Most of the events occurred within the weeks following DPRK-6. Thirteen of the detected events have been located. These events form two clusters, both to the northwest of the test site. The first cluster is about 3 km from the test site and contains an event that occurred in 2016 (before DPRK-5) as well as two of the last events detected in this work. The second cluster is about 6 km northwest of the test site and contains only events that occurred after the last test. Both clusters appear to be quite compact. The north–south extent of the clusters is well constrained by the observations to be less than 1–2 km. Moreover, the relatively high correlation coefficients in the 2–8 Hz band also argue for small separations between events. These events are hypothesized to have occurred on a northwest-striking fault plane that passes near or under the Punggye-ri test site. High stress state (inferred from low b-values) supports the idea that each cluster is located at an asperity on the hypothesized fault plane. Prior to DPRK-3, no events were observed from either cluster, but since DPRK-3 there has been at least one event per year. This is consistent with stress change triggering behavior observed elsewhere and suggests that all these events were triggered by stress changes on the asperities due to the explosions.

58 GEOSCIENCES↗

Completion design improvement using a deep convolutional network

Maximizing stimulated natural and hydraulic fracture network is one of the primary hydraulic fracturing concerns for economic production from a horizontal shale gas well. Geomechanical facies and preexisting fractures in each stage are identified based on similarities in formation characteristics to optimize the locations of perforation clusters. This often requires analyzing large volumes of drilling, Logging While Drilling (LWD) and Measurement While Drilling (MWD) data. In this paper, we develop a methodology that calculates the mechanical specific energy (MSE) using real-time drill string acceleration signals directly from its definition. High resolution vibration signals have been collected using a tri-axial accerlometer, which was an auxiliary tool included in acoustic borehole imager. This technique provides a cost-efficient solution for engineered completion design. Furthermore, we adopt deep Convolutional Neural Network (CNN) with signal processing to build a data pipeline that effectively extracts patterns from dynamic acceleration signals for rock lateral MSE classification. First, we apply discrete wavelet transform and Short-Time Fourier Transform (STFT) for signal denoising and pattern recognition. Then we construct an image dataset using multi-scale image fusion at pixel level from 3 sensor channels, including axial, lateral acceleration spectrograms and zero-padded revolutions per minute (RPM). The resulted RGB image dataset includes 4,000 images of 5 MSE ranges with various rock strength conditions. Our results demonstrate that the proposed deep learning model can achieve more than 90% classification accuracy. The deep learning results, as a reference source, were applied in selected Marcellus Shale Energy and Environmental Lab (MSEEL) wells engineered completion located in the Marcellus shale gas site.

03 NATURAL GAS↗

Effect of Collective Dynamics and Anharmonicity on Entropy in Heterogenous Catalysis: Building the Case for Advanced Molecular Simulations

In this paper, we present a perspective on the computational determination of entropy and its effects and consequences on heterogeneous catalysis. Special attention is paid to the role of anharmonicity and the deviations from the standard harmonic oscillator approximations which can fail to provide a reliable assessment of entropy. To address these challenges, advanced methodologies are needed that can explicitly account for these thermodynamic drivers through the appropriate statistical sampling of reactive free energy surfaces. We discuss where anharmonicity should be expected, where it has been observed from a theoretical perspective, and the methods currently employed to address it. We concentrate on three types of systems where we have observed major, nonnegligible anharmonic effects: (1) supported nanoparticles, where the migration of metal atoms, complexes, and entire clusters exhibit anharmonic behavior in their dynamic motion; (2) porous solids where confinement effects distort potential energy surfaces and hinder molecular motions resulting in large entropic terms; and (3) solid/liquid interfaces, where interactions between solvent molecules and adsorbed species can result in large solvent organization free energy and unique reactivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Coordination Chemistry in the Structural and Functional Exploration of Actinide-Based Metal-Organic Frameworks

The coordination chemistry between inorganic and organic species can be optimally exemplified by metal–organic frameworks (MOFs), whose structures and functionalities can be rationally designed from these highly tunable building blocks. The high porosity, stability, and versatile functionalities of MOFs have attracted wide-spread attention from energy-related research and pollution remediation to biomedical applications. A unique and underexplored subset of these materials are MOFs based on actinide nodes; these MOFs have distinguished themselves as a unique platform for investigating the versatile oxidation states, reactivity, and coordination chemistry of actinides. Herein, we will focus on the rational design and synthesis of actinide-based MOFs under the general guidelines of coordination chemistry for their structural and functional explorations. The dimensionality, topology, and structures of actinide-based MOFs can be controlled by selecting pre-designed building blocks of actinide-based nodes and organic linkers with certain desired coordination geometries and functionalities. Furthermore, these unique actinide-based MOFs have shown promise for applications in nuclear waste mitigation, pollution control, and catalysis.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Polyelectrolyte character of rigid rod peptide bundlemer chains constructed via hierarchical self-assembly

Short α-helical peptides were computationally designed to self-assemble into robust coiled coils that are antiparallel, homotetrameric bundles. These peptide bundle units, or ‘bundlemers’, have been utilized as anisotropic building blocks to construct bundlemer-based polymers via a hierarchical, hybrid physical-covalent assembly pathway. The bundlemer chains were constructed using short linker connections via ‘click’ chemistry reactions between the N-termini of bundlemer constituent peptides. The resulting bundlemer chains appear as extremely rigid, cylindrical rods in transmission electron microscopy (TEM) images. Small angle neutron scattering (SANS) shows that these bundlemer chains exist as individual rods in solution with a cross-section that is equal to that of a single coiled coil bundlemer building block of ≈20 Å. SANS further confirms that the interparticle solution structure of the rigid rod bundlemer chains is heterogeneous and responsive to solution conditions, such as ionic-strength and pH. Due to their peptidic constitution, the bundlemer assemblies behave like polyelectrolytes that carry an average charge density of approximately 3 charges per bundlemer as determined from SANS structure factor data fitting, which describes the repulsion between charged rods in solution. This repulsion manifests as a correlation hole in the scattering profile that is suppressed by dilution or addition of salt. Presence of rod cluster aggregates with a mass fractal dimension of ≈2.5 is also confirmed across all samples. The formation of such dense, fractal-like cluster aggregates in a solution of net repulsive rods is a unique example of the subtle balance between short-range attraction and long-rage repulsion interactions in proteins and other biomaterials. With computational control of constituent peptide sequences, it is further possible to deconvolute the underlying sequence driven structure–property relationships in the modular bundlemer chains.

36 MATERIALS SCIENCE↗

Dynamic conformational switching underlies TFIIH function in transcription and DNA repair and impacts genetic diseases

Transcription factor IIH (TFIIH) is a protein assembly essential for transcription initiation and nucleotide excision repair (NER). Yet, understanding of the conformational switching underpinning these diverse TFIIH functions remains fragmentary. TFIIH mechanisms critically depend on two translocase subunits, XPB and XPD. To unravel their functions and regulation, we build cryo-EM based TFIIH models in transcription- and NER-competent states. Using simulations and graph-theoretical analysis methods, we reveal TFIIH’s global motions, define TFIIH partitioning into dynamic communities and show how TFIIH reshapes itself and self-regulates depending on functional context. Our study uncovers an internal regulatory mechanism that switches XPB and XPD activities making them mutually exclusive between NER and transcription initiation. By sequentially coordinating the XPB and XPD DNA-unwinding activities, the switch ensures precise DNA incision in NER. Mapping TFIIH disease mutations onto network models reveals clustering into distinct mechanistic classes, affecting translocase functions, protein interactions and interface dynamics.

59 BASIC BIOLOGICAL SCIENCES↗

Robust Group Subspace Recovery: A New Approach for Multi-Modality Data Fusion

Robust Subspace Recovery (RoSuRe) algorithm was recently introduced as a principled and numerically efficient algorithm that unfolds underlying Unions of Subspaces (UoS) structure, present in the data. The union of Subspaces (UoS) is capable of identifying more complex trends in data sets than simple linear models. In this work, we build on and extend RoSuRe to prospect the structure of different data modalities individually. We propose a novel multi-modal data fusion approach based on group sparsity which we refer to as Robust Group Subspace Recovery (RoGSuRe). Relying on a bi-sparsity pursuit paradigm and non-smooth optimization techniques, the introduced framework learns a new joint representation of the time series from different data modalities, respecting an underlying UoS model. We subsequently integrate the obtained structures to form a unified subspace structure. The proposed approach exploits the structural dependencies between the different modalities data to cluster the associated target objects. The resulting fusion of the unlabeled sensors’ data from experiments on audio and magnetic data has shown that our method is competitive with other state of the art subspace clustering methods. The resulting UoS structure is employed to classify newly observed data points, highlighting the abstraction capacity of the proposed method.

47 OTHER INSTRUMENTATION↗

Computing with Beowulf

Parallel computers built out of mass-market parts are cost-effectively performing data processing and simulation tasks. The Supercomputing (now known as "SC") series of conferences celebrated its 10th anniversary last November. While vendors have come and gone, the dominant paradigm for tackling big problems still is a shared-resource, commercial supercomputer. Growing numbers of users needing a cheaper or dedicated-access alternative are building their own supercomputers out of mass-market parts. Such machines are generally called Beowulf-class systems after the 11th century epic. This modern-day Beowulf story began in 1994 at NASA's Goddard Space Flight Center. A laboratory for the Earth and space sciences, computing managers there threw down a gauntlet to develop a $50,000 gigaFLOPS workstation for processing satellite data sets. Soon, Thomas Sterling and Don Becker were working on the Beowulf concept at the University Space Research Association (USRA)-run Center of Excellence in Space Data and Information Sciences (CESDIS). Beowulf clusters mix three primary ingredients: commodity personal computers or workstations, low-cost Ethernet networks, and the open-source Linux operating system. One of the larger Beowulfs is Goddard's Highly-parallel Integrated Virtual Environment, or HIVE for short.

Cohen, Jarrett↗

A Step Beyond Simple Keyword Searches: Services Enabled by a Full Content Digital Journal Archive

The problems of managing and searching large archives of scientific journal articles can potentially be addressed through data mining and statistical techniques matured primarily for quantitative scientific data analysis. A journal paper could be represented by a multivariate descriptor, e.g., the occurrence counts of a number key technical terms or phrases (keywords), perhaps derived from a controlled vocabulary ( e . g . , the American Meteorological Society's Glossary of Meteorology) or bootstrapped from the journal archive itself. With this technique, conventional statistical classification tools can be leveraged to address challenges faced by both scientists and professional societies in knowledge management. For example, cluster analyses can be used to find bundles of "most-related" papers, and address the issue of journal bifurcation (when is a new journal necessary, and what topics should it encompass). Similarly, neural networks can be trained to predict the optimal journal (within a society's collection) in which a newly submitted paper should be published. Comparable techniques could enable very powerful end-user tools for journal searches, all premised on the view of a paper as a data point in a multidimensional descriptor space, e.g.: "find papers most similar to the one I am reading", "build a personalized subscription service, based on the content of the papers I am interested in, rather than preselected keywords", "find suitable reviewers, based on the content of their own published works", etc. Such services may represent the next "quantum leap" beyond the rudimentary search interfaces currently provided to end-users, as well as a compelling value-added component needed to bridge the print-to-digital-medium gap, and help stabilize professional societies' revenue stream during the print-to-digital transition.

Boccippio, Dennis J.↗

FLEET: Flexible Efficient Ensemble Training for Heterogeneous Deep Neural Networks

Parallel training of an ensemble of Deep Neural Networks (DNN) on a cluster of nodes is an effective approach to shorten the process of neural network architecture search and hyper-parameter tuning for a given learning task. Prior efforts have shown that data sharing, where the common preprocessing operation is shared across the DNN training pipelines, saves computational resources and improves pipeline efficiency. Data sharing strategy, however, performs poorly for a heterogeneous set of DNNs where each DNN has varying computational needs and thus different training rate and convergence speed. This paper proposes FLEET, a flexible ensemble DNN training framework for efficiently training a heterogeneous set of DNNs. We build FLEET via several technical innovations. We theoretically prove that an optimal resource allocation is NP-hard and propose a greedy algorithm to efficiently allocate resources for training each DNN with data sharing. We integrate data-parallel DNN training into ensemble training to mitigate the differences in training rates and introduce checkpointing into this context to address the issue of different convergence speeds. Experiments show that FLEET significantly improves the training efficiency of DNN ensembles without compromising the quality of the result.

Guan, Hui↗

Transcription preinitiation complex structure and dynamics provide insight into genetic diseases

Transcription preinitiation complexes (PICs) are vital assemblies whose function underlies the expression of protein-encoding genes. Cryo-EM advances have begun to uncover their structural organization. Nevertheless, functional analyses are hindered by incompletely modeled regions. Here we integrate all available cryo-EM data to build a practically complete human PIC structural model. This enables simulations that reveal the assembly’s global motions, define PIC partitioning into dynamic communities and delineate how structural modules function together to remodel DNA. We identify key TFIIE–p62 interactions that link core-PIC to TFIIH. p62 rigging interlaces p34, p44 and XPD while capping the DNA-binding and ATP-binding sites of XPD. PIC kinks and locks substrate DNA, creating negative supercoiling within the Pol II cleft to facilitate promoter opening. Mapping disease mutations associated with xeroderma pigmentosum, trichothiodystrophy and Cockayne syndrome onto defined communities reveals clustering into three mechanistic classes that affect TFIIH helicase functions, protein interactions and interface dynamics.

Biochemistry & Molecular Biology↗

FloodPlanet: High-Resolution Commercial Imagery for Training and Validation of Deep Learning-Based Models of Inundation Extent

Flooding events are becoming increasingly frequent worldwide and are known to cause extensive damage. Public optical and radar satellite imagery can be used to detect large areas of inundation in rural areas, however, long revisit times and coarse spatial resolution limit applications for short-lived events and urban areas. Commercial constellations such as those operated by Planet offer increased spatial and temporal resolution and can supplement mapping efforts to provide more information to disaster response, relief, and mitigation efforts. Deep learning requires high quality labeled data for training across coincident sensors. The FloodPlanet dataset presented here contains labeled surface water for 18 events across the world based on Planetscope imagery with coincident Harmonized Landsat Sentinel-2 ( HLS) or Sentinel-1 and builds upon the previously existing Sen1Floods11, xBD, and NASA Sentinel-1 datasets. Sen1Floods11 includes 4,831 512x512 pixel overlapping tiles of coincident Sentinel-1 and Sentinel-2 data observing 11 flood events across the world from 2017-2019. The dataset contains a combination of automated and hand-labeled surface water for use in training and validation of inundation modeling efforts. The xBD dataset identifies flood-damaged buildings and indicates the scale of damage to each (none, minor, moderate, and major) from four flood events which occurred in the United States, India, Nepal, and Bangladesh from the same time period. The NASA dataset contains hand-labeled water bodies observed in Sentinel-1 imagery during five flood events within the 2017-2019 period. The effort presented here utilizes observations from these previously investigated flood events to generate labels of surface water at the 3-5m spatial resolution provided by Planetscope and facilitate the comparison between public and commercial data. A data pipeline was built which uses clustering algorithms to pick the most suitable overlapping chips between the public data and PlanetScope data for manual labeling. Labels were created manually using NASA’s ImageLabeler tool and include areas of high- and low-confidence water. The high confidence designation is reserved for areas of open, unobstructed water while low confidence is used for areas of suspected water beneath vegetation, clouds, or cloud shadows. Expected to be released in late 2022, the FloodPlanet dataset will include tiled imagery with a unique ID for each 1024x1024 pixel tile, 7 bands of HLS data, and high- and low-confidence flood labels in both shapefile and tiff formats. The authors will follow Spatial Temporal Access Catalog (STAC) guidelines to release FloodPlanet on the Radiant Earth ML hub, which hosts public datasets for machine learning.

Alexander Melancon↗

HELIOCOMM: Wireless Controls State-of-the-Art Report

This report introduces the concept of wireless controls in heliostat-based concentrating solar thermal power (CSP) systems. Specifically, the need for wireless communications to be implemented within the heliostat-based CSP systems is identified versus the existing approaches that follow wireline connections which suffer from high installation, operation, and maintenance cost. Furthermore, this report analyzes the most recent advances in the field of developing wireless controls in heliostat-based CSP systems, which are highlighted to be in their infancy given the primitive wireless networking solutions that they currently utilize and test. The main contribution of this report is the introduction of a novel HELIOCOMM system that supports the wireless controls in heliostat-based CSP systems by exploiting the next generation networking technology of integrated access and backhaul. Furthermore, the proposed HELIOCOMM system performs an artificial intelligent clustering approach of the heliostats and clusterhead selection and develops an entropy-based routing model to enable the heliostats to communicate with the central station by considering their energy availability and network traffic. Also, towards efficiently exploiting the limited resources in the developed wireless communication system, a resource allocation module is introduced that performs the maximization of the energy efficiency of each heliostat by minimizing its corresponding experienced end-to-end latency to communicate with the central station, while performing an intelligent bandwidth splitting in the access and backhaul wireless links. The overall architecture is presented, and its individual building components are discussed in detail.

14 SOLAR ENERGY↗

Hadoop for High-Performance Climate Analytics: Use Cases and Lessons Learned

Scientific data services are a critical aspect of the NASA Center for Climate Simulations mission (NCCS). Hadoop, via MapReduce, provides an approach to high-performance analytics that is proving to be useful to data intensive problems in climate research. It offers an analysis paradigm that uses clusters of computers and combines distributed storage of large data sets with parallel computation. The NCCS is particularly interested in the potential of Hadoop to speed up basic operations common to a wide range of analyses. In order to evaluate this potential, we prototyped a series of canonical MapReduce operations over a test suite of observational and climate simulation datasets. The initial focus was on averaging operations over arbitrary spatial and temporal extents within Modern Era Retrospective- Analysis for Research and Applications (MERRA) data. After preliminary results suggested that this approach improves efficiencies within data intensive analytic workflows, we invested in building a cyber infrastructure resource for developing a new generation of climate data analysis capabilities using Hadoop. This resource is focused on reducing the time spent in the preparation of reanalysis data used in data-model inter-comparison, a long sought goal of the climate community. This paper summarizes the related use cases and lessons learned.

analytics↗

Non-Reciprocity, Metastability, and Dynamic Reconfiguration in Co-Assembly of Active and Passive Particles

Living organisms often exhibit non-reciprocal interactions where the forces acting on the objects are not equal in magnitude or opposite in direction. The combination of reciprocal and non-reciprocal interactions between synthetic building blocks remains largely unexplored. Here, out-of-equilibrium assemblies of non-motile isotropic passive and metal-patched motile active particles are formed by overlapping bulk interactions with directed self-propulsion. An external alternating current (AC) electric field generates concurrent dipolar and induced-charge electrophoretic forces between the particles which are evaluated using microscopy. The interaction force measurements allow to determine the degree of reciprocity in interactions, which is tunable by designing the active particle and its trajectory. While linearly-propelled active particles evade assembly with passive particles, helically propelled active particles form active-passive clusters with dynamic reconfiguration and long-lived metastability. Large clusters display programmable fluctuations and reconfigurability by controlling the fraction of active particles. The study establishes principles of integrating reciprocal and non-reciprocal interactions in guided colloidal assembly of reconfigurable metastable structures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗