Cryo‐EM map interpretation and protein model‐building using iterative map segmentation
Not Available
59 BASIC BIOLOGICAL SCIENCES↗
SEARCH · Search NASA
Results for “map segmentation”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Common risk segment mapping: Streamlining exploration for carbon storage sites, with application to coastal Texas and Louisiana
Large-scale deployment of Carbon Capture and Storage (CCS) will require a commensurately large number of sites. Efficient screening methods are needed to create investment assurance and focus efforts on the most promising sites. The problem is similar to petroleum exploration, for which there are well-developed (though seldom published) workflows, including Common Risk Segment (CRS) mapping. In brief, the process requires 1) defining the key play elements; 2) identifying candidate geologic intervals for each; 3) creating fact-based maps for those intervals; 4) determining minimum criteria for the success of each element; 5) reinterpreting the fact-based maps in terms of chance of success; and 6) combining the individual maps to form a composite, basin-scale view of prospectivity. We adapt the CRS process to screening for CO 2 storage sites. Critically, we redefine the process in terms of cost of characterization and development, rather than chance of success. For illustration, we apply the process to the example of the Lower Miocene on the Texas and Louisiana Gulf Coast. We show that the predictions are consistent with historic hydrocarbon production volumes and rates. The power of the CRS method is that it creates a systematic approach to geologic evaluation and translates complex, multidimensional analysis into clear, graphical and easily comprehended business inputs. The results highlight sweet spots and identifies critical risks, suggesting a focus for further data collection and analysis. Furthermore, the method developed here can be applied to both surface and subsurface factors anywhere that there is interest in geologic storage of CO 2 .
54 ENVIRONMENTAL SCIENCES↗
Geothermal play fairway analysis, part 1: Example from the Snake River Plain, Idaho
The Snake River Plain (SRP) volcanic province overlies the track of the Yellowstone hotspot, a thermal anomaly that extends deep into the mantle. Most of the area is underlain by a basaltic volcanic province that overlies a mid-crustal intrusive complex, which in turn provides the long-term heat flux needed to sustain geothermal systems. Previous studies have identified several known geothermal resource areas within the SRP. For the geothermal study presented herein, our goals were to: (1) adapt the methodology of Play Fairway Analysis (PFA) for geothermal exploration to create a formal basis for its application to geothermal systems, (2) assemble relevant data for the SRP from publicly available and private sources, and (3) build a geothermal PFA model for the SRP and identify the most promising plays, using GIS-based software tools that are standard in the petroleum industry. The study focused on identifying three critical resource parameters for exploitable hydrothermal systems in the SRP: heat source, reservoir and recharge permeability, and cap or seal. Data included in the compilation for heat source were heat flow, distribution and ages of volcanic vents, groundwater temperatures, thermal springs and wells, helium isotope anomalies, and reservoir temperatures estimated using geothermometry. Reservoir and recharge permeability was inferred from the analysis of stress orientations and magnitudes, post-Miocene faults, and subsurface structural lineaments based on magnetics and gravity data. Data for cap or seal included the distribution of impermeable lake sediments and clay-seal associated with hydrothermal alteration below the regional aquifer. These data were used to compile Common Risk Segment maps for heat, permeability, and seal, which were combined to create a Composite Common Risk Segment map for all southern Idaho that reflects the risk associated with geothermal resource exploration and identifies favorable resource tracks. Our regional assessment indicated that undiscovered geothermal resources may be located in several areas of the SRP. Two of these areas, the western SRP and Camas Prairie, were selected for more detailed assessment, during which heat, permeability, and seal were evaluated using newly collected field data and smaller grid parameters to refine the location of potential resources. These higher resolution assessments illustrate the flexibility of our approach over a range of scales.
54 ENVIRONMENTAL SCIENCES↗
Segmenting water and shadow regions within WorldView imagery using local binary patterns
Many shadow detection algorithms pertaining to remotely sensed imagery exist. Several of these algorithms exploit the spectral characteristics of shadows within imagery to identify shaded regions. However, these algorithms can have problems when water is also present within the imagery because water shares similar spectral characteristics with shadows. Many of these algorithms are applied to small image subsets instead of the image as a whole and frequently are applied to urban environments that require additional use of the normalized difference water index or other features to affect the removal of water from the shadow mask. This diversity of the image scene content coupled with the complexity and wide variety of environmental conditions that satellite imagery can acquire makes reliably separating shadow and water within larger images a complex problem. Thresholding various spectral indices to produce segmentation maps can be challenging when large, complex, and often imbalanced scenes are captured, which may require manual adjustment of algorithmic parameters for different image areas. Here, we present a methodology that makes use of the near-infrared channel using a watershed segmentation algorithm, local binary pattern measurements, and a support vector machine to classify shadow and water within a full WorldView scene. Results are promising with initial accuracies above 97% for both shadow and water.
47 OTHER INSTRUMENTATION↗
Efficient Distributed Sequence Parallelism for Transformer-Based Image Segmentation
We introduce an efficient distributed sequence parallel approach for training transformer-based deep learning image segmentation models. The neural network models are comprised of a combination of a Vision Transformer encoder with a convolutional decoder to provide image segmentation mappings. The utility of the distributed sequence parallel approach is especially useful in cases where the tokenized embedding representation of image data are too large to fit into standard computing hardware memory. To demonstrate the performance and characteristics of our models trained in sequence parallel fashion compared to standard models, we evaluate our approach using a 3D MRI brain tumor segmentation dataset. We show that training with a sequence parallel approach can match standard sequential model training in terms of convergence. Furthermore, we show that our sequence parallel approach has the capability to support training of models that would not be possible on standard computing resources.
Lyngaas, Isaac↗
Untargeted Spatial Metabolomics and Spatial Proteomics on the Same Tissue Section
An increasing number of spatial multiomic workflows have been recently developed. Some of these approaches have leveraged initial mass spectrometry imaging (MSI)-based spatial metabolomics to inform region of interest (ROI) selection for downstream spatial proteomics. However, these workflows have been limited by varied substrate requirements between modalities or have required analyzing serial sections (i.e., one section per modality). To mitigate these issues, we present a novel multiomic workflow that uses desorption electrospray ionization (DESI)-MSI to identify representative spatial metabolite patterns on-tissue prior to spatial proteomic analyses on the same tissue section. Further, this workflow is demonstrated here with a model mammalian tissue (coronal rat brain section) mounted on a polyethylene naphthalate-membrane slide. Initial DESI-MSI resulted in 160 annotations (SwissLipids) within to the METASPACE platform (≤20% false discovery rate). A segmentation map from the annotated ion images informed downstream ROI selection for spatial proteomics characterization from the same sample. The unspecific substrate requirements and minimal sample disruption inherent to DESI-MSI allowed for an optimized, downstream spatial proteomics assay, resulting in 3888 ± 240 to 4717 ± 48 proteins being confidently directed per ROI (200 µm x 200 µm). Finally, we demonstrate the integration of multiomic information, where we found ceramide localization to be correlated with SMPD3 abundance (ceramide synthesis protein), and we also utilized protein abundance to resolve metabolite isomeric ambiguity. Overall, the integration of DESI-MSI into the multiomic workflow allows for complementary spatial and molecular-level information to be achieved from optimized implementations of each MS assay inherent to the workflow itself.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Machine learning for endoleak detection after endovascular aortic repair
Diagnosis of endoleak following endovascular aortic repair (EVAR) relies on manual review of multi-slice CT angiography (CTA) by physicians which is a tedious and time-consuming process that is susceptible to error. We evaluate the use of a deep neural network for the detection of endoleak on CTA for post-EVAR patients using a novel data efficient training approach. 50 CTAs and 20 CTAs with and without endoleak respectively were identified based on gold standard interpretation by a cardiovascular subspecialty radiologist. The Endoleak Augmentor, a custom designed augmentation method, provided robust training for the machine learning (ML) model. Predicted segmentation maps underwent post-processing to determine the presence of endoleak. The model was tested against 3 blinded general radiologists and 1 blinded subspecialist using a held-out subset (10 positive endoleak CTAs, 10 control CTAs). Model accuracy, precision and recall for endoleak diagnosis were 95%, 90% and 100% relative to reference subspecialist interpretation (AUC = 0.99). Accuracy, precision and recall was 70/70/70% for generalist1, 50/50/90% for generalist2, and 90/83/100% for generalist3. The blinded subspecialist had concordant interpretations for all test cases compared with the reference. In conclusion, our ML-based approach has similar performance for endoleak diagnosis relative to subspecialists and superior performance compared with generalists.
60 APPLIED LIFE SCIENCES↗
Deep learning-enabled probing of irradiation-induced defects in time-series micrographs
Modeling time-series data with convolutional neural networks (CNNs) requires building a model to learn in batches as opposed to training sequentially. Coupling CNNs with in situ or operando techniques opens the possibility of accurately segmenting dynamic reactions and mass transport phenomena to understand how materials behave under the conditions in which they are used. In this article, in situ ion irradiation transmission electron microscopy (TEM) images are used as inputs into the CNN to assess the defect generation rate, defect cluster density, and saturation of defects. We then use the output segmentation maps to correlate with conventional TEM micrographs to assess the model’s ability to detail nanoscale interactions. Next, we discuss the implications of preprocessing and hyperparameters on model variability, accuracy when expanded to other datasets, and the role of regularization when controlling model variance. Ultimately, we eliminate human bias when extrapolating physical metrics, speed up analysis time, decouple reactions that happen at 100 ms intervals, and deploy models that are both accurate and transferable to similar experiments.
Burns, Kory (ORCID:0000000158019909)↗
Geothermal Play Fairway Analysis, Part 2: GIS methodology
Play Fairway Analysis (PFA) in geothermal exploration originates from a systematic methodology developed within the petroleum industry and is based on a geologic, geophysical, and hydrologic framework of identified geothermal systems. We tailored this methodology to study the geothermal resource potential of the Snake River Plain and surrounding region, but it can be adapted to other geothermal resource settings. We adapted the PFA approach to geothermal resource exploration by cataloging the critical elements controlling exploitable hydrothermal systems, establishing risk matrices that evaluate these elements in terms of both probability of success and level of knowledge, and building a code-based ‘processing model’ to process results. A geographic information system was used to compile a range of different data types, which we refer to as elements (e.g., faults, vents, heat flow, etc.), with distinct characteristics and measures of confidence. Discontinuous discrete data (points, lines, or polygons) for each element were transformed into continuous interpretive 2D grid surfaces called evidence layers. Because different data types have varying uncertainties, most evidence layers have an accompanying confidence layer which reflects spatial variations in these uncertainties. Risk layers, as defined here, are the product of evidence and confidence layers, and are the building blocks used to construct Common Risk Segment (CRS) maps for heat, permeability, and seal, using a weighted sum for permeability and heat, but a different approach with seal. CRS maps quantify the variable risk associated with each of these critical components. In a final step, the three CRS maps were combined into a Composite Common Risk Segment (CCRS) map, using a modified weighted sum, for results that reveal favorable areas for geothermal exploration. Additional maps are also presented that do not mix contributions from evidence and confidence (to allow an isolated view of evidence and confidence), as well as maps that calculate favorability using the product of components instead of a weighted sum (to highlight where all components are present). Our approach helped to identify areas of high geothermal favorability in the western and central Snake River Plain during the first phase of study and helped identify more precise local drilling targets during the second phase of work. By identifying favorable areas, this methodology can help to reduce uncertainty in geothermal energy exploration and development.
15 GEOTHERMAL ENERGY↗
A Play-Based Exploration of CO 2 Storage in the Illinois Basin: Development and Application of the Play-Based Exploration Workflow
This report documents the workflow developed and applied for a play-based exploration (PBE) of carbon capture and storage (CCS) potential in the Illinois Basin, conducted under U.S. Department of Energy Cooperative Agreement DE-FE0032366. The project was led by the Illinois State Geological Survey (ISGS) at the University of Illinois Urbana-Champaign in collaboration with Visage Energy. The goal of this workflow is to identify locations where subsurface, surface, and societal conditions align to support safe and effective geologic CO 2 storage. To achieve this, the project team developed a systematic, seven-step workflow for conducting play-based exploration: (1) defining play elements, (2) collecting data, (3) constructing a geodatabase, (4) defining suitability criteria, (5) conducting suitability mapping, (6) generating Common Risk Segment (CRS) maps, and (7) creating composite play maps. The workflow is designed to be repeatable and adaptable for CCS assessments in other regions or for alternative subsurface energy applications such as hydrogen or natural gas storage.
01 COAL, LIGNITE, AND PEAT↗
Play Fairway Analysis: Structurally Controlled Geothermal Systems in the Eastern Great Basin Extensional Regime, Utah
A research team with membership from the University of Utah/Energy & Geoscience Institute, the University of Utah/Dept. of Geology & Geophysics, and the Utah Geological Survey, undertook a play fairway analysis (PFA) for geothermal resources in the Eastern Great Basin (EGB) extensional tectonic regime of western Utah. This is a high-priority region for geothermal exploration because active Basin and Range (B&R) extension with volcanism having a N-S strike is superimposed upon pre-existing E-W belts of plutonic rocks and large-scale structural lineaments. Cumulative heat flow along the N-S strike of the state totals approximately 5 GWt above background stable interior. Three electricity producing power plants currently exist with substantial potential for increase. Succinctly, our PFA approach aims to resolve potential sources of heat and permeability in the region, which are the two principal criteria for establishing a geothermal resource. An initial Phase 1 was carried out using only existing geoscientific data in the area. Criteria selected for focusing heat potential include direct heat flow measurements in boreholes, magnetotelluric (MT) low resistivity anomalies, fluid/gas geochemistry, and proximity to recent volcanic eruptions. Permeability is established through geological structures (fault density, critically stressed areas, seismicity, gravity), and MT low resistivity anomalies. In Phase II of this PFA project, additional geological, geophysical and geochemical data were acquired and analysis carried out primarily over promising composite common risk (CCR) areas initially identified in Phase I in order to focus prospectivity and prepare for drilling recommendations. These prospects are near the Twin Peaks rhyolite field, high heat flow areas north of the producing Cove Fort system, and geophysical structure beneath the Crater Knoll area off the northeast flank of the Mineral Mountains. Additional data included MT site fill-in, structural mapping and analysis using high-resolution imagery, gravity and on-ground mapping, Nodal 3C passive seismic collection, and passive 3He surveying. Heat source and permeability potential are again expressed in terms of their individual common risk segment (CRS) maps, with a color scheme using green for most favorable (low risk) and red for least favorable (high risk). Diverse data types are united through the technique of probability kriging, which establishes prospectivity thresholds for each data type and then computes probability of exceeding that threshold over the PFA area. Modified CRS and CCRS maps are compared to those of Phase I to highlight tighter prospectivity focus. In doing so, the prospectivity threshold for heat was increased significantly to narrow the targeting. In the final Phase III of this project where a recommended deep thermal gradient hole was sited, additional geophysical, geochemical and geological field collection and analysis was carried out to refine drill hole targeting. This includes prospect-scale MT, gravity, structure, passive seismic deployment (Cove Fort area), and detailed 3He isotope profiling. It was the recommendation of the DOE Technical Monitoring Team (TMT) that one or more holes be sited in the north-ern Cove Fort area where legacy TG gradient holes showed high cumulative heat flow. These were to be of moderate depth, 2000-3000 feet, to reach the geothermal fluid table expected to start in excess of 1000 feet depth. The drilling organization stipulated by the DOE/GTO was that of the USGS Research Drilling Program (RDP) centered in Las Vegas, NV. A detailed well plan, appended to this report, was developed principally by Dr. Ben Barker consulting to University of Utah, Dr. Steve Pye on the DOE TMT, Mr. Steven Crawford of the USGS-RDP, and the project PI Phil Wannamaker. However, temperature and possible H 2 S at the systems lead to cancellation of the drilling last-minute as this appeared outside the experience base of the USGS-RDP. We hope to have the opportunity to revisit the test drilling and expand the Play Fairway Analysis of this region at some point in the future.
15 GEOTHERMAL ENERGY↗
EDS-PhaSe: Phase Segmentation and Analysis from EDS Elemental Map Images Using Markers of Elemental Segregation
Scanning electron microscopy (SEM), combined with energy-dispersive spectroscopy (EDS), is an extensively used technique for in-depth microstructural analysis. Here, we present the EDS-Phase Segmentation (EDS-PhaSe) tool that enables phase segmentation and phase analysis using the EDS elemental map images. Importantly, it converts the EDS map images into estimated composition maps for calculating markers of selective elemental redistribution in the scanned area and creates a phase-segmented micrograph while providing approximate fraction and composition of each identified phase. EDS-PhaSe offers two unique advantages. Firstly, it enables the direct processing of EDS elemental map images without requiring any raw or proprietary data/software, thereby allowing the analysis of EDS results available in the published literature as images. Secondly, it enables segmentation and analysis of phases even when the phase contrast is missing in backscattered micrographs, assisting in correlating the XRD and SEM-EDS data as shown in this work for a AlCoCrFeNi high-entropy alloy.
36 MATERIALS SCIENCE↗
Wettability Effects on Primary Drainage Mechanisms and NAPL Distribution: A Pore-Scale Study
The pore-scale processes governing water drainage behavior in porous media have implications for geoscience multiphase scenarios including carbon capture and storage, contaminant site remediation, oil recovery, and vadose zone processes. However, few studies report directly observed pore-scale water drainage phenomena in 3-D soils. This knowledge gap limits our ability to verify assumptions underlying existing models and develop optimal solutions. As such, this paper utilizes synchrotron X-ray microtomography to present an experimental pore-scale examination of nonaqueous phase liquid (NAPL)/water distribution along a primary drainage front as dense NAPL was injected upward into water wetting (WW) and intermediate wetting (IW) sand-packed columns. Pore-network structures were extracted from imaged data sets and mapped onto segmented NAPL/water data sets which allowed quantitative examinations of wettability impacts on (a) the extent to which NAPL fills individual pore bodies and (b) relationships between pore size and the phase occupying the pore, with both considered as a function of distance (and capillary pressure) relative to the NAPL front. These results revealed that several hypotheses treating IW sand similarly to WW sands are simplistic. IW systems exhibited a sequence of pore filling that deviated from traditional capillary pressure-based model predictions: NAPL invades smaller pores, while larger, adjacent pores are bypassed leaving multipore residual water ganglia. NAPL pore saturations were close to 1 and did not change with capillary pressure in IW systems. Overall, the results illustrate how a relatively small change in operative contact angle alters NAPL distribution during water drainage, with important implications for geoscience multiphase flow scenarios.
58 GEOSCIENCES↗
A VR-based volumetric medical image segmentation and visualization system with natural human interaction
Volume rendering produces informative two-dimensional (2D) images from a 3-dimensional (3D) volume. It highlights the region of interest and facilitates a good comprehension of the entire data set. However, volume rendering faces a few challenges. First, a high-dimensional transfer function is usually required to differentiate the target from its neighboring objects with subtle variance. Unfortunately, designing such a transfer function is a strenuously trial-and-error process. Second, manipulating/visualizing a 3D volume with a traditional 2D input/output device suffers dimensional limitations. To address all the challenges, we design NUI-VR 2 , a natural user interface-enabled volume rendering system in the virtual reality space. NUI-VR 2 marries volume rendering and interactive image segmentation. It transforms the original volume into a probability map with image segmentation. A simple linear transfer function will highlight the target well in the probability map. More importantly, we set the entire image segmentation and volume rendering pipeline in an immersive virtual reality environment with a natural user interface. NUI-VR 2 eliminates the dimensional limitations in manipulating and perceiving 3D volumes and dramatically improves the user experience.
42 ENGINEERING↗
Bayesian Segmentation (BCNN) v.1
Deep learning has been applied with great success to the segmentation of 3D X-Ray Computed Tomography (CT) scans. Establishing the credibility of these segmentations requires uncertainty quantification (UQ) to identify problem areas. Bayesian neural networks (BNNs), which use variational inference to learn the posterior distribution of the neural network weights, have been proposed to incorporate UQ into deep learning models. This software is an implementation of a novel 3D Bayesian convolutional neural network (BCNN) that provides accurate binary segmentations and uncertainty maps for 3D volumes. In particular, the uncertainty maps generated by this BCNN capture continuity and visual gradients, making them interpretable as confidence intervals for segmentation usable in numerical simulations. SAND2019-12927 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.
LaBonte, TylerMatthew↗
Data from "A Bayesian Record Linkage Approach to Applications in Tree Demography Using Overlapping LiDAR Scans"
Processed LiDAR data and environmental covariates from 2015 and 2019 LiDAR scans in the Vicinity of Snodgrass Mountain (Western Colorado, USA), in a geographic subset used in primary analysis for the research paper.This package contains LiDAR-derived canopy height maps for 2015 and 2019, crown polygons derived from the height maps using a segmentation algorithm, and environmental covariates supporting the model of forest growth. Source datasets include August 2015 and August 2019 discrete-return LiDAR point clouds collected by Quantum Geospatial for terrain mapping purposes on behalf of the Colorado Hazard Mapping Program and the Colorado Water Conservation Board. Both datasets adhere to the USGS QL2 quality standard. The point cloud data were processed using the R package lidR to generate a canopy height model representing maximum vegetation height above the ground surface, using a pit-free algorithm.This dataset was compiled to assess how spatial patterns of tree growth in montane and subalpine forests are influenced by water and energy availability. Understanding these growth patterns can provide insight into forest dynamics in the Southern Rocky Mountains under changing climatic conditions.This dataset contains .tif, .csv, and .txt files. This dataset additionally includes a file-level metadata (flmd.csv) file that lists each file contained in the dataset with associated metadata; and a data dictionary (dd.csv) file that contains column/row headers used throughout the files along with a definition, units, and data type.
54 ENVIRONMENTAL SCIENCES↗
Automated Assembly Progress Monitoring in Modular Construction Factories Using Computer Vision-Based Instance Segmentation
Modular construction has recently gained interest as a transformative construction method. In this method, a large portion of the construction is performed inside factories, where processes are fast-paced and interdependent; therefore, any deviation from the schedule can delay the production. Such deviations are frequent in modular factories due to the labor-intensive nature of the tasks. This propagation of delays can be mitigated by continuously monitoring each process; however, current manual monitoring methods are laborious, and recently proposed contact sensor-based methods are intrusive to the work. In addition, recent computer vision-based monitoring methods inside factories are limited to detection algorithms that fail to provide the pixel-level accuracy required for assembly progress monitoring in highly occluded factory scenes, and they require a large number of manual annotations. Therefore, this paper proposes a method to monitor the installation of subassemblies in modular construction factories using mask R-CNN instance segmentation and improves the data efficiency of the model using a copy-paste augmentation method. This method was validated on the CCTV videos captured from a modular construction factory in the US, resulting in a 9% mAP improvement in segmentation.
computer vision↗
Quantifying the unknown impact of segmentation uncertainty on image-based simulations
Abstract Image-based simulation, the use of 3D images to calculate physical quantities, relies on image segmentation for geometry creation. However, this process introduces image segmentation uncertainty because different segmentation tools (both manual and machine-learning-based) will each produce a unique and valid segmentation. First, we demonstrate that these variations propagate into the physics simulations, compromising the resulting physics quantities. Second, we propose a general framework for rapidly quantifying segmentation uncertainty. Through the creation and sampling of segmentation uncertainty probability maps, we systematically and objectively create uncertainty distributions of the physics quantities. We show that physics quantity uncertainty distributions can follow a Normal distribution, but, in more complicated physics simulations, the resulting uncertainty distribution can be surprisingly nontrivial. We establish that bounding segmentation uncertainty can fail in these nontrivial situations. While our work does not eliminate segmentation uncertainty, it improves simulation credibility by making visible the previously unrecognized segmentation uncertainty plaguing image-based simulation.
42 ENGINEERING↗