SEARCH · Search NASA
Results for “pick up”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A self-supervised workflow for particle picking in cryo-EM
High-resolution single-particle cryo-EM data analysis relies on accurate particle picking. To facilitate the particle picking process, a self-supervised workflow has been developed. This includes an iterative strategy, which uses a 2D class average to improve training particles, and a progressively improved convolutional neural network for particle picking. To automate the selection of particles, a threshold is defined (%/Res) using the ratio of percentage class distribution and resolution as a cutoff. This workflow has been tested using six publicly available data sets with different particle sizes and shapes, and can automatically pick particles with minimal user input. The picked particles support high-resolution reconstructions at 3.0 Å or better. This workflow is a step towards automated single-particle cryo-EM data analysis at the stage of particle picking. It may be used in conjunction with commonly used single-particle analysis packages such as Relion , cryoSPARC , cisTEM , SPHIRE and EMAN2 .
CryoTransformer: a transformer model for picking protein particles from Cryo-EM micrographs
Cryo-electron microscopy (cryo-EM) is a powerful technique for determining the structures of large protein complexes. Picking single protein particles from cryo-EM micrographs (images) is a crucial step in reconstructing protein structures from them. However, the widely used template-based particle picking process requires some manual particle picking and is labor-intensive and time-consuming. Though machine learning and artificial intelligence (AI) can potentially automate particle picking, the current AI methods pick particles with low precision or low recall. The erroneously picked particles can severely reduce the quality of reconstructed protein structures, especially for the micrographs with low signal-to-noise-ratio (SNR).
CryoSegNet: accurate cryo-EM protein particle picking by integrating the foundational AI image segmentation model and attention-gated U-Net
Picking protein particles in cryo-electron microscopy (cryo-EM) micrographs is a crucial step in the cryo-EM-based structure determination. However, existing methods trained on a limited amount of cryo-EM data still cannot accurately pick protein particles from noisy cryo-EM images. The general foundational artificial intelligence–based image segmentation model such as Meta’s Segment Anything Model (SAM) cannot segment protein particles well because their training data do not include cryo-EM images. Here, we present a novel approach (CryoSegNet) of integrating an attention-gated U-shape network (U-Net) specially designed and trained for cryo-EM particle picking and the SAM. The U-Net is first trained on a large cryo-EM image dataset and then used to generate input from original cryo-EM images for SAM to make particle pickings. CryoSegNet shows both high precision and recall in segmenting protein particles from cryo-EM micrographs, irrespective of protein type, shape and size. On several independent datasets of various protein types, CryoSegNet outperforms two top machine learning particle pickers crYOLO and Topaz as well as SAM itself. The average resolution of density maps reconstructed from the particles picked by CryoSegNet is 3.33 Å, 7% better than 3.58 Å of Topaz and 14% better than 3.87 Å of crYOLO. It is publicly available at https://github.com/jianlin-cheng/CryoSegNet
A large expert-curated cryo-EM image dataset for machine learning protein particle picking
Cryo-electron microscopy (cryo-EM) is a powerful technique for determining the structures of biological macromolecular complexes. Picking single-protein particles from cryo-EM micrographs is a crucial step in reconstructing protein structures. However, the widely used template-based particle picking process is labor-intensive and time-consuming. Though machine learning and artificial intelligence (AI) based particle picking can potentially automate the process, its development is hindered by lack of large, high-quality labelled training data. To address this bottleneck, we present CryoPPP, a large, diverse, expert-curated cryo-EM image dataset for protein particle picking and analysis. It consists of labelled cryo-EM micrographs (images) of 34 representative protein datasets selected from the Electron Microscopy Public Image Archive (EMPIAR). The dataset is 2.6 terabytes and includes 9,893 high-resolution micrographs with labelled protein particle coordinates. The labelling process was rigorously validated through 2D particle class validation and 3D density map validation with the gold standard. The dataset is expected to greatly facilitate the development of both AI and classical methods for automated cryo-EM protein particle picking.
Artificial intelligence in cryo-EM protein particle picking: recent advances and remaining challenges
Abstract Cryo-electron microscopy (cryo-EM) has revolutionized structural biology by enabling the determination of high-resolution 3-Dimensional (3D) structures of large biological macromolecules. Protein particle picking, the process of identifying individual protein particles in cryo-EM micrographs for building protein structures, has progressed from manual and template-based methods to sophisticated artificial intelligence (AI)-driven approaches in recent years. This review critically examines the evolution and current state of cryo-EM particle picking methods, with an emphasis on the impact of AI. We conducted a comparative evaluation of popular AI-based particle picking methods, using both general machine learning metrics and specific cryo-EM structure determination metrics. This analysis involved constructing the 3D density map from the picked protein particles and assessing the obtained resolution and particle orientation diversity, underscoring the significant impact of AI on cryo-EM particle picking. Despite the advancements, we also identified key obstacles, such as handling complex micrographs with small proteins. The analysis provides insights into the future development of more sophisticated and fully automated AI methods in cryo-EM particle recognition.
Automatic microseismic event picking via unsupervised machine learning
SUMMARY Effective and efficient arrival picking plays an important role in microseismic and earthquake data processing and imaging. Widely used short-term-average long-term-average ratio (STA/LTA) based arrival picking algorithms suffer from the sensitivity to moderate-to-strong random ambient noise. To make the state-of-the-art arrival picking approaches effective, microseismic data need to be first pre-processed, for example, removing sufficient amount of noise, and second analysed by arrival pickers. To conquer the noise issue in arrival picking for weak microseismic or earthquake event, I leverage the machine learning techniques to help recognizing seismic waveforms in microseismic or earthquake data. Because of the dependency of supervised machine learning algorithm on large volume of well-designed training data, I utilize an unsupervised machine learning algorithm to help cluster the time samples into two groups, that is, waveform points and non-waveform points. The fuzzy clustering algorithm has been demonstrated to be effective for such purpose. A group of synthetic, real microseismic and earthquake data sets with different levels of complexity show that the proposed method is much more robust than the state-of-the-art STA/LTA method in picking microseismic events, even in the case of moderately strong background noise.
Divide and conquer: separating the two probabilities in seismic phase picking
There are two fundamental probabilities in the seismic phase picking process—the probability of the existence of a seismic phase (detection probability) and the probability associated with the phase arrival time estimation (timing probability). The nearly ubiquitous approach in developing deep learning phase picking models is to use a kernel, such as a truncated Gaussian, to mask the labelled phase arrival time and train a segmentation model. Once a model is trained, the times of the peaks in the output are taken as phase arrival times (picks), and the height of the peaks are taken as ‘probability’ of the picks. Here, we show that this ‘probability’ represents neither the detection nor the timing probability because this approach forces the output to follow the shape of the kernel. We introduce an approach using two models to estimate these two distinct probabilities. We use a binary classifier with a calibrated confidence to address the detection probability and a multiclass classifier to obtain a probability mass function to address the timing probability. This new approach can make the deep learning-based phase picking process more interpretable and provide options to logically control seismic monitoring workflows.
Making Phase-Picking Neural Networks More Consistent and Interpretable
Improving the interpretability of phase-picking neural networks remains an important task to facilitate their deployment to routine, real-time seismic monitoring. The popular phase-picking neural networks published in the literature lack interpretability because their output prediction scores do not necessarily correspond with the reliability of phase picks and can even be highly inconsistent depending on how we window the waveform data. Here, we show that systematically shifting the waveforms during training and using an antialiasing filter within the neural network architecture can substantially improve the consistency of the output prediction scores and can even make them scale with the signal-to-noise ratios of the waveforms. We demonstrate the improvements by applying these approaches to a commonly used phase-picking neural network architecture and using waveform data from the 2019 Ridgecrest earthquake sequence.
The Value of Hyperparameter Optimization in Phase-Picking Neural Networks
The effectiveness of neural networks for picking seismic phase arrival times has been demonstrated through several case studies, and seismic monitoring programs are starting to adopt the technology into their workflows. However, published models were designed and trained using rather arbitrary choices of hyperparameters, limiting their performance. In this study, we use phase picks from both routine and template-matching analyses from multiple regions (Ridgecrest, California; Kilauea, Hawaii; Yellowstone, Wyoming–Montana–Idaho) to test a hyperparameter optimization scheme for phase-picking neural networks and to evaluate their performance. We show that a published model, namely PhaseNet (Zhu and Beroza, 2019), can be simplified and improved with reasonable effort and there are preferred choices of hyperparameters that increase the performance. We also show that models optimized based on the arrival times reported in routine event catalogs consistently perform well when picking arrival times of smaller events, which is crucial for many tasks from microseismicity to explosion monitoring.
Automatic Seismic Phase Picking Using Deep Learning for the EGS Collab project
Microseismic monitoring plays an important role in many energy-related and environmental industries.The microseismic event catalog and seismic structure of the subsurface are two of the primary outputsof the microseismic monitoring system. Though rough locations of microseismic events can be estimated automatically, obtaining high-resolution microseismic event locations requires a significant amount of human laborespecially on seismic phase picking. Unlike traditional automatic pickers that are usually less precise than human analysts, a fewrecently proposed algorithms based on deepneural networks(DNN)were able to match or surpass human performance for earthquake signals. Due to differences in the spatial scale of the study area, sensor sampling rate, and geometry of the monitoring system, it is not clear whether these deepneural networkmodels can be used to speed up microseismic data processing. In this paper, we adapted the DNN based technique for automatic phase picking of microseismic signals. We usedmicroseismic data recorded at the experiment 1 site of the enhancedgeothermal system (EGS) Collab project anddesigneda workflowthat we call transfer-learning aided double-difference tomography (TADT),thatcombines transfer learning and seismic tomography. We re-train an existing DNN with our data to obtain a newmodel using around 3500 seismogramsand associated manual phase picks. Thistransfer learnedmodel is able to reach human performance but muchfaster than human analysts. The transfer-learning-derived phase pickswereused to improve microseismic event locations and imagethesubsurface. The results are similar to or slightly better than those obtained with manual phase picks.
An End-To-End Earthquake Detection Method for Joint Phase Picking and Association Using Deep Learning
Earthquake monitoring by seismic networks typically involves a workflow consisting of phase detection/picking, association, and location tasks. In recent years, the accuracy of these individual stages has been improved through the use of machine learning techniques. Here, in this study, we introduce a new end-to-end approach that improves overall earthquake detection accuracy by jointly optimizing each stage of the detection pipeline. We propose a neural network architecture for the task of multi-station processing of seismic waveforms recorded over a seismic network. This end-to-end architecture consists of three sub-networks: a backbone network that extracts features from raw waveforms, a phase picking sub-network that picks P- and S-wave arrivals based on these features, and an event detection sub-network that aggregates the features from multiple stations to associate and detect earthquakes across a seismic network. We use these sub-networks together with a shift-and-stack module based on back-projection that introduces kinematic constraints on arrival times, allowing the neural network model to generalize to different velocity models and to variable station geometry in seismic networks. We evaluate our proposed method on the STanford EArthquake Dataset (STEAD) and on the 2019 Ridgecrest, CA earthquake sequence. The results demonstrate that our end-to-end approach can effectively pick P- and S-wave arrivals and achieve earthquake detection accuracy rivaling that of other state-of-the-art approaches. Because our approach preserves information across tasks in the detection pipeline, it has the potential to outperform approaches that do not.
Evaluating multistation phase picking algorithm phase neural operator (PhaseNO) on local seismic networks
Reliable automatic phase picking is important for many seismic applications. With the development of machine learning approaches, many algorithms are proposed, evaluated and applied to different areas. Many of these algorithms are single station based, while recent proposed methods start to combine surrounding stations into consideration in the problem of phase picking. Among these algorithms, the phase neural operator (PhaseNO) shows promising results on regional data sets comparing to existing algorithms. But there are many use cases for the local seismic networks in our community, therefore in this paper we evaluate the performance of PhaseNO on four different local data sets and compare the results to PhaseNet and EQTransformer. We used both individual phase picking metrics as well as association metrics to illustrate the performance of PhaseNO. By manually reviewing the newly detected events, we find that the PhaseNO model outperforms the single station-based approaches in the local-scale use cases due to its consideration of coherent signals from multiple stations. We also explored PhaseNO’s behaviours when only using one station, as well as gradually increasing the number of stations in the seismic network to better understand its behaviour. Overall, using the off-the-shelf machine learning based phase pickers, PhaseNO demonstrated its good performance on local-scale seismic networks.
Curb Allocation and Pick-Up Drop-Off Aggregation for a Shared Autonomous Vehicle Fleet
Advances in information technologies and vehicle automation have birthed new transportation services, including shared autonomous vehicles (SAVs). Shared autonomous vehicles are on-demand self-driving taxis, with flexible routes and schedules, able to replace personal vehicles for many trips in the near future. The siting and density of pick-up and drop-off (PUDO) points for SAVs, much like bus stops, can be key in planning SAV fleet operations, since PUDOs impact SAV demand, route choices, passenger wait times, and network congestion. Unlike traditional human-driven taxis and ride-hailing vehicles like Lyft and Uber, SAVs are unlikely to engage in quasi-legal procedures, like double parking or fire hydrant pick-ups. In congested settings, like central business districts (CBD) or airport curbs, SAVs and others will not be allowed to pick up and drop off passengers wherever they like. This paper uses an agent-based simulation to model the impact of different PUDO locations and densities in the Austin, Texas CBD, where land values are highest and curb spaces are coveted. In this paper 18 scenarios were tested, varying PUDO density, fleet size and fare price. The results show that for a given fare price and fleet size, PUDO spacing (e.g., one block vs. three blocks) has significant impact on ridership, vehicle-miles travelled, vehicle occupancy, and revenue. A good fleet size to serve the region’s 80 core square miles is 4000 SAVs, charging a $1 fare per mile of travel distance, and with PUDOs spaced three blocks of distance apart from each other in the CBD.
Reducing the Parameter Dependency of Phase-Picking Neural Networks with Dice Loss
Training a neural network for picking seismic phase arrivals has been commonly posed as a segmentation problem. It is a highly imbalanced segmentation problem in the sense that the background vastly dominates the foreground because we are trying to pick the optimal single sample point that represents the arrival of a seismic phase in a many seconds long time window. Here, we test the Dice loss, which is a preferred loss function for highly imbalanced image segmentation problems. We show that phase-picking neural networks trained on the Dice loss behave in a binary fashion for which the prediction output is almost always either nearly 1 or nearly 0. This feature removes the strong dependence of data processing workflows on the prediction score threshold, which is an otherwise critical parameter to determine when using neural networks trained on the cross-entropy loss. When strategically used, models trained on the Dice loss can reduce the parameter dependency of machine learning-based seismic monitoring.
The study of high-frequency pick-ups for electron beam position measurements in the AWAKE common beamline
The common beamline of the AWAKE experiment at CERN involves the co-propagation of two particle beams: protons with 48 nC bunch charge and 250 ps bunch length, and electrons with up to 600 pC bunch charge and approximately 4 ps bunch length. The existing operational beam position monitors at AWAKE cannot measure the electron bunches whilst the more-intense proton bunches are present, due to their low operating frequency. In order to try to address this challenge, two different types of high-frequency pick-ups were studied, a conical-shaped button pick-up and a Cherenkov diffraction radiation-based pick-up designed to operate at around 30 GHz. Both devices were installed at AWAKE and were connected to two identical read-out systems designed by TRIUMF. This contribution presents and discusses the results obtained from beam-based measurements during the current experimental year.
Rock Valley Accelerated Weight Drop Seismic Data Processing and Picking of P-wave and S-wave Arrival Times
Rock Valley, in the southern end of the Nevada National Security Site, hosts a fault system that was responsible for a shallow (< 3 km below surface ) magnitude 3.7 earthquake in May 1993. In order to better understand this system, seismic properties of the shallow subsurface need to be better constrained. In April and May of 2021, accelerated weight drop (AWD) active-source seismic data were recorded in order to measure P- and S-wave travel-times for the area. This report describes the processing and phase picking of the recorded seismic waveforms. In total, we picked 7,982 P-wave arrivals at offsets up to ~2500 m, and 4,369 S-wave arrivals at offsets up to ~2200 m. These travel-time picks can be inverted for shallow P-wave and S-wave velocity structure in future studies.
Pick-and-Place Transfer of Arbitrary-Metal Electrodes for van der Waals Device Fabrication
Van der Waals electrode integration is a promising strategy to create nearly perfect interfaces between metals and 2D materials, with advantages such as eliminating Fermi-level pinning and reducing contact resistance. However, the lack of a simple, generalizable pick-and-place transfer technology has greatly hampered the wide use of this technique. Here, we demonstrate the pick-and-place transfer of prefabricated electrodes from reusable polished hydrogenated diamond substrates without the use of any sacrificial layers due to the inherent low-energy and dangling-bond-free nature of the hydrogenated diamond surface. The technique enables transfer of arbitrary-metal electrodes and an electrode array, as demonstrated by successful transfer of eight different elemental metals with work functions ranging from 4.22 to 5.65 eV. We also demonstrate the electrode array transfer for large-scale device fabrication. The mechanical transfer of metal electrodes from diamond to van der Waals materials creates atomically smooth interfaces with no interstitial impurities or disorder, as observed with cross-section high-resolution transmission electron microscopy and energy-dispersive X-ray spectroscopy. As a demonstration of its device application, we use the diamond transfer technique to create metal contacts to monolayer transition metal dichalcogenide semiconductors with high-work-function Pd, low-work-function Ti, and semimetal Bi to create n- and p-type field-effect transistors with low Schottky barrier heights. We also extend this technology to air-sensitive materials (trilayer 1T’ WTe 2 ) and other applications such as ambipolar transistors, Schottky diodes, and optoelectronics. This highly reliable and reproducible technology paves the way for new device architectures and high-performance devices.