Search NASA⌕ Search

Engineering topics

Borodinov, Nikolay

Publications and source records attributed to Borodinov, Nikolay.

At least 19 records

Correlative multimodal chemical imaging via machine learning

Machine learning approach can combine mass spectral imaging (MSI) techniques, one with low spatial resolution but intact molecular spectra and the other with nanometer spatial resolution but fragmented molecular signatures, to predict molecular MSI spectra with submicron spatial resolution. The machine learning approach can perform transformations on the spectral image data of the two MSI techniques to reduce dimensionality, and using a correlation technique, find relationships between the transformed spectral image data. The determined relationships can be used to generate MSI spectra of desired resolution.

Ovchinnikova, Olga S.↗

A review on recent machine learning applications for imaging mass spectrometry studies

Imaging mass spectrometry (IMS) is a powerful analytical technique widely used in biology, chemistry, and materials science fields that continue to expand. IMS provides a qualitative compositional analysis and spatial mapping with high chemical specificity. The spatial mapping information can be 2D or 3D depending on the analysis technique employed. Due to the combination of complex mass spectra coupled with spatial information, large high-dimensional datasets (hyperspectral) are often produced. Therefore, the use of automated computational methods for an exploratory analysis is highly beneficial. The fast-paced development of artificial intelligence (AI) and machine learning (ML) tools has received significant attention in recent years. These tools, in principle, can enable the unification of data collection and analysis into a single pipeline to make sampling and analysis decisions on the go. There are various ML approaches that have been applied to IMS data over the last decade. Here, in this review, we discuss recent examples of the common unsupervised (principal component analysis, non-negative matrix factorization, k-means clustering, uniform manifold approximation and projection), supervised (random forest, logistic regression, XGboost, support vector machine), and other methods applied to various IMS datasets in the past five years. The information from this review will be useful for specialists from both IMS and ML fields since it summarizes current and representative studies of computational ML-based exploratory methods for IMS.

47 OTHER INSTRUMENTATION↗

Correlated mechanochemical maps of Arabidopsis thaliana primary cell walls using atomic force microscope infrared spectroscopy

Spatial heterogeneity in composition and organisation of the primary cell wall affects the mechanics of cellular morphogenesis. However, directly correlating cell wall composition, organisation and mechanics has been challenging. To overcome this barrier, we applied atomic force microscopy coupled with infrared (AFM-IR) spectroscopy to generate spatially correlated maps of chemical and mechanical properties for paraformaldehyde-fixed, intact Arabidopsis thaliana epidermal cell walls. AFM-IR spectra were deconvoluted by non-negative matrix factorisation (NMF) into a linear combination of IR spectral factors representing sets of chemical groups comprising different cell wall components. This approach enables quantification of chemical composition from IR spectral signatures and visualisation of chemical heterogeneity at nanometer resolution. Cross-correlation analysis of the spatial distribution of NMFs and mechanical properties suggests that the carbohydrate composition of cell wall junctions correlates with increased local stiffness. Together, our work establishes new methodology to use AFM-IR for the mechanochemical analysis of intact plant primary cell walls.

59 BASIC BIOLOGICAL SCIENCES↗

Pan-sharpening for microscopy

Techniques for generating full-spatial resolution, full spectral resolution image(s) from a 3D spectral-data cube for any spectral value within a given spectral range are provided without requiring the acquisition of all full-spatial resolution, full spectral resolution data by an instrument. The 3D spectral-data cube is generated from a limited number of full-spatial resolution, sparse spectral resolution data and a sparse-spatial resolution, full-spectral resolution data of the same area of the sample. The use of the 3D spectral-data cube reduces the data acquisition time.

Ovchinnikova, Olga S.↗

Microstructural Evaluation of Phase Instability in Large Bandgap Metal Halide Perovskites

The optoelectronic performance of organic–inorganic halide perovskite (OIHP)-based devices has been improved in recent years. Particularly, solar cells fabricated using mixed-cations and mixed-halides have outperformed their single-cation and single-halide counterparts. Yet, a systematic evaluation of the microstructural behavior of mixed perovskites is missing despite their known composition-dependent photoinstability. Here, we explore microstructural inhomogeneity in (FAPbI 3 ) x (MAPbBr 3 ) 1– x using advanced scanning probe microscopy techniques. In this work, contact potential difference (CPD) maps measured by Kelvin probe force microscopy show an increased fraction of grains exhibiting a low CPD with flat topography as MAPbBr 3 concentration is increased. The higher portion of low CPD contributes to asymmetric CPD distribution curves. Chemical analysis reveals these grains being rich in MA, Pb, and I. The composition-dependent phase segregation upon illumination, reflected on the emergence of a low-energy peak emission in the original photoluminescence spectra, arises from the formation of such grains with flat topology. Bias-dependent piezo-response force microscopy measurements, in these grains, further confirm vigorous ion migration and cause a hysteretic piezo-response. Our results, therefore, provide insights into the microstructural evaluation of phase segregation and ion migration in OIHPs pointing toward process optimization as a mean to further enhance their optoelectronic performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Helium Ion Microscopy with Secondary Ion Mass Spectrometry for Nanoscale Chemical Imaging and Analysis of Polyolefins

To date, chemical imaging of polymers and polymer blends has been primarily accomplished using time-of-flight secondary ion mass spectrometry (ToF-SIMS) to directly visualize the distribution of components in a complex material with spatial resolution ranging from 100 nm to 5 μm. However, in many cases, this resolution falls far short of visualizing interfaces directly. To overcome these limitations, recent work has focused on developing a SIMS detection system based on a helium ion microscope (HIM) enabling chemical imaging with a demonstrated ~14 nm spatial resolution. Here, we utilize HIM-SIMS for differentiation between the olefin-based polymers of polyethylene (PE) and polypropylene (PP). We illustrate both analyses for separating PE and PP using specific mass fragment ratios as well as demonstrate spatially resolved imaging of phase-separated domains within PE. Altogether, we demonstrate the abilities of HIM-SIMS as a multimodal chemical technique for imaging and quantification of polyolefin interfaces, which could be more broadly applied to the analysis of more complex polymeric systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Role of Decomposition Product Ions in Hysteretic Behavior of Metal Halide Perovskite

Ion migration is one of the most debated mechanisms and credited with multiple observed phenomena and performance in metal halide perovskites (MHPs) semiconductor devices. However, to date, the migration of ions and their effects on MHPs are not still fully understood, largely due to a lack of direct observations of temporal ion migration. In this work, using direct observation of ion migration in-operando, we observe the hysteretic migration behavior of intrinsic ions (i.e., CH 3 NH 3 + and I – ) as well as reveal the migration behavior of CH 3 NH 3 + decomposition ions. We find that CH 3 NH 3 + decomposition products can be affected by light and accumulate at the interfaces under bias. These MHP decomposition products are tightly related to the device performance and stability. Complementary results of time-resolved Kelvin probe force microscopy (tr-KPFM) demonstrate a correlation between dynamics of these interfacial ions and charge carriers. Overall, we find that there are a number of mobile ions including CH 3 NH 3 + decomposition products in MHPs that need to be taken into account when measuring MHP device responses (e.g., charge dynamics) and should be considered in future optimization studies of MHP semiconductor devices.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enhancing hyperspectral EELS analysis of complex plasmonic nanostructures with pan-sharpening

Nanoscale hyperspectral techniques—such as electron energy loss spectroscopy (EELS)—are critical to understand the optical response in plasmonic nanostructures, but as systems become increasingly complex, the required sampling density and acquisition times become prohibitive for instrumental and specimen stability. As a result, there has been a recent push for new experimental methodologies that can provide comprehensive information about a complex system, while significantly reducing the duration of the experiment. In this work, we present a pan-sharpening approach to hyperspectral EELS analysis, where we acquire two datasets from the same region (one with high spatial resolution and one with high spectral fidelity) and combine them to achieve a single dataset with the beneficial properties of both. This work outlines a straightforward, reproducible pathway to reduced experiment times and higher signal-to-noise ratios, while retaining the relevant physical parameters of the plasmonic response, and is generally applicable to a wide range of spectroscopy modalities.

36 MATERIALS SCIENCE↗

Direct Observation of Photoinduced Ion Migration in Lead Halide Perovskites

Unique optoelectronic, electronic, and sensing properties of hybrid organic–inorganic perovskites (HOIPs) are underpinned by the complex interactions between electronic and ionic states. In this study, the photoinduced field ion migration in HOIPs is directly observed. Using newly developed local probe time-resolved techniques, more significant CH 3 NH 3 + migration than I – /Br – migration in HOIPs is unveiled. It is found that light illumination only induces CH 3 NH 3 + migration but not I – /Br – migration. By directly observing temporal changes in bias-induced and photoinduced ion migration in device conditions, it is revealed that light illumination suppresses the bias-induced ion redistribution in the lateral device. These findings, being a necessary compensation of previous understandings of ion migration in HOIPs based on simulations and static and/or indirect measurements, offer advanced insights into the distinct light effects on the migration of organic cation and halides in HOIPs, which are expected to be helpful for improving the performance and the long-term stability of HOIPs optoelectronics.

36 MATERIALS SCIENCE↗

Structural and antibacterial properties of NSAID-loaded ultra-high molecular weight polyethylene

Peri-articular delivery of pain medication in joint arthroplasty has the potential to address post-operative pain and decrease the use of systemic opioids. Additionally, the sustained release from a delivery vehicle may be especially impactful in the initial post-operative period when pain is most severe. We recently described a novel approach for the sustained intra-articular delivery of an analgesic (bupivacaine) from an ultra-high molecular weight polyethylene (UHMWPE) bearing surface. A secondary but very significant effect of incorporating bupivacaine in UHMWPE was its antibacterial effect against Staphylococcal species, which are associated with the majority of periprosthetic joint infections. Here, we report on the structure, properties, elution characteristics and antibacterial properties of UHMWPE loaded with the non-steroidal anti-inflammatory drug (NSAID) — tolfenamic acid. We showed that 6 wt% drug loading was optimal for eluting clinically relevant intra-articular and systemic concentrations, for maintaining mechanical properties at a clinically relevant level, and for providing anti-colonization potential against low risk (planktonic) and high risk (biofilm forming) Staphylococcal species. We determined the osteoblast response to the tolfenamic acid-loaded UHMWPE to evaluate the cytotoxicity profile of this novel material. Tolfenamic acid-loaded UHMWPE has the potential to be used as a part of multimodal pain management therapy following arthroplasty and may provide prophylaxis for periprosthetic infection.

36 MATERIALS SCIENCE↗

Toward nanoscale molecular mass spectrometry imaging via physically constrained machine learning on co-registered multimodal data

Mass spectrometry imaging (MSI) plays a pivotal role in investigating the chemical nature of complex systems that underly our understanding in biology and medicine. Multiple fields of life science such as proteomics, lipidomics and metabolomics benefit from the ability to simultaneously identify molecules and pinpoint their distribution across a sample. However, achieving the necessary submicron spatial resolution to distinguish chemical differences between individual cells and generating intact molecular spectra is still a challenge with any single imaging approach. Here, we developed an approach that combines two MSI techniques, matrix-assisted laser desorption/ionization (MALDI) and time-of-flight secondary ion mass spectrometry (ToF-SIMS), one with low spatial resolution but intact molecular spectra and the other with nanometer spatial resolution but fragmented molecular signatures, to predict molecular MSI spectra with submicron spatial resolution. The known relationships between the two MSI channels of information are enforced via a physically constrained machine-learning approach and directly incorporated in the data processing. We demonstrate the robustness of this method by generating intact molecular MALDI-type spectra and chemical maps at ToF-SIMS resolution when imaging mouse brain thin tissue sections. This approach can be readily adopted for other types of bioimaging where physical relationships between methods have to be considered to boost the confidence in the reconstruction product.

97 MATHEMATICS AND COMPUTING↗

In situ multimodal imaging for nanoscale visualization of tribofilm formation

A third of the energy from fuel combustion in passenger car gasoline engines is lost due to friction. Carefully designed engine lubricants can recover some of these losses by reducing friction and wear by forming a nanometer-scale chemico-physico tribofilm between surfaces. Accordingly, attention has focused on developing oil formulations that form low-friction tribofilms. However, analyses of resultant tribofilms are typically conducted after tribo-tests with conventional characterization tools and do not offer insights into tribofilm formation and evolution, precluding information critical to tuning tribofilm properties. In this work, we developed a unique multimodal methodology based on Atomic Force Microscopy (AFM) with local probe heating for in situ tribological studies that activates friction modifiers and simultaneously captures the evolution of friction and surface roughness, with nanometer resolution. As a platform to demonstrate the ability of this methodology to visualize dynamics of tribofilm formation in situ, we apply it to molybdenum-based friction modifiers to distinguish key factors in their functionality and correlate nanoscale AFM and Friction Force Microscopy data to bench tribo-tests used in the industry. To decode the formation mechanisms observed in situ and underlying chemistry of tribofilms, we performed ab initio Molecular Dynamics (AIMD) simulations at comparable conditions. AIMD simulations confirmed both nanoscale and bench tribo-test results and showed deviations in molecular organization in tribofilms that are formed from different molybdenum-based friction modifiers that corroborates with surface functionality. With this innovative methodology, we demonstrate proof-of-principle in situ formation of molybdenum-based tribofilms directly on steel surfaces that could be applied generally to studying tribofilm formation.

36 MATERIALS SCIENCE↗

Machine learning-based multidomain processing for texture-based image segmentation and analysis

Atomic and molecular resolved atomic force microscopy (AFM) images offer unique insights into materials' properties such as local ordering, molecular orientation, and topological defects, which can be used to pinpoint physical and chemical interactions occurring at the surface. Utilizing machine learning for extracting underlying physical parameters increases the throughput of AFM data processing and eliminates inconsistencies intrinsic to manual image analysis, thus enabling the creation of reliable frameworks for qualitative and quantitative evaluation of experimental data. Here, we present a robust and scalable approach to the segmentation of AFM images based on flexible pre-selected classification criteria. The usage of supervised learning and feature extraction allows us to retain the consideration of specific problem-dependent features (such as types of periodical structures observed in the images and the associated numerical parameters: spacing, orientation, etc.). We highlight the applicability of this approach for the segmentation of molecular resolved AFM images based on the crystal orientation of the observed domains, automated selection of boundaries, and collection of relevant statistics. Finally, we outline a general strategy for machine learning-enabled analysis of nanoscale systems exhibiting periodic order that could be applied to any analytical imaging technique

36 MATERIALS SCIENCE↗

Light-Ferroic Interaction in Hybrid Organic–Inorganic Perovskites

Given the remarkable performance of hybrid organic–inorganic perovskites (HOIPs) in solar cells, light emitters, and photodetectors, the quest to advance the fundamental understanding of the photophysical properties in this class of materials remains highly relevant. Recently, the discovery of ferroic twin domains in HOIPs has renewed the debate of the ferroic effects on optoelectric processes. This work explores the interaction between light and ferroic twin domains in CH 3 NH 3 PbI 3 . Due to strain and chemical inhomogeneities, photogenerated electrons and holes show a preferential motion in the ferroelastic twin domains. Density functional theory (DFT) shows that electrons and holes result in lattice expansion in CH 3 NH 3 PbI 3 differently. Hence, light generates strain in the ferroelastic domains due to preferential photocarrier motion, leading to a screening of strain variation. X-ray diffraction studies verify the DFT simulations and reveal that the photoinduced strain is light intensity dependent, and the photoexcitation is a prerequisite of inducing strain by light. This work extends the fundamental understanding of light-ferroic interaction and offers guidance for developing functional devices.

36 MATERIALS SCIENCE↗

Deep data analytics for genetic engineering of diatoms linking genotype to phenotype via machine learning

Abstract Genome engineering for materials synthesis is a promising avenue for manufacturing materials with unique properties under ambient conditions. Biomineralization in diatoms, unicellular algae that use silica to construct micron-scale cell walls with nanoscale features, is an attractive candidate for functional synthesis of materials for applications including photonics, sensing, filtration, and drug delivery. Therefore, controllably modifying diatom structure through targeted genetic modifications for these applications is a very promising field. In this work, we used gene knockdown in Thalassiosira pseudonana diatoms to create modified strains with changes to structural morphology and linked genotype to phenotype using supervised machine learning. An artificial neural network (NN) was developed to distinguish wild and modified diatoms based on the SEM images of frustules exhibiting phenotypic changes caused by a specific protein (Thaps3_21880), resulting in 94% detection accuracy. Class activation maps visualized physical changes that allowed the NNs to separate diatom strains, subsequently establishing a specific gene that controls pores. A further NN was created to batch process image data, automatically recognize pores, and extract pore-related parameters. Class interrelationship of the extracted paraments was visualized using a multivariate data visualization tool, called CrossVis, and allowed to directly link changes in morphological diatom phenotype of pore size and distribution with changes in the genotype.

59 BASIC BIOLOGICAL SCIENCES↗

Application of pan-sharpening algorithm for correlative multimodal imaging using AFM-IR

The coupling of atomic force microscopy with infrared spectroscopy (AFM-IR) offers the unique capability to characterize the local chemical and physical makeup of a broad variety of materials with nanoscale resolution. However, in order to fully utilize the measurement capability of AFM-IR, a three-dimensional dataset (2D map with a spectroscopic dimension) needs to be acquired, which is prohibitively time-consuming at the same spatial resolution of a regular AFM scan. In this paper, we provide a new approach to process spectral AFM-IR data based on a multicomponent pan-sharpening algorithm. This approach requires only a low spatial resolution spectral and a limited number of high spatial resolution single wavenumber chemical maps to generate a high spatial resolution hyperspectral image, greatly reducing data acquisition time. As a result, we are able to generate high-resolution maps of component distribution, produce chemical maps at any wavenumber available in the spectral range, and perform correlative analysis of the physical and chemical properties of the samples. We highlight our approach via imaging of plant cell walls as a model system and showcase the interplay between mechanical stiffness of the sample and its chemical composition. We believe our pan-sharpening approach can be more generally applied to different material classes to enable deeper understanding of that structure-property relationship at the nanoscale.

36 MATERIALS SCIENCE↗