Search NASA⌕ Search

Engineering topics

Foster, Ian T. (ORCID:0000000321295269)

Publications and source records attributed to Foster, Ian T. (ORCID:0000000321295269).

4 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Deep learning at the edge enables real-time streaming ptychographic imaging

Abstract Coherent imaging techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent imaging methods like ptychography are poised to revolutionize nanoscale materials characterization. However, these advancements are accompanied by significant increase in data and compute needs, which precludes real-time imaging, feedback and decision-making capabilities with conventional approaches. Here, we demonstrate a workflow that leverages artificial intelligence at the edge and high-performance computing to enable real-time inversion on X-ray ptychography data streamed directly from a detector at up to 2 kHz. The proposed AI-enabled workflow eliminates the oversampling constraints, allowing low-dose imaging using orders of magnitude less data than required by traditional methods.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Robotic pendant drop: containerless liquid for μs-resolved, AI-executable XPCS

Abstract The dynamics and structure of mixed phases in a complex fluid can significantly impact its material properties, such as viscoelasticity. Small-angle X-ray Photon Correlation Spectroscopy (SA-XPCS) can probe the spontaneous spatial fluctuations of the mixed phases under various in situ environments over wide spatiotemporal ranges (10 −6 –10 3 s /10 −10 –10 −6 m). Tailored material design, however, requires searching through a massive number of sample compositions and experimental parameters, which is beyond the bandwidth of the current coherent X-ray beamline. Using 3.7-μs-resolved XPCS synchronized with the clock frequency at the Advanced Photon Source, we demonstrated the consistency between the Brownian dynamics of ~100 nm diameter colloidal silica nanoparticles measured from an enclosed pendant drop and a sealed capillary. The electronic pipette can also be mounted on a robotic arm to access different stock solutions and create complex fluids with highly-repeatable and precisely controlled composition profiles. This closed-loop, AI-executable protocol is applicable to light scattering techniques regardless of the light wavelength and optical coherence, and is a first step towards high-throughput, autonomous material discovery.

36 MATERIALS SCIENCE↗
DOE OSTI2022

AICCA: AI-Driven Cloud Classification Atlas

Clouds play an important role in the Earth’s energy budget, and their behavior is one of the largest uncertainties in future climate projections. Satellite observations should help in understanding cloud responses, but decades and petabytes of multispectral cloud imagery have to date received only limited use. This study describes a new analysis approach that reduces the dimensionality of satellite cloud observations by grouping them via a novel automated, unsupervised cloud classification technique based on a convolutional autoencoder, an artificial intelligence (AI) method good at identifying patterns in spatial data. Our technique combines a rotation-invariant autoencoder and hierarchical agglomerative clustering to generate cloud clusters that capture meaningful distinctions among cloud textures, using only raw multispectral imagery as input. Cloud classes are therefore defined based on spectral properties and spatial textures without reliance on location, time/season, derived physical properties, or pre-designated class definitions. We use this approach to generate a unique new cloud dataset, the AI-driven cloud classification atlas (AICCA), which clusters 22 years of ocean images from the Moderate Resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua and Terra instruments—198 million patches, each roughly 100 km × 100 km (128 × 128 pixels)—into 42 AI-generated cloud classes, a number determined via a newly-developed stability protocol that we use to maximize richness of information while ensuring stable groupings of patches. AICCA thereby translates 801 TB of satellite images into 54.2 GB of class labels and cloud top and optical properties, a reduction by a factor of 15,000. The 42 AICCA classes produce meaningful spatio-temporal and physical distinctions and capture a greater variety of cloud types than do the nine International Satellite Cloud Climatology Project (ISCCP) categories—for example, multiple textures in the stratocumulus decks along the West coasts of North and South America. We conclude that our methodology has explanatory power, capturing regionally unique cloud classes and providing rich but tractable information for global analysis. AICCA delivers the information from multi-spectral images in a compact form, enables data-driven diagnosis of patterns of cloud organization, provides insight into cloud evolution on timescales of hours to decades, and helps democratize climate research by facilitating access to core data.

97 MATHEMATICS AND COMPUTING↗