Search NASA⌕ Search

SEARCH · Search NASA

Results for “optical neural network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Ice-Over-Water Cloud Identification in an Artificial Neural Network Approach

An artificial neural network (ANN) algorithm, employing several Aqua MODIS channels, the retrieved cloud phase and total cloud visible optical depth, and temperature and humidity vertical profiles is trained to detect multilayer (ML) ice-over-water cloud systems identified by matched 2008 CloudSat and CALIPSO (CC) data. The trained MLANN was applied to 2009 MODIS data resulting in combined ML and single layer detection accuracies of 87% (89%) and 86% (89%) for snow-free (snow-covered) regions during the day and night, respectively. When corrected for the viewing-zenith-angle dependence of each parameter, the ML fraction detected is relatively invariant across the swath. Compared to the CC ML variability, the MLANN is robust seasonally and interannually, and produces similar distribution patterns over the globe, except in the polar regions. Additional research is needed to conclusively evaluate the VZA dependence and further improve the MLANN accuracy. This approach should greatly improve the monitoring of cloud vertical structure using operational passive sensors.

MODIS↗
DOE OSTI2024

Deep-learning based artificial intelligence tool for melt pools and defect segmentation

Accelerating fabrication of additively manufactured components with precise microstructures is important for quality and qualification of built parts, as well as for a fundamental understanding of process improvement. Accomplishing this requires fast and robust characterization of melt pool geometries and structural defects in images. This paper proposes a pragmatic approach based on implementation of deep learning models and self-consistent workflow that enable systematic segmentation of defects and melt pools in optical images. Deep learning is based on an image-to-image translation–conditional generative adversarial neural network architecture. An artificial intelligence (AI) tool based on this deep learning model enables fast and incrementally more accurate predictions of the prevalent geometric features, including melt pool boundaries and printing-induced structural defects. We present statistical analysis of geometric features that is enabled by the AI tool, showing strong spatial correlation of defects and the melt pool boundaries. The correlations of widths and heights of melt pools with dataset processing parameters show the highest sensitivity to thermal influences resulting from laser passes in adjacent and subsequent layer passes. The presented models and tools are demonstrated on the aluminum alloy and datasets produced with different sets of processing parameters. However, they have universal quality and could easily be adapted to different material compositions. The method can be easily generalized to microstructural characterizations other than optical microscopy.

additive manufacturing↗
DOE OSTI2022

Estimation, UQ, and Sensitivity Analysis for a New Diagnostic Setup [Slides]

This is for an early career talk I am giving at the Association for Women in Math’s Research Symposium. It provides a general overview of three projects: the first focuses on velocity measurements from optical laser diagnostics, the second focuses on probe alignment and location (metrology), and the third is my Site-Directed Research and Development (SDRD) which focuses on neural networks for image datasets. All three projects have strong uncertainty quantification components.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Efficient Signal Processing in BOTDA: Utilizing PCA and PCA-Based Neural Networks for Temperature Monitoring

This work presents a comparative analysis of the various signal processing techniques used in the Brillouin gain spectrum (BGS) peak estimation. Traditional fitting methods such as Lorentzian curve fitting (LCF) are slow and less effective in noisy data. PCA-based methods were tested on the experimental data: A Euclidian distance-based approach, and a probabilistic deep neural network (PDNN) based approach, both using 5 principal components to represent a single BGS. Both methods significantly reduce computational time with respect to LCF, whereas PDNN offers uncertainty insights along with the parameter value. Measuring a range of temperatures, analyzing accuracy, and speed, it can be concluded that PCA trained PDNN outperforms other methods, and appears to be helpful in scenario where large datasets are generated.

Brillouin optical time domain analysis↗
NASA NTRSDate not supplied

Ice-Over-Water Cloud Properties in an Artificial Neural Network Approach

Clouds are a crucial component of the atmospheric energy system, particularly the radiative balance within, above, and below the troposphere. The vertical distribution of cloud mass and phase determines layer heating rates, the loss of radiation to space, and the amount of radiative heating at the surface. Thus, it is important to know how clouds are distributed both vertically and horizontally at all times of day. Satellite remote sensing is the only approach available to monitor clouds day and night around the globe. In this paper several artificial neural network (ANN) algorithms, employing several Aqua MODIS infrared channels, profiles of relative humidity and temperature from GMAO numerical weather analyses, and the retrieved total cloud visible optical depth, are trained to detect multilayer ice-over-water cloud systems and to retrieve some of their properties as identified by a year of 2008 Aqua MODIS data matched with CloudSat and CALIPSO (CC) cloud profiles. The CC lidar and radar profiles provide the vertical structure that serves as output truth for the multilayer algorithm. The neural networks were trained using one year (2008) of cloud top height data from the CC dataset, with correlation around 0.94 (0.95) and MAE as low as 0.82 (0.81) km for nonpolar regions during the day (night). Applying the trained ANN to independent year 2009 MODIS data resulted in a combined ML and single layer hit rate of 86.4% (85.1%) for nonpolar regions during the day (night). Since the ANN is trained using near-nadir MODIS pixels, infrared radiance corrections were developed as a function of view zenith angle from MODIS and applied to off-nadir pixels when processing MODIS swath data. The multilayer amount derived with the ANN is relatively invariant with increasing view zenith angle compared to the multilayer amount without the corrections.

MODIS↗
NASA NTRS1998

Predicting Ecologically Important Vegetation Variables from Remotely Sensed Optical/Radar Data Using Neural Networks

A number of satellite sensor systems will collect large data sets of the Earth's surface during NASA's Earth Observing System (EOS) era. Efforts are being made to develop efficient algorithms that can incorporate a wide variety of spectral data and ancillary data in order to extract vegetation variables required for global and regional studies of ecosystem processes, biosphere-atmosphere interactions, and carbon dynamics. These variables are, for the most part, continuous (e.g. biomass, leaf area index, fraction of vegetation cover, vegetation height, vegetation age, spectral albedo, absorbed photosynthetic active radiation, photosynthetic efficiency, etc.) and estimates may be made using remotely sensed data (e.g. nadir and directional optical wavelengths, multifrequency radar backscatter) and any other readily available ancillary data (e.g., topography, sun angle, ground data, etc.). Using these types of data, neural networks can: 1) provide accurate initial models for extracting vegetation variables when an adequate amount of data is available; 2) provide a performance standard for evaluating existing physically-based models; 3) invert multivariate, physically based models; 4) in a variable selection process, identify those independent variables which best infer the vegetation variable(s) of interest; and 5) incorporate new data sources that would be difficult or impossible to use with conventional techniques. In addition, neural networks employ a more powerful and adaptive nonlinear equation form as compared to traditional linear, index transformations, and simple nonlinear analyses. These neural networks attributes are discussed in the context of the authors' investigations of extracting vegetation variables of ecological interest.

Kimes, Daniel S.↗
DOE OSTI2020

Applying Improved Optical Recognition with Machine Learning on Sorting Cu Impurities in Steel Scrap

Annually, 20–55 million tons of electronic waste (e-waste) is produced worldwide (5% of all municipal solid waste). Although e-waste embodies only 2% of America’s municipal waste, it accounts for a significantly larger proportion of the heavy metals and flame retardants present in the waste stream. Currently, less than 20% of all e-waste is recycled in the United States because the heterogeneity of the feedstock limits the opportunity for reuse in high value products and processing of the waste itself is often too costly to justify handling. To address this concern, the aims of this study are: 1) to identify the major plastic and metal compositions within electronic shredder residue (ESR), 2) to formulate solvents and processing conditions to separate 90% of the plastics targeted from consumer shred ESR, and 3) to develop a process design model to estimate the cost and energy efficiency of the proposed solvent-based processing. In this study, a pre-sorted heterogeneous ESR feedstock (one where aluminum, magnetic components, and hazardous battery materials removed by an e-waste recycling facility) was used, with the major compositions of the ESR characterized. It was found that 25 wt.% of the feedstock was composed of plastics, 6 wt.% rubber, 27 wt.% printed circuit boards, 23% wire, and the remainder metals and capacitors. Within the plastic portion, polystyrene (PS, 40 wt.%), acrylonitrile butadiene styrene (ABS, 25 wt.%), and styrene-acrylonitrile (SAN, 9wt.%) were identified to compose the majority of the screened plastics using Fourier transform infrared spectroscopy (FTIR). Next, selective solvents were screened using Hansen Solubility Parameter Theory (HSP) for dissolving PS and ABS. The pre-screening results show that methylene chloride (dichloromethane, DCM) and tetrahydrofuran (THF) are capable of dissolving the most PS and ABS, while methanol (MeOH) and ethylene glycol (EG) are capable of precipitating the most PS and ABS. These solvents were subsequently used to recover polymers and remove. flame retardants within the ESR feedstock. By optimizing the dissolution time and the solvents used, the highest polymer dissolution yield (99 wt.%%) was achieved using DCM for 48 hr. Both pre-screened anti-solvents (MeOH and EG) showed the highest polymer precipitation yield (71 wt.%). In terms of flame retardant removal rate, EG was found to have a high phosphorus-containing flame retardant removal rate (up to 98%). Characterization shows that the proposed solvent-based processing can preserve a high molecular weight fraction of the polymers and effectively remove flame retardants. Cost analysis indicates that the amount of the solvent/anti-solvent recovered after the reaction would play a critical role in reducing the operating costs. The energy analysis shows that the proposed solvent-based processes can save up to 60% of the embodied energy used to manufacture plastics used in electronics (PS and ABS were used for calculations). The results from this project prove the potential of solvent-based processing to produce secondary materials (plastics and metals) from e-waste for cross-industry reuse.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Machine learning control of an elliptically bent hard x-ray mirror

This article showcases the high-resolution control of an elliptically bent hard X-ray mirror optics at the Advanced Photon Source. The mirror uses a compact laminar flexure bending mechanism to achieve elliptical shapes covering a large range of focal distances. An array of capacitive sensors are used as a surface profiler for in-situ monitoring of the mirror shape. Machine learning and control techniques were used to change the mirror shape and focus the incident X-ray at predefined focal planes. The mirror surface shape error can be controlled to be within 40 nm rms with high repeatability. This technique gives the capability to focus incident X-ray beam within a range of focal distances corresponding to shape deformation range of a mirror optics. This work would be beneficial for controlling similar adaptive optics for multiple adaptive optics systems.

adaptive optics↗
DOE OSTI2020

Optimization and Prediction of Spectral Response of Metasurfaces Using Artificial Intelligence

Hot-electron generation has been a topic of intense research for decades for numerous applications ranging from photodetection and photochemistry to biosensing. Recently, the technique of hot-electron generation using non-radiative decay of surface plasmons excited by metallic nanoantennas, or meta-atoms, in a metasurface has attracted attention. These metasurfaces can be designed with thicknesses on the order of the hot-electron diffusion length. The plasmonic resonances of these ultrathin metasurfaces can be tailored by changing the shape and size of the meta-atoms. One of the fundamental mechanisms leading to generation of hot-electrons in such systems is optical absorption, therefore, optimization of absorption is a key step in enhancing the performance of any metasurface based hot-electron device. Here we utilized an artificial intelligence-based approach, the genetic algorithm, to optimize absorption spectra of plasmonic metasurfaces. Using genetic algorithm optimization strategies, we designed a polarization insensitive plasmonic metasurface with 90% absorption at 1550 nm that does not require an optically thick ground plane. We fabricated and optically characterized the metasurface and our experimental results agree with simulations. Finally, we present a convolutional neural network that can predict the absorption spectra of metasurfaces never seen by the network, thereby eliminating the need for computationally expensive simulations. Our results suggest a new direction for optimizing hot-electron based photodetectors and sensors.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2025

Using "AI Poincare" to analyze non-linear integrable optics

This study dives into the applicability of using automated discovery of conserved quantities in dynamical systems relevant to accelerator physics. Specifically, we explore the performance of AI Poincaré in analyzing numerical trajectory data obtained using the McMillan system of non-linear integrable optics. A comprehensive evaluation of the algorithm's performance is conducted through diverse methodologies. These include the analysis of the estimated number of conserved quantities embedded in a dataset and the deviation of interpolated points on the inferred manifold with respect to points in actually in the dataset. the investigation identifies an optimal range of perturbation distances where the underlying manifold extraction algorithm inside AI Poincaré exhibits optimal performance. Additionally, an improved neural network architecture is proposed based on the observed results. Finally, we apply the algorithm to preliminary experimental data from the Integrable Optics Test Accelerator at Fermilab to successfully infer the number of conserved quantities even in the presence of fast decoherence of the measured signal.

Osmanov, Lazare [Free U. Tbilisi]↗
DOE OSTI2024

Super Resolving Unrolled Neural Networks for Remote Sensing

In remote sensing systems, the capabilities of the system are constrained by the complex interactions between size, weight, and power (SWAP) of potential designs. In electro-optical (EO) systems, examples of these critical parameters include the system’s sensitivity and resolution. Those parameters can be increased by ever larger optical apertures and focal planes but at the cost of more SWAP. Multi-image super resolution (MISR) techniques allow resolution to be enhanced via computation rather than more sophisticated optical hardware. These algorithms combine multiple images together into a single, higher resolution image, trading temporal resolution and computation for spatial resolution. Fielded MISR techniques, such as Drizzle, can require several hundred images to create a single super resolved image, implying reduced temporal resolution, increased data acquisition load, and limiting mission applications. Iterative techniques, such as model-based image reconstruction and compressive sensing, have been shown to create super resolved images using fewer images than Drizzle. They do this by posing an optimization problem that balances accuracy between a highly accurate physical model and an image model. In the case of super resolution, the physical model is defined by the relation between low resolution input images and the desired high resolution output image. The image model encodes some assumptions about the super resolved image. These assumptions are meant to suppress reconstruction artifacts that arise due to deterministic physical model error, stochastic measurement noise, and potential undersampling. In practice, the performance of iterative methods are limited by imaging models compatible with optimization. Deep learning-based methods can effectively learn image models of arbitrary complexity, but lack the theoretical explainability and robustness of iterative techniques. Consensus equilibrium (CE) generalizes the iterative techniques beyond optimization, enabling blackbox algorithms such as traditional and neural image denoisers to be used as the image model. CE-based approaches retain much of the explainability and robustness of iterative techniques while allowing the expressiveness of machine learning image models to be used. Additionally, by unrolling iterations of CE with an embedded image denoiser, the image denoiser can be further trained and specialized to the specific application with potentially higher quality reconstructions. Under this project, we demonstrated the feasibility of training an unrolled neural network based upon CE. While we didn’t train one, we showed that the CE process is differentiable and its gradient can be tractably computed. We also explored the usage of a variants of CE akin to generative neural works. Most importantly, we applied the CE framework to a number of problems including non-blind deconvolution, upsampling, single-image super resolution, MISR, event-based sensing, and saturated deconvolution. Our MISR prototype creates high quality reconstructions with an order of magnitude fewer images than previous approaches and, critically, produces these reconstructions fast enough for practical usage.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Machine learning for deep elastic strain engineering of semiconductor electronic band structure and effective mass

Abstract The controlled introduction of elastic strains is an appealing strategy for modulating the physical properties of semiconductor materials. With the recent discovery of large elastic deformation in nanoscale specimens as diverse as silicon and diamond, employing this strategy to improve device performance necessitates first-principles computations of the fundamental electronic band structure and target figures-of-merit, through the design of an optimal straining pathway. Such simulations, however, call for approaches that combine deep learning algorithms and physics of deformation with band structure calculations to custom-design electronic and optical properties. Motivated by this challenge, we present here details of a machine learning framework involving convolutional neural networks to represent the topology and curvature of band structures in k -space. These calculations enable us to identify ways in which the physical properties can be altered through “deep” elastic strain engineering up to a large fraction of the ideal strain. Algorithms capable of active learning and informed by the underlying physics were presented here for predicting the bandgap and the band structure. By training a surrogate model with ab initio computational data, our method can identify the most efficient strain energy pathway to realize physical property changes. The power of this method is further demonstrated with results from the prediction of strain states that influence the effective electron mass. We illustrate the applications of the method with specific results for diamonds, although the general deep learning technique presented here is potentially useful for optimizing the physical properties of a wide variety of semiconductor materials.

Tsymbalov, Evgenii↗
DOE OSTI2023

MHD mode tracking using high-speed cameras and deep learning

Abstract We present a new algorithm to track the amplitude and phase of rotating magnetohydrodynamic (MHD) modes in tokamak plasmas using high speed imaging cameras and deep learning. This algorithm uses a convolutional neural network (CNN) to predict the amplitudes of the n = 1 sine and cosine mode components using solely optical measurements from one or more cameras. The model was trained and tested on an experimental dataset consisting of camera frame images and magnetic-based mode measurements from the High Beta Tokamak - Extended Pulse (HBT-EP) device, and it outperformed other, more conventional, algorithms using identical image inputs. The effect of different input data streams on the accuracy of the model’s predictions is also explored, including using a temporal frame stack or images from two cameras viewing different toroidal regions.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Software For Automated Leak Detection Using Infrared Camera

This code can read in videos or images in either a batch or real-time format. Videos are broken up into frames, and the frames are processed using an optical flow algorithm to decipher movement between adjacent frames. This adherent movement is ran through a convolutional neural network that automatically classifies the contents of the video. Additional content inside the code aids with noisy images and removal of nuisance movement.

Walker, CodyM. [Idaho National Laboratory (INL), I↗
NASA NTRS1997

VIGILANTE: An Advanced Sensing/Processing Testbed for ATR Applications

VIGILANTE consists of two major components:1. the Viewing Imager/Gimballed Instrumentation Laboratory (VIGIL)- advanced infrared, visible, and ultraviolet sensors with appropriate optics and camera electronics & 2. the Analog Neural Three-dimensional processing Experiment (ANTE)-a massively parallel, neural network-based, high-speed processor.

automatic↗
DOE OSTI2024

Emission line predictions for mock galaxy catalogues: a new differentiable and empirical mapping from DESI

ABSTRACT We present a simple, differentiable method for predicting emission line strengths from rest-frame optical continua using an empirically determined mapping. Extensive work has been done to develop mock galaxy catalogues that include robust predictions for galaxy photometry, but reliably predicting the strengths of emission lines has remained challenging. Our new mapping is a simple neural network implemented using the JAX Python automatic differentiation library. It is trained on Dark Energy Spectroscopic Instrument Early Release data to predict the equivalent widths (EWs) of the eight brightest optical emission lines (including H α, H β, [O ii], and [O iii]) from a galaxy’s rest-frame optical continuum. The predicted EW distributions are consistent with the observed ones when noise is accounted for, and we find Spearman’s rank correlation coefficient ρs > 0.87 between predictions and observations for most lines. Using a non-linear dimensionality reduction technique, we show that this is true for galaxies across the full range of observed spectral energy distributions. In addition, we find that adding measurement uncertainties to the predicted line strengths is essential for reproducing the distribution of observed line-ratios in the BPT diagram. Our trained network can easily be incorporated into a differentiable stellar population synthesis pipeline without hindering differentiability or scalability with GPUs. A synthetic catalogue generated with such a pipeline can be used to characterize and account for biases in the spectroscopic training sets used for training and calibration of photo-z’s, improving the modelling of systematic incompleteness for the Rubin Observatory LSST and other surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Optical Control of Adaptive Nanoscale Domain Networks

Adaptive networks can sense and adjust to dynamic environments to optimize their performance. Understanding their nanoscale responses to external stimuli is essential for applications in nanodevices and neuromorphic computing. However, it is challenging to image such responses on the nanoscale with crystallographic sensitivity. Here, the evolution of nanodomain networks in (PbTiO 3 ) n /(SrTiO 3 ) n superlattices (SLs) is directly visualized in real space as the system adapts to ultrafast repetitive optical excitations that emulate controlled neural inputs. The adaptive response allows the system to explore a wealth of metastable states that are previously inaccessible. Their reconfiguration and competition are quantitatively measured by scanning x-ray nanodiffraction as a function of the number of applied pulses, in which crystallographic characteristics are quantitatively assessed by assorted diffraction patterns using unsupervised machine-learning methods. The corresponding domain boundaries and their connectivity are drastically altered by light, holding promise for light-programable nanocircuits in analogy to neuroplasticity. Phase-field simulations elucidate that the reconfiguration of the domain networks is a result of the interplay between photocarriers and transient lattice temperature. The demonstrated optical control scheme and the uncovered nanoscopic insights open opportunities for the remote control of adaptive nanoscale domain networks.

36 MATERIALS SCIENCE↗