Search NASA⌕ Search

SEARCH · Search NASA

Results for “optical neural network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

Space Vehicle Pose Estimation via Optical Correlation and Nonlinear Estimation

A technique for 6-degree-of-freedom (6DOF) pose estimation of space vehicles is being developed. This technique draws upon recent developments in implementing optical correlation measurements in a nonlinear estimator, which relates the optical correlation measurements to the pose states (orientation and position). For the optical correlator, the use of both conjugate filters and binary, phase-only filters in the design of synthetic discriminant function (SDF) filters is explored. A static neural network is trained a priori and used as the nonlinear estimator. New commercial animation and image rendering software is exploited to design the SDF filters and to generate a large filter set with which to train the neural network. The technique is applied to pose estimation for rendezvous and docking of free-flying spacecraft and to terrestrial surface mobility systems for NASA's Vision for Space Exploration. Quantitative pose estimation performance will be reported. Advantages and disadvantages of the implementation of this technique are discussed.

Rakoczy, John M.↗
DOE OSTI2021

Predictability of Localized Plasmonic Responses in Nanoparticle Assemblies

Design of nanoscale structures with desired optical properties is a key task for nanophotonics. In this work, the correlative relationship between local nanoparticle geometries and their plasmonic responses is established using encoder-decoder neural networks. In the im2spec network, the relationship between local particle geometries and local spectra is established via encoding the observed geometries to a small number of latent variables and subsequently decoding into plasmonic spectra; in the spec2im network, the relationship is reversed. Surprisingly, these reduced descriptions allow high-veracity predictions of local responses based on geometries for fixed compositions and surface chemical states. Analysis of the latent space distributions and the corresponding decoded and closest (in latent space) encoded images yields insight into the generative mechanisms of plasmonic interactions in the nanoparticle arrays. Ultimately, this approach creates a path toward determining configurations that yield the spectrum closest to the desired one, paving the way for stochastic design of nanoplasmonic structures.

nanoparticle arrays↗
DOE OSTI2022

Use of machine learning for a helium line intensity ratio method in Magnum-PSI

Optical emission spectroscopy (OES) of helium (He) line intensities has been used to measure the electron density, ne, and temperature, Te, in various plasma devices. In this study, a neural network with five hidden layers is introduced to model the relation between the OES data and ne/Te from laser Thomson scattering in the linear plasma device Magnum-PSI and compared to multiple regression analysis. It is shown that the neural network reduces the residual errors of prediction values (ne and Te) less than half those of the multiple regression analysis. We checked two different data splitting methods for training and validation data, i.e., with and without considering the unit of discharge. A comparison of the splitting methods suggests that the residual error will decrease to ~10% even for a new discharge data when accumulating a sufficient data set.

Kajita, Shin↗
NASA NTRSDate not supplied

Implementation of Machine Learning Methods for Crater-Based Navigation

Terrain Relative Navigation methods require surface feature detectors to gain information from images used to improve on-board state estimates. This paper presents the development of a crater detection method based on Machine Learning that can extract data from optical images with different crater shapes and sizes, under varying lighting conditions. This work includes an automated capability for generating labeled training data and iterative testing of the neural network-based crater detector. Preliminary results are included to quantify the detector’s accuracy compared to a known crater catalog, given a set of real lunar images from the Lunar Reconnaissance Orbiter.

Sofia G Catalan↗
NASA NTRS1993

Using neural networks to assist in OPAD data analysis

The space shuttle main engine (SSME) became the subject of plume emission spectroscopy in 1986 when researchers from NASA-Marshall Space Flight Center (MSFC), Arnold Engineering Development Center (AEDC), and Rocketdyne went to the SSME test stands at the NASA-Stennis Space Center and at Rocketdyne's Santa Susan Field Laboratory to optically observe the plume. Since then, plume spectral acquisitions have recorded many nominal tests and the qualitative spectral features of the SSME plume are now well established. Significant discoveries made with both wide-band and narrow-band plume emission spectroscopy systems led MSFC to promote the Optical Plume Anomaly Detection (OPAD) program with a goal of instrumenting all SSME test stands with customized spectrometer systems. A prototype OPAD system is now installed on the SSME Technology Test Bed (TTB) at MSFC. The OPAD system instrumentation consists of a broad-band, optical multiple-channel analyzer (OMA) and a narrow-band device called a polychrometer. The OMA is a high-resolution (1.5-2.0 Angstroms) 'super-spectrometer' covering the near-ultraviolet to near-infrared waveband (2800-7400 Angstroms), providing two scans per second. The polychrometer consists of sixteen narrow-band radiometers: fourteen monitoring discrete wavelengths of health and condition monitoring elements and two dedicated to monitoring background emissions. All sixteen channels are capable of providing 500 samples per second. To date, the prototype OPAD system has been used during 43 SSME firings on the TTB, collecting well over 250 megabytes of plume spectral data. One goal of OPAD data analysis is to determine interatively with the help of a computer code, SPECTRA4, developed at AEDC. Experience has shown that iteration with SPECTRA4 is an incredibly labor intensive task and not one to be performed by band. What is really needed is the 'inverse' of SPECTRA4 but the mathematical model for this inverse mapping is tenuous at best. However, the robustness of PSECTRA4 run in the 'forward' direction means that accurate input/output mappings can be obtained. If the mappings were inverted (i.e., input becomes output and output becomes input) then an 'inverse' of SPECTRA4 would be at hand but the 'model' would be specific to the data utilized and would in no way be general. Building a generalized model based upon known input/output mappings while ignoring the details of the governing physical model is possible through the use of a neural network. The research investigation described involves the development of a neural network to provide a generalized 'inverse' of SPECTRA4. The objectives of the research were to design an appropriate neural network architecture, train the network, and then evaluate its performance.

Whitaker, Kevin W.↗
DOE OSTI2021

Peculiar velocity estimation from kinetic SZ effect using deep neural networks

ABSTRACT The Sunyaev–Zel’dolvich (SZ) effect is expected to be instrumental in measuring velocities of distant clusters in near future telescope surveys. We simplify the calculation of peculiar velocities of galaxy clusters using deep learning frameworks trained on numerical simulations to avoid the independent estimation of the optical depth. Images of distorted photon backgrounds are generated for idealized observations using one of the largest cosmological hydrodynamical simulations, the Magneticum simulations. The model is tested to determine its ability of estimating peculiar velocities from future kinetic SZ observations under different noise conditions. The deep learning algorithm displays robustness in estimating peculiar velocities from kinetic SZ effect by an improvement in accuracy of about 17 per cent compared to the analytical approach.

Wang, Yuyu (ORCID:0000000202458547)↗
DOE OSTI2021

Validity of Machine Learning in the Quantitative Analysis of Complex Scanning Near-Field Optical Microscopy Signals Using Simulated Data

Scattering-type scanning near-field optical microscope (s-SNOM) is a modern technique for subdiffractional optical imaging and spectroscopy. Over the past two decades, tremendous efforts have been devoted to modeling complex tip-sample interactions in s-SNOM, aimed at understanding the electrodynamics of materials at the nanoscale. However, due to complexities in analytical methods and the limited computation power for fully numerical simulations, compromises must be made to facilitate the modeling of tip-sample interaction, such as using quasistatic approximation or unrealistic tip geometries. Here, we apply a variety of widely utilized machine-learning methods, including k nearest neighbor and feedforward neural network etc. to study the phase-resolved spectroscopic near-field response. With only a small set of training data, which is simulated using the finite-dipole model, we demonstrate that the relation between the experimental near-field signal and sample optical constant can be one to one mapped without the need for tip modeling: for a given material with a moderate dielectric function, its complex near-field spectrum can be accurately determined within the mid-IR spectral range, and vice versa. Our preliminary study sets the stage for future exploration using real experimental data. Our method is beneficial for processing the increasing amount of data accumulated across many research groups and especially useful for user facilities such as synchrotron-based national laboratories where a large amount of data is generated on a daily basis.

36 MATERIALS SCIENCE↗
DOE OSTI2026

DESI Strong Lens Foundry. III. Keck Spectroscopy for Strong Lenses Discovered Using Residual Neural Networks

We present spectroscopic data of strong lenses and their source galaxies using the Keck Near-Infrared Echellette Spectrometer (NIRES) and the Dark Energy Spectroscopic Instrument (DESI), providing redshifts necessary for nearly all strong-lensing applications with these systems, especially the extraction of physical parameters from lensing modeling. These strong lenses were found in the DESI Legacy Imaging Surveys using residual neural networks and followed up by our Hubble Space Telescope program, with all systems displaying unambiguous lensed arcs. With NIRES, we target eight lensed sources at redshifts difficult to measure in the optical range and determine the source redshifts for six, between z s = 1.675 and 3.332. DESI observed one of the remaining source redshifts, as well as an additional source redshift within the six systems. The two systems with nondetections by NIRES were observed for a considerably shorter 600 s at high airmass. Combining NIRES infrared spectroscopy with optical spectroscopy from our DESI Strong Lensing Secondary Target Program, these results provide the complete lens and source redshifts for six systems, a resource for refining automated strong lens searches in future deep- and wide-field imaging surveys and addressing a range of questions in astrophysics and cosmology.

Agarwal, Shrihan [University of Chicago, IL (Unite↗
NASA NTRS1990

The optical implementation of inner product neural associative memory

A liquid-crystal TV spatial light modulator (LCTV SLM) input device and LCTV nonlinear thresholding element are presently used to accomplish an all-optical implementation of an inner-product neural associative memory. This architecture represents an alternative to the vector-matrix multiplication method of the Hopfield model, which is most often employed by neural network associative memory models. LCTV SLM experimental results are presented and discussed.

Liu, Hua-Kuang↗
DOE OSTI2022

Extending the SAGA Survey (xSAGA). I. Satellite Radial Profiles as a Function of Host-galaxy Properties

We present "Extending the Satellites Around Galactic Analogs Survey" (xSAGA), a method for identifying low-z galaxies on the basis of optical imaging and results on the spatial distributions of xSAGA satellites around host galaxies. Using spectroscopic redshift catalogs from the SAGA Survey as a training data set, we have optimized a convolutional neural network (CNN) to identify z < 0.03 galaxies from more-distant objects using image cutouts from the DESI Legacy Imaging Surveys. From the sample of >100,000 CNN-selected low-z galaxies, we identify >20,000 probable satellites located between 36–300 projected kpc from NASA-Sloan Atlas central galaxies in the stellar-mass range $9.5\lt \mathrm{log}({M}_{\star }/{M}_{\odot })\lt 11$. We characterize the incompleteness and contamination for CNN-selected samples and apply corrections in order to estimate the true number of satellites as a function of projected radial distance from their hosts. Satellite richness depends strongly on host stellar mass, such that more-massive host galaxies have more satellites, and on host morphology, such that elliptical hosts have more satellites than disky hosts with comparable stellar masses. We also find a strong inverse correlation between satellite richness and the magnitude gap between a host and its brightest satellite. The normalized satellite radial distribution between 36–300 kpc does not depend on host stellar mass, morphology, or magnitude gap. The satellite abundances and radial distributions we measure are in reasonable agreement with predictions from hydrodynamic simulations. Our results deliver unprecedented statistical power for studying satellite galaxy populations and highlight the promise of using machine-learning for extending galaxy samples of wide-area surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2005

Optical Tweezers and Optical Trapping Improved for Future Automated Micromanipulation and Characterization

Optical trap arrays are being developed at the NASA Glenn Research Center for holding, manipulating, and optically interrogating arrays of nanotube sensors. The trap arrays, for example, might be used to arrange arrays of chemical sensors for insertion onto a chip in liquid, air, and vacuum environments. Neural-network-controlled spatial light modulators (SLMs) are to generate and control the trap positions and trap profiles in three dimensions.

Wrbanek, Susan Y.↗
DOE OSTI2022

Automated bubble analysis of high-speed subcooled flow boiling images using U-net transfer learning and global optical flow

Capturing and analyzing the bubble dynamics is crucial to improving the understanding of boiling heat transfer mechanisms and predicting boiling heat transfer coefficient and boiling crisis. High speed video (HSV) imaging has been used for decades towards this end. Still, there is no universal approach to quantitatively analyze bubble dynamics from HSV images. In this study, we propose a data-driven post-processing approach to segment, track, and identify wall-attached vapor bubbles from HSV images of the boiling process in subcooled flow conditions. Firstly, we employ a transfer learning framework with a U-Net-based convolution neural network (CNN) architecture to detect and segment bubbles in HSV images of diverse contrast and surface texture using very little data (e.g., 10 images) for training. Then, we evaluate the trained CNN model with 100 ground-truth images, and the validation results show that the model accuracy and precision in detecting the optical footprint of bubbles are higher than 90%. Finally, we suggest a criterion to identify a condensing bubble based on the divergence of the bubble displacement, which is calculated from sequential segmented bubble images using a global optical flow code. Using this combination of machine learning and optical flow, we can identify nucleation sites and track the growth of bubbles nucleating at each site to quantify nucleation site density, nucleation frequency, and other fundamental boiling parameters. The proposed system is validated using results obtained on a special heater, which enables both infrared (IR) thermometry and HSV imaging on a metallic surface. We compare the fundamental boiling parameters obtained by the two different diagnostics. The results show good agreement. In conclusion, the difference between the measurements of nucleation site density, averaged nucleation frequency, and averaged growth time performed with the two techniques is always within ± 20% and mostly ± 10% of the values measured with IR thermometry.

42 ENGINEERING↗
NASA NTRS2014

In-Situ and Remote-Sensing Data Fusion Using Machine Learning Techniques to Infer Urban and Fire Related Pollution Plumes

Airmass type characterization is key in understanding the relative contribution of various emission sources to atmospheric composition and air quality and can be useful in bottom-up model validation and emission inventories. However, classification of pollution plumes from space is often not trivial. Sub-orbital campaigns, such as SEAC4RS (Studies of Emissions, Atmospheric Composition, Clouds and Climate Coupling by Regional Surveys) give us a unique opportunity to study atmospheric composition in detail, by using a vast suite of in-situ instruments for the detection of trace gases and aerosols. These measurements allow identification of spatial and temporal atmospheric composition changes due to various pollution plumes resulting from urban, biogenic and smoke emissions. Nevertheless, to transfer the knowledge gathered from such campaigns into a global spatial and temporal context, there is a need to develop workflow that can be applicable to measurements from space. In this work we rely on sub-orbital in-situ and total column remote sensing measurements of various pollution plumes taken aboard the NASA DC-8 during 2013 SEAC4RS campaign, linking them through a neural-network (NN) algorithm to allow inference of pollution plume types by input of columnar aerosol and trace-gas measurements. In particular, we use the 4STAR (Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research) airborne measurements of wavelength dependent aerosol optical depth (AOD), particle size proxies, O3, NO2 and water vapor to classify different pollution plumes. Our method relies on assigning a-priori ground-truth labeling to the various plumes, which include urban pollution, different fire types (i.e. forest and agriculture) and fire stage (i.e. fresh and aged) using cluster analysis of aerosol and trace-gases in-situ and auxiliary (e.g. trajectory) data and the training of a NN scheme to fit the best prediction parameters using 4STAR measurements as input. We explore our misclassification rates as related to our ground-truth labels, and with multi-layered pollution plume cases. The next step in our analysis is to optimize parameter selection for a scheme that can be applied to space-borne aerosol and trace-gas observation platforms such as OMI, and future geostationary satellites such as TEMPO and GEO-CAPE.

Neural-network↗
DOE OSTI2022

Development of advanced machine learning models for analysis of plutonium surrogate optical emission spectra

This work investigates and applies machine learning paradigms seldom seen in analytical spectroscopy for quantification of gallium in cerium matrices via processing of laser-plasma spectra. Ensemble regressions, support vector machine regressions, Gaussian kernel regressions, and artificial neural network techniques are trained and tested on cerium-gallium pellet spectra. A thorough hyperparameter optimization experiment is conducted initially to determine the best design features for each model. The optimized models are evaluated for sensitivity and precision using the limit of detection (LoD) and root mean-squared error of prediction (RMSEP) metrics, respectively. Gaussian kernel regression yields the superlative predictive model with an RMSEP of 0.33% and an LoD of 0.015% for quantification of Ga in a Ce matrix. This study concludes that these machine learning methods could yield robust prediction models for rapid quality control analysis of plutonium alloys.

Rao, Ashwin P. (ORCID:0000000319312568)↗
NASA NTRS2021

Large-Scale High-Resolution Coastal Mangrove Forests Mapping Across West Africa With Machine Learning Ensemble and Satellite Big Data

Coastal mangrove forests provide important ecosystem goods and services, including carbon sequestration, biodiversity conservation, and hazard mitigation. However, they are being destroyed at an alarming rate by human activities. To characterize mangrove forest changes, evaluate their impacts, and support relevant protection and restoration decision making, accurate and up-to-date mangrove extent mapping at large spatial scales is essential. Available large-scale mangrove extent data products use a single machine learning method commonly with 30 m Landsat imagery, and significant inconsistencies remain among these data products. With huge amounts of satellite data involved and the heterogeneity of land surface characteristics across large geographic areas, finding the most suitable method for large-scale high-resolution mangrove mapping is a challenge. The objective of this study is to evaluate the performance of a machine learning ensemble for mangrove forest mapping at 20 m spatial resolution across West Africa using Sentinel-2 (optical) and Sentinel-1 (radar) imagery. The machine learning ensemble integrates three commonly used machine learning methods in land cover and land use mapping, including Random Forest (RF), Gradient Boosting Machine (GBM), and Neural Network (NN). The cloud-based big geospatial data processing platform Google Earth Engine (GEE) was used for pre-processing Sentinel-2 and Sentinel-1 data. Extensive validation has demonstrated that the machine learning ensemble can generate mangrove extent maps at high accuracies for all study regions in West Africa (92%–99% Producer’s Accuracy, 98%–100% User’s Accuracy, 95%–99% Overall Accuracy). This is the first-time that mangrove extent has been mapped at a 20 m spatial resolution across West Africa. The machine learning ensemble has the potential to be applied to other regions of the world and is therefore capable of producing high-resolution mangrove extent maps at global scales periodically.

coastal environment↗
NASA NTRSDate not supplied

Unlocking the Mysteries of the Moon’s Shadowed Regions

The Moon poles host large quantities of water-ice deposits in the permanently shadowed regions (PSRs), which are vital for enabling sustainable human space exploration, making these regions high-priority targets for upcoming Artemis missions [1]. Unfortunately, today, the best available orbital lunar imagery [2, 3] lacks the meter-scale resolution and signal needed to understand the geomorphology and trafficability of PSRs, complicating the planning and execution of future missions seeking to explore PSRs. We have developed an image enhancement tool called HORUS (Hyper-effective nOise Removal Unet Software) [4, 5], designed to enhance LRO Narrow-Angle Camera (NAC) optical low-light imagery of permanently shadowed regions by effectively removing the CCD-related, photon, and other residual noises that corrupt the images. The tool is composed of two deep learning neural networks trained on environmental metadata and real and synthetic imagery, the latter generated by a physical noise model (LROC). We demonstrated that HORUS effectively produces low-noise, high-resolution images (~1.5m/px), achieving a 5 to 10x improvement over existing long-exposure images of PSRs. HORUS allows scientists and engineers to identify geomorphic features (e.g., craters and boulders) in shadowed regions as small as 3 meters across as well as to peek inside of small shadowed regions, for the first time. The tool was deployed and thoroughly validated for NASA's VIPER mission [6], where it was applied to 20 candidate target regions across the lunar South Pole. Additionally, we conducted different approaches to validate the resulting HORUS-processed images. With HORUS denoised images, VIPER scientists can increase their confidence on what surface features (previously unseen) exist in the shadowed regions, helping them plan rover traverses more safely and efficiently (e.g., Fig. 1) In this manuscript, we will describe how VIPER scientists are utilizing HORUS denoised images to extract new information from the terrain and increase their confidence in what surface features exist in the shadowed regions. In combination with other high-resolution images and digital elevation maps, HORUS images are helping the team analyze potential lading and science sites, as well as planning traverses more safely and efficiently (e.g., Fig. 1). Additionally, we will describe how HORUS tool unlocks a broad range of scientific and exploration applications to other Artemis and CPLS missions to the lunar poles, including (but not limited to) geomorphic analysis, change detection, surface hazard detection, and terrain relative navigation.

artificial intelligence↗
DOE OSTI2023

The Role of Mesoscale Cloud Morphology in the Shortwave Cloud Feedback

A supervised neural network algorithm is used to categorize near-global satellite retrievals into three mesoscale cellular convective (MCC) cloud morphology patterns. At constant cloud amount, morphology patterns differ in brightness associated with the amount of optically thin cloud features. Environmentally driven transitions from closed MCC to other morphology patterns, typically accompanied by more optically thin cloud features, are used as a framework to quantify the morphology contribution to the optical depth component of the shortwave cloud feedback. A marine heat wave is used as an out-of-sample test of closed MCC occurrence predictions. Morphology shifts in optical depth between 65°S and 65°N under projected environmental changes (i.e., from an abrupt quadrupling of CO 2 ) assuming constant cloud cover contributes between 0.04 and 0.07 W m -2 K -1 (aggregate of 0.06) to the global mean cloud feedback.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Investigating resource-efficient neutron/gamma classification ML models targeting eFPGAs

There has been considerable interest and resulting progress in implementing machine learning (ML) models in hardware over the last several years from the particle and nuclear physics communities. A big driver has been the release of the Python package, hls4ml, which has enabled porting models specified and trained using Python ML libraries to register transfer level (RTL) code. So far, the primary end targets have been commercial field-programmable gate arrays (FPGAs) or synthesized custom blocks on application specific integrated circuits (ASICs). However, recent developments in open-source embedded FPGA (eFPGA) frameworks now provide an alternate, more flexible pathway for implementing ML models in hardware. These customized eFPGA fabrics can be integrated as part of an overall chip design. In general, the decision between a fully custom, eFPGA, or commercial FPGA ML implementation will depend on the details of the end-use application. In this work, we explored the parameter space for eFPGA implementations of fully-connected neural network (fcNN) and boosted decision tree (BDT) models using the task of neutron/gamma classification with a specific focus on resource efficiency. We used data collected using an AmBe sealed source incident on Stilbene, which was optically coupled to an OnSemi J-series silicon photomultiplier (SiPM) to generate training and test data for this study. We investigated relevant input features and the effects of bit-resolution and sampling rate as well as trade-offs in hyperparameters for both ML architectures while tracking total resource usage. The performance metric used to track model performance was the calculated neutron efficiency at a gamma leakage of 10 -3 . The results of the study will be used to aid the specification of an eFPGA fabric, which will be integrated as part of a test chip.

47 OTHER INSTRUMENTATION↗