Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multispectral”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2013

Automated registration of multispectral MR vessel wall images of the carotid artery

Purpose: Atherosclerosis is the primary cause of heart disease and stroke. The detailed assessment of atherosclerosis of the carotid artery requires high resolution imaging of the vessel wall using multiple MR sequences with different contrast weightings. These images allow manual or automated classification of plaque components inside the vessel wall. Automated classification requires all sequences to be in alignment, which is hampered by patient motion. In clinical practice, correction of this motion is performed manually. Previous studies applied automated image registration to correct for motion using only nondeformable transformation models and did not perform a detailed quantitative validation. The purpose of this study is to develop an automated accurate 3D registration method, and to extensively validate this method on a large set of patient data. In addition, the authors quantified patient motion during scanning to investigate the need for correction. Methods: MR imaging studies (1.5T, dedicated carotid surface coil, Philips) from 55 TIA/stroke patients with ipsilateral <70% carotid artery stenosis were randomly selected from a larger cohort. Five MR pulse sequences were acquired around the carotid bifurcation, each containing nine transverse slices: T1-weighted turbo field echo, time of flight, T2-weighted turbo spin-echo, and pre- and postcontrast T1-weighted turbo spin-echo images (T1W TSE). The images were manually segmented by delineating the lumen contour in each vessel wall sequence and were manually aligned by applying throughplane and inplane translations to the images. To find the optimal automatic image registration method, different masks, choice of the fixed image, different types of the mutual information image similarity metric, and transformation models including 3D deformable transformation models, were evaluated. Evaluation of the automatic registration results was performed by comparing the lumen segmentations of the fixed image and moving image after registration. Results: The average required manual translation per image slice was 1.33 mm. Translations were larger as the patient was longer inside the scanner. Manual alignment took 187.5 s per patient resulting in a mean surface distance of 0.271 ± 0.127 mm. After minimal user interaction to generate the mask in the fixed image, the remaining sequences are automatically registered with a computation time of 52.0 s per patient. The optimal registration strategy used a circular mask with a diameter of 10 mm, a 3D B-spline transformation model with a control point spacing of 15 mm, mutual information as image similarity metric, and the precontrast T1W TSE as fixed image. A mean surface distance of 0.288 ± 0.128 mm was obtained with these settings, which is very close to the accuracy of the manual alignment procedure. The exact registration parameters and software were made publicly available. Conclusions: An automated registration method was developed and optimized, only needing two mouse clicks to mark the start and end point of the artery. Validation on a large group of patients showed that automated image registration has similar accuracy as the manual alignment procedure, substantially reducing the amount of user interactions needed, and is multiple times faster. In conclusion, the authors believe that the proposed automated method can replace the current manual procedure, thereby reducing the time to analyze the images.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2023

Snapshot multispectral imaging using a diffractive optical network

Abstract Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep learning to create a virtual spectral filter array at the output image field-of-view. This diffractive multispectral imager performs spatially-coherent imaging over a large spectrum, and at the same time, routes a pre-determined set of spectral channels onto an array of pixels at the output plane, converting a monochrome focal-plane array or image sensor into a multispectral imaging device without any spectral filters or image recovery algorithms. Furthermore, the spectral responsivity of this diffractive multispectral imager is not sensitive to input polarization states. Through numerical simulations, we present different diffractive network designs that achieve snapshot multispectral imaging with 4, 9 and 16 unique spectral bands within the visible spectrum, based on passive spatially-structured diffractive surfaces, with a compact design that axially spans ~72 λ m , where λ m is the mean wavelength of the spectral band of interest. Moreover, we experimentally demonstrate a diffractive multispectral imager based on a 3D-printed diffractive network that creates at its output image plane a spatially repeating virtual spectral filter array with 2 × 2 = 4 unique bands at terahertz spectrum. Due to their compact form factor and computation-free, power-efficient and polarization-insensitive forward operation, diffractive multispectral imagers can be transformative for various imaging and sensing applications and be used at different parts of the electromagnetic spectrum where high-density and wide-area multispectral pixel arrays are not widely available.

36 MATERIALS SCIENCE↗
DOE OSTI2014

Estimating atmospheric parameters and reducing noise for multispectral imaging

A method and system for estimating atmospheric radiance and transmittance. An atmospheric estimation system is divided into a first phase and a second phase. The first phase inputs an observed multispectral image and an initial estimate of the atmospheric radiance and transmittance for each spectral band and calculates the atmospheric radiance and transmittance for each spectral band, which can be used to generate a "corrected" multispectral image that is an estimate of the surface multispectral image. The second phase inputs the observed multispectral image and the surface multispectral image that was generated by the first phase and removes noise from the surface multispectral image by smoothing out change in average deviations of temperatures.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Multispectral Quantitative Phase Imaging Using a Diffractive Optical Network

As a label‐free imaging technique, quantitative phase imaging (QPI) provides optical path length information of transparent specimens for various applications in biology, materials science, and engineering. Multispectral QPI measures quantitative phase information across multiple spectral bands, permitting the examination of wavelength‐specific phase and dispersion characteristics of samples. Herein, the design of a diffractive processor is presented that can all‐optically perform multispectral quantitative phase imaging of transparent phase‐only objects within a snapshot. The design utilizes spatially engineered diffractive layers, optimized through deep learning, to encode the phase profile of the input object at a predetermined set of wavelengths into spatial intensity variations at the output plane, allowing multispectral QPI using a monochrome focal plane array. Through numerical simulations, diffractive multispectral processors are demonstrated to simultaneously perform quantitative phase imaging at 9 and 16 target spectral bands in the visible spectrum. The generalization of these diffractive processor designs is validated through numerical tests on unseen objects, including thin Pap smear images. Due to its all‐optical processing capability using passive dielectric diffractive materials, this diffractive multispectral QPI processor offers a compact and power‐efficient solution for high‐throughput quantitative phase microscopy and spectroscopy.

36 MATERIALS SCIENCE↗
DOE OSTI2016

Multispectral medical image fusion in Contourlet domain for computer based diagnosis of Alzheimer’s disease

Computer based diagnosis of Alzheimer’s disease can be performed by dint of the analysis of the functional and structural changes in the brain. Multispectral image fusion deliberates upon fusion of the complementary information while discarding the surplus information to achieve a solitary image which encloses both spatial and spectral details. This paper presents a Non-Sub-sampled Contourlet Transform (NSCT) based multispectral image fusion model for computer-aided diagnosis of Alzheimer’s disease. The proposed fusion methodology involves color transformation of the input multispectral image. The multispectral image in YIQ color space is decomposed using NSCT followed by dimensionality reduction using modified Principal Component Analysis algorithm on the low frequency coefficients. Further, the high frequency coefficients are enhanced using non-linear enhancement function. Two different fusion rules are then applied to the low-pass and high-pass sub-bands: Phase congruency is applied to low frequency coefficients and a combination of directive contrast and normalized Shannon entropy is applied to high frequency coefficients. The superiority of the fusion response is depicted by the comparisons made with the other state-of-the-art fusion approaches (in terms of various fusion metrics).

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2014

Land cover classification in multispectral imagery using clustering of sparse approximations over learned feature dictionaries

We present results from an ongoing effort to extend neuromimetic machine vision algorithms to multispectral data using adaptive signal processing combined with compressive sensing and machine learning techniques. Our goal is to develop a robust classification methodology that will allow for automated discretization of the landscape into distinct units based on attributes such as vegetation, surface hydrological properties, and topographic/geomorphic characteristics. We use a Hebbian learning rule to build spectral-textural dictionaries that are tailored for classification. We learn our dictionaries from millions of overlapping multispectral image patches and then use a pursuit search to generate classification features. Land cover labels are automatically generated using unsupervised clustering of sparse approximations (CoSA). We demonstrate our method on multispectral WorldView-2 data from a coastal plain ecosystem in Barrow, Alaska. We explore learning from both raw multispectral imagery and normalized band difference indices. We explore a quantitative metric to evaluate the spectral properties of the clusters in order to potentially aid in assigning land cover categories to the cluster labels. In this study, our results suggest CoSA is a promising approach to unsupervised land cover classification in high-resolution satellite imagery.

42 ENGINEERING↗
DOE OSTI2016

Gimbaled multispectral imaging system and method

A gimbaled multispectral imaging system and method is described herein. In an general embodiment, the gimbaled multispectral imaging system has a cross support that defines a first gimbal axis and a second gimbal axis, wherein the cross support is rotatable about the first gimbal axis. The gimbaled multispectral imaging system comprises a telescope that fixed to an upper end of the cross support, such that rotation of the cross support about the first gimbal axis causes the tilt of the telescope to alter. The gimbaled multispectral imaging system includes optics that facilitate on-gimbal detection of visible light and off-gimbal detection of infrared light.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗
DOE OSTI2020

Simulated JWST Data Sets for Multispectral and Hyperspectral Image Fusion

The James Webb Space Telescope (JWST) will provide multispectral and hyperspectral infrared images of a large number of astrophysical scenes. Multispectral images will have the highest angular resolution, while hyperspectral images (e.g., with integral field unit spectrometers) will provide the best spectral resolution. This paper aims at providing a comprehensive framework to generate an astrophysical scene and to simulate realistic hyperspectral and multispectral data acquired by two JWST instruments, namely, NIRCam Imager and NIRSpec IFU. We want to show that this simulation framework can be resorted to assess the benefits of fusing these images to recover an image of high spatial and spectral resolutions. To do so, we make a synthetic scene associated with a canonical infrared source, the Orion Bar. We develop forward models including corresponding noises for the two JWST instruments based on their physical features. JWST observations are then simulated by applying the forward models to the aforementioned synthetic scene. We test a dedicated fusion algorithm we developed on these simulated observations. We show that the fusion process reconstructs the high spatio-spectral resolution scene with a good accuracy on most areas, and we identify some limitations of the method to be tackled in future works. The synthetic scene and observations presented in the paper can be used, for instance, to evaluate instrument models, pipelines, or more sophisticated algorithms dedicated to JWST data analysis. Besides, fusion methods such as the one presented in this paper are shown to be promising tools to fully exploit the unprecedented capabilities of the JWST.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Robust Spectral Unmixing of Sparse Multispectral Lidar Waveforms using Gamma Markov Random Fields

Here, this paper presents a new Bayesian spectral un-mixing algorithm to analyse remote scenes sensed via sparse multispectral Lidar measurements. To a first approximation, in the presence of a target, each Lidar waveform consists of a main peak, whose position depends on the target distance and whose amplitude depends on the wavelength of the laser source considered (i.e, on the target reflectivity). Besides, these temporal responses are usually assumed to be corrupted by Poisson noise in the low photon count regime. When considering multiple wavelengths, it becomes possible to use spectral information in order to identify and quantify the main materials in the scene, in addition to estimation of the Lidar-based range profiles. Due to its anomaly detection capability, the proposed hierarchical Bayesian model, coupled with an efficient Markov chain Monte Carlo algorithm, allows robust estimation of depth images together with abundance and outlier maps associated with the observed 3D scene. The proposed methodology is illustrated via experiments conducted with real multispectral Lidar data acquired in a controlled environment. The results demonstrate the possibility to unmix spectral responses constructed from extremely sparse photon counts (less than 10 photons per pixel and band).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Optimal band selection for target detection with a LWIR multispectral imager

Multispectral imaging can offer many benefits in cost, complexity, resolution, size, weight, and power, relative to hyperspectral imaging. When designing a multispectral system, spectral bandpasses can be selected using optimization algorithms configured to maximally separate target detection scores between target and background regions. A hyperspectral image (HSI) can serve as the source of data from which band groupings can be tested for optimality. The output of an adaptive cosine estimator target detection algorithm is used in an objective function. Three optimization algorithms are compared: particle swarm, dual annealing, and differential evolution. A global optimum is also found using a brute force approach on the Livermore Computing Syrah supercomputer. Three materials are investigated: calcite, gypsum, and limestone. This is done for 3-, 4-, and 5-band systems. The data originate from a longwave infrared HSI of a material display board. The optimization algorithms were run 30 times for every scenario. Performance statistics (maximum, minimum, mean, standard deviation, and median) based on the separation values are given. Additional characterization was performed using receiver operator characteristic (ROC) curves and the area under the ROC curve. While good performance was obtained for the three optimization algorithms, the dual annealing algorithm produced the highest and most consistent detection separation scores on average.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Quantifying the robustness of deep multispectral segmentation models against natural perturbations and data poisoning

In overhead image segmentation tasks, including additional spectral bands beyond the traditional RGB channels can improve model performance. However, it is still unclear how incorporating this additional data impacts model robustness to adversarial attacks and natural perturbations. For adversarial robustness, the additional in-formation could improve the model’s ability to distinguish malicious inputs, or simply provide new attack avenues and vulnerabilities. For natural perturbations, the additional information could better inform model decisions and weaken perturbation effects or have no significant influence at all. In this work, we seek to characterize the performance and robustness of a multispectral (RGB and near infrared) image segmentation model subjected to adversarial attacks and natural perturbations. While existing adversarial and natural robustness research has focused primarily on digital perturbations, we prioritize on creating realistic perturbations designed with physical world conditions in mind. For adversarial robustness, we focus on data poisoning attacks whereas for natural robustness, we focus on extending ImageNet-C common corruptions for fog and snow that coherently and self-consistently perturbs the input data. Overall, we find both RGB and multispectral models are vulnerable to data poisoning attacks regardless of input or fusion architectures and that while physically-realizable natural perturbations still degrade model performance, the impact differs based on fusion architecture and input data.

Deep learning, multispectral images, multimodal fu↗
DOE OSTI2017

Synergistically Enhanced Performance of Ultrathin Nanostructured Silicon Solar Cells Embedded in Plasmonically Assisted, Multispectral Luminescent Waveguides

Ultrathin silicon solar cells fabricated by anisotropic wet chemical etching of single-crystalline wafer materials represent an attractive materials platform that could provide many advantages for realizing high-performance, low-cost photovoltaics. However, their intrinsically limited photovoltaic performance arising from insufficient absorption of low-energy photons demands careful design of light management to maximize the efficiency and preserve the cost-effectiveness of solar cells. Herein we present an integrated flexible solar module of ultrathin, nanostructured silicon solar cells capable of simultaneously exploiting spectral upconversion and downshifting in conjunction with multispectral luminescent waveguides and a nanostructured plasmonic reflector to compensate for their weak optical absorption and enhance their performance. The 8 $μ$m-thick silicon solar cells incorporating a hexagonally periodic nanostructured surface relief are surface-embedded in layered multispectral luminescent media containing organic dyes and NaYF 4 :Yb 3+ ,Er 3+ nanocrystals as downshifting and upconverting luminophores, respectively, via printing-enabled deterministic materials assembly. The ultrathin nanostructured silicon microcells in the composite luminescent waveguide exhibit strongly augmented photocurrent (~40.1 mA/cm 2 ) and energy conversion efficiency (~12.8%) than devices with only a single type of luminescent species, owing to the synergistic contributions from optical downshifting, plasmonically enhanced upconversion, and waveguided photon flux for optical concentration, where the short-circuit current density increased by ~13.6 mA/cm 2 compared with microcells in a nonluminescent medium on a plain silver reflector under a confined illumination.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Estimating Individual Tree Mortality in the Sierra Nevada Using Lidar and Multispectral Reflectance Data

Widespread tree mortality events occur during periods of severe drought in temperate conifer forests and are expected to become more frequent in many areas due to climate change. Improved mapping of individual tree mortality is needed to identify risk factors and design effective conservation strategies. In this study, we used National Ecological Observatory Network (NEON) lidar and multispectral reflectance airborne observations to map individual tree mortality over a 160 km 2 area during and after the 2012–2016 drought for two sites in California's Sierra National Forest. We used NEON lidar to derive tree locations and crown perimeters and multispectral data to map tree mortality for more than 1 million trees. We found that 25.4% of the trees in our study area died between 2013 and 2017, with considerably higher mortality at the lower-elevation Soaproot Saddle site. Between 2017 and 2019, an additional 2.0%–2.8% of the trees died each year. Two wildfires in 2020 and 2021 increased tree mortality within burned area perimeters by 49%–89% between 2019 and 2021. Consistent with previous work, we found that tree mortality risk increased as a function of tree height. Tree mortality was positively associated with distance from rivers, trees per hectare, and decreasing slope at the lower elevation site. In contrast, increasing slope was positively associated with tree mortality at the higher elevation site. Our approach and dataset provide a means to study the combined effects of drought and wildfire on tree mortality and may improve projections of forest resilience under a changing climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

Design and evaluation of a device for fast multispectral time-resolved fluorescence spectroscopy and imaging

The application of time-resolved fluorescence spectroscopy (TRFS) to in vivo tissue diagnosis requires a method for fast acquisition of fluorescence decay profiles in multiple spectral bands. This study focusses on development of a clinically compatible fiber-optic based multispectral TRFS (ms-TRFS) system together with validation of its accuracy and precision for fluorescence lifetime measurements. It also presents the expansion of this technique into an imaging spectroscopy method. A tandem array of dichroic beamsplitters and filters was used to record TRFS decay profiles at four distinct spectral bands where biological tissue typically presents fluorescence emission maxima, namely, 390, 452, 542, and 629 nm. Each emission channel was temporally separated by using transmission delays through 200 μm diameter multimode optical fibers of 1, 10, 19, and 28 m lengths. A Laguerre-expansion deconvolution algorithm was used to compensate for modal dispersion inherent to large diameter optical fibers and the finite bandwidth of detectors and digitizers. The system was found to be highly efficient and fast requiring a few nano-Joule of laser pulse energy and <1 ms per point measurement, respectively, for the detection of tissue autofluorescent components. Organic and biological chromophores with lifetimes that spanned a 0.8–7 ns range were used for system validation, and the measured lifetimes from the organic fluorophores deviated by less than 10% from values reported in the literature. Multi-spectral lifetime images of organic dye solutions contained in glass capillary tubes were recorded by raster scanning the single fiber probe in a 2D plane to validate the system as an imaging tool. The lifetime measurement variability was measured indicating that the system provides reproducible results with a standard deviation smaller than 50 ps. The ms-TRFS is a compact apparatus that makes possible the fast, accurate, and precise multispectral time-resolved fluorescence lifetime measurements of low quantum efficiency sub-nanosecond fluorophores.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

Multispectral multidimensional spectrometer spanning the ultraviolet to the mid-infrared

Multidimensional spectroscopy is the optical analog to nuclear magnetic resonance, probing dynamical processes with ultrafast time resolution. At optical frequencies, the technical challenges of multidimensional spectroscopy have hindered its progress until recently, where advances in laser sources and pulse-shaping have removed many obstacles to its implementation. Multidimensional spectroscopy in the visible and infrared (IR) regimes has already enabled respective advances in our understanding of photosynthesis and the structural rearrangements of liquid water. A frontier of ultrafast spectroscopy is to extend and combine multidimensional techniques and frequency ranges, which have been largely restricted to operating in the distinct visible or IR regimes. By employing two independent amplifiers seeded by a single oscillator, it is straightforward to span a wide range of time scales (femtoseconds to seconds), all of which are often relevant to the most important energy conversion and catalysis problems in chemistry, physics, and materials science. Complex condensed phase systems have optical transitions spanning the ultraviolet (UV) to the IR and exhibit dynamics relevant to function on time scales of femtoseconds to seconds and beyond. We describe the development of the Multispectral Multidimensional Nonlinear Spectrometer (MMDS) to enable studies of dynamical processes in atomic, molecular, and material systems spanning femtoseconds to seconds, from the UV to the IR regimes. The MMDS employs pulse-shaping methods to provide an easy-to-use instrument with an unprecedented spectral range that enables unique combination spectroscopies. We demonstrate the multispectral capabilities of the MMDS on several model systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2013

Online quantitative analysis of multispectral images of human body tissues

A method is developed for online monitoring of structural and morphological parameters of biological tissues (haemoglobin concentration, degree of blood oxygenation, average diameter of capillaries and the parameter characterising the average size of tissue scatterers), which involves multispectral tissue imaging, image normalisation to one of its spectral layers and determination of unknown parameters based on their stable regression relation with the spectral characteristics of the normalised image. Regression is obtained by simulating numerically the diffuse reflectance spectrum of the tissue by the Monte Carlo method at a wide variation of model parameters. The correctness of the model calculations is confirmed by the good agreement with the experimental data. The error of the method is estimated under conditions of general variability of structural and morphological parameters of the tissue. The method developed is compared with the traditional methods of interpretation of multispectral images of biological tissues, based on the solution of the inverse problem for each pixel of the image in the approximation of different analytical models. (biomedical optics)

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗