Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multispectral”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Charge separation in the photosystem II reaction center resolved by multispectral two-dimensional electronic spectroscopy

The photosystem II reaction center (PSII RC) performs the primary energy conversion steps of oxygenic photosynthesis. While the PSII RC has been studied extensively, the similar time scales of energy transfer and charge separation and the severely overlapping pigment transitions in the Qy region have led to multiple models of its charge separation mechanism and excitonic structure. Here, we combine two-dimensional electronic spectroscopy (2DES) with a continuum probe and two-dimensional electronic vibrational spectroscopy (2DEV) to study the cyt b559-D1D2 PSII RC at 77 K. This multispectral combination correlates the overlapping Qy excitons with distinct anion and pigment-specific Q x and mid-infrared transitions to resolve the charge separation mechanism and excitonic structure. Through extensive simultaneous analysis of the multispectral 2D data, we find that charge separation proceeds on multiple time scales from a delocalized excited state via a single pathway in which Pheo D1 is the primary electron acceptor, while Chl D1 and P D1 act in concert as the primary electron donor.

30 DIRECT ENERGY CONVERSION↗

Multispectral UAV imagery of experimental freshwater wetlands under 5 ppt saltwater intrusion, Louisiana, 2023 and 2024

Multispectral imagery was collected using an unmanned aerial vehicle (UAV) to evaluate how freshwater vegetation responds to short-term simulated saltwater intrusion events. The purpose of this data collection was to understand how plant health changes in response to acute salinity exposure, which is increasingly relevant in coastal wetland ecosystems facing sea level rise and storm surge events, such as in coastal Louisiana. Three experimental saltwater intrusions were conducted at a salinity of approximately 5 parts per thousand (ppt) for durations of 6-days, 10-days, and 17-days. UAV flights occurred both before and after each treatment. The resulting imagery was processed using Pix4DMapper software to georeference the images and generate orthomosaics. The multispectral sensor used in this study captures reflectance in five bands: blue, green, red, red-edge, and near-infrared. The uploaded data consist of georeferenced .tif orthomosaics for each spectral band, which are compatible with GIS software for vegetation analysis. This imagery can be utilized in investigations into vegetation stress, remote sensing of freshwater wetland ecosystems, and modeling of plant response to environmental changes.

EARTH SCIENCE > BIOSPHERE > ECOSYSTEMS↗

Mapping Vegetation at Species Level with High-Resolution Multispectral and Lidar Data Over a Large Spatial Area: A Case Study with Kudzu

Mapping vegetation species is critical to facilitate related quantitative assessment, and mapping invasive plants is important to enhance monitoring and management activities. Integrating high-resolution multispectral remote-sensing (RS) images and lidar (light detection and ranging) point clouds can provide robust features for vegetation mapping. However, using multiple sources of high-resolution RS data for vegetation mapping on a large spatial scale can be both computationally and sampling intensive. Here, we designed a two-step classification workflow to potentially decrease computational cost and sampling effort and to increase classification accuracy by integrating multispectral and lidar data in order to derive spectral, textural, and structural features for mapping target vegetation species. We used this workflow to classify kudzu, an aggressive invasive vine, in the entire Knox County (1362 km2) of Tennessee (U.S.). Object-based image analysis was conducted in the workflow. The first-step classification used 320 kudzu samples and extensive, coarsely labeled samples (based on national land cover) to generate an overprediction map of kudzu using random forest (RF). For the second step, 350 samples were randomly extracted from the overpredicted kudzu and labeled manually for the final prediction using RF and support vector machine (SVM). Computationally intensive features were only used for the second-step classification. SVM had constantly better accuracy than RF, and the producer’s accuracy, user’s accuracy, and Kappa for the SVM model on kudzu were 0.94, 0.96, and 0.90, respectively. SVM predicted 1010 kudzu patches covering 1.29 km2 in Knox County. We found the sample size of kudzu used for algorithm training impacted the accuracy and number of kudzu predicted. The proposed workflow could also improve sampling efficiency and specificity. Our workflow had much higher accuracy than the traditional method conducted in this research, and could be easily implemented to map kudzu in other regions as well as map other vegetation species.

59 BASIC BIOLOGICAL SCIENCES↗

UAS remote sensing (3DR SOLO platform): multispectral reflectance and normalized difference vegetation index, Seward Peninsula, Alaska, 2022

Airborne remote sensing data collected using a Parrot Sequoia+ multispectral sensor installed on a 3DR SOLO unoccupied aerial system (UAS) – operated by the Terrestrial Ecosystem Science & Technology group https://www.bnl.gov/envsci/testgroup/ at Brookhaven National Laboratory. This package includes data from 19 flights flown over the NGEE-Arctic, Kougarok Mile Marker (MM) 80, Kougarok Fire Complex (KFC) and Teller MM 27 sites in July 2022. Derived image products include point cloud, ortho-mosaiced multispectral image, a digital surface model (DSM) using the structure from motion (SfM) technique, and a normalized difference vegetation index (NDVI) map. Unprocessed and processed data products are included in this package (processing levels 0-2). Data and metadata are provided as text (*.txt, *.json, *hdr,), tabular (*.dat, *.csv), point cloud (*.laz), Cloud Optimized GeoTIFF (COG, *.tif), and image (*.jpg, *.tif, *png) formats.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

UAS remote sensing (3DR SOLO platform): multispectral reflectance, canopy height model, normalized difference vegetation index, Seward Peninsula, Alaska, 2021

Airborne remote sensing data collected using a Parrot Sequoia+ multispectral sensor installed on a 3DR SOLO unoccupied aerial system (UAS) - operated by the Terrestrial Ecosystem Science Technology group at Brookhaven National Laboratory. This package includes data from 10 flights flown over the NGEE-Arctic Council Mile Marker (MM) 71, Kougarok MM64, and Teller MM27 sites on the Seward Peninsula, Alaska, in August 2021. Derived image products include point cloud, ortho-mosaiced multispectral image, ortho-mosaiced RGB image, a digital surface model (DSM) using the structure from motion (SfM) technique, a canopy height model (CHM), and a normalized difference vegetation index (NDVI) map. Unprocessed and processed data products are included in this package (processing levels 0-2). Data and metadata are provided as text (*.txt, *.json, *hdr,), tabular (*.dat, *.csv), point cloud (*.laz), Cloud Optimized GeoTIFF (COG, *.tif), and image (*.jpg, *.tif, *png) formats. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Temporal multispectral and 3D analysis of Cerro de Pasco, Peru

Mining operations across the world often lead to contamination of land, water resources, ecosystems and in some cases, entire communities.Results of recent health and ground sampling studies revealed extensive lead contamination within the populace and around the City of Cerro de Pasco, Peru. Tailings excavated from a large open pit zinc mine in the center of the city have been aggregated in four large stockpiles within close proximity to neighborhoods, schools, and hospitals. Visual comparison of ASTER (Advanced Spaceborne Thermal Emission and Reflection Radiometer) imagery from 2001 and Sentinel-2 imagery from 2018 suggests a size increase in one tailing stockpile in particular near the neighborhood of Paragsha. Due to ongoing mining efforts, the hypothesis motivating the work presented here is that Pb-bearing minerals would be detectable through multispectral analysis, an increase in Pb mineral percent abundance would be observed and tailing stockpile volume would be detectable between 2001 and 2016. This hypothesis is tested using Spectral Angle Mapper (SAM), Adaptive Coherence Estimator (ACE), and Jeffries-Matusita distance calculation on ASTER (2001) and Sentinel-2 (2018) VNIR and SWIR bands. Volume and area estimate of tailing stockpiles were calculated using a photogrammetrically derived point cloud. SAM detected the presence of five Pb-bearing minerals around Cerro de Pasco and Paragsha. The results of the temporal SAM analysis displayed an increase of approximately 17% of Pb-bearing minerals around the greater Cerro de Pasco city area and approximately 11% for the neighborhood of Paragsha. Jeffries-Matusita distance results suggest clear correlation between contamination sources and affected locations. Total tailing stockpile volume was measured to be approximately 200,300,000 m 3 . Volume for Pile 4 was estimated to have increased by approximately 46,000,000 m 3 between 2001 and 2018. Lastly, these presented results will hopefully inspire and guide future remote sensing campaigns, perhaps involving a UAV or aircraft-based hyperspectral instrument.

54 ENVIRONMENTAL SCIENCES↗

Comparison of CNN-Based Image Classification Approaches for Implementation of Low-Cost Multispectral Arcing Detection

Camera-based sensing has benefited in recent years from developments in machine learning data processing methods, as well as improved data collection options such as Unmanned Aerial Vehicles (UAV) mounted sensors. However, cost considerations, both for the initial purchase of sensors as well as updates, maintenance, or potential replacement if damaged, can limit adoption of more expensive sensing options for some applications. To evaluate more affordable options with less expensive, more available, and more easily replaceable hardware, we examine the use of machine learning-based image classification with custom datasets, utilizing deep learning based-image classification and the use of ensemble models for sensor fusion. Utilizing the same models for each camera to reduce technical overhead, we showed that for a very representative training dataset, camera-based detection can be successful for detection of electrical arcing. We also use multiple validation datasets, based on conditions expected to be of varying difficulty, to evaluate custom data. These results show that ensemble models of different data sources can mitigate risks from gaps in training data, though the system will be less redundant for those cases unless other precautions are taken. We found that with good quality custom datasets, data fusion models can be utilized without specialization in design to the specific cameras utilized, allowing for less specialized, more accessible equipment to be utilized as multispectral camera components. This approach can provide an alternative to expensive sensing equipment for applications in which lower-cost or more easily replaceable sensing equipment is desirable.

convolutional neural networks↗

Multispectral and thermal surface imagery and surface elevation mosaics (camspec-air)

This dataset contains high resolution image products (orthomosaics) acquired from midsized uncrewed aerial systems, which have been processed for value added quality. The instrument itself, a multispectral imager, the Altum by Micasense, captures 6 spectral bands (red, green blue, NIR, red edge, and LWIR/thermal1) as radiance, which is converted to reflectance. The code used to develop these images first uses tools from the Micasense python library2 to apply dark level corrections, row gradient corrections, and radiometric corrections. Next it uses the processing API from Agisoft Metashape software to align and mosaic the processed imagery, following the processes developed by the USGS' structure from motion workflow documentation3. Captures at different altitudes (recorded in MSL) produce an orthomosaic, a tif image containing information related to the 6 spectral bands, and a digital elevation model (DEM), a tif image containing information related to the elevation of the surveyed terraine. Metadata included in every image can be used to extract lat, lon, and reflectance values. 1https://www.arm.gov/publications/tech_reports/handbooks/doe-sc-arm-tr-281.pdf 2https://micasense.github.io/imageprocessing/MicaSense%20Image%20Processing%20Setup.html 3https://pubs.usgs.gov/of/2021/1039/ofr20211039.pdf

54 ENVIRONMENTAL SCIENCES↗

Recurrent and convolutional neural networks for sequential multispectral optoacoustic tomography ( MSOT ) imaging

Abstract Multispectral optoacoustic tomography (MSOT) is a beneficial technique for diagnosing and analyzing biological samples since it provides meticulous details in anatomy and physiology. However, acquiring high through‐plane resolution volumetric MSOT is time‐consuming. Here, we propose a deep learning model based on hybrid recurrent and convolutional neural networks to generate sequential cross‐sectional images for an MSOT system. This system provides three modalities (MSOT, ultrasound, and optoacoustic imaging of a specific exogenous contrast agent) in a single scan. This study used ICG‐conjugated nanoworms particles (NWs‐ICG) as the contrast agent. Instead of acquiring seven images with a step size of 0.1 mm, we can receive two images with a step size of 0.6 mm as input for the proposed deep learning model. The deep learning model can generate five other images with a step size of 0.1 mm between these two input images meaning we can reduce acquisition time by approximately 71%.

Juhong, Aniwat↗

Mapping ephemeral stream networks in desert environments using very-high-spatial-resolution multispectral remote sensing

In this paper, understanding the spatial patterns of ephemeral streams is crucial for understanding how hydrologic processes influence the abundance and distribution of wildlife habitats in desert regions. Available methods for mapping ephemeral streams at the watershed scale typically underestimate the size of channel networks. Although remote sensing is an effective means of collecting data and obtaining information on large, inaccessible areas, conventional techniques for extracting channel features are not sufficient in regions that have small topographic gradients and subtle target-background spectral contrast. By using very high resolution multispectral imagery, we developed a new algorithm that applies landscape information to map ephemeral channels in desert regions of the Southwestern United States where utility-scale solar energy development is occurring. Knowledge about landscape features and structures was integrated into the algorithm using a series of spectral transformation and spatial statistical operations to integrate information about landscape features and structures. The algorithm extracted ephemeral stream channels at a local scale, with the result that approximately 900% more ephemeral streams was identified than what were identified by using the U.S. Geological Survey’s National Hydrography Dataset. The accuracy of the algorithm in detecting channel areas was as high as 92%, and its accuracy in delineating channel center lines was 91% when compared to a subset of channel networks that were digitized by using the very high resolution imagery. Although the algorithm captured stream channels in desert landscapes across various channel sizes and forms, it often underestimated stream headwaters and channels obscured by bright soils and sparse vegetation. While further improvement is warranted, the algorithm provides an effective means of obtaining detailed information about ephemeral streams, and it could make a significant contribution toward improving the hydrological modelling of desert environments.

47 OTHER INSTRUMENTATION↗

Numerical assessment of uncertainty and dynamic range expansion of multispectral image-based pyrometry

Temperature measurements based on spectral radiation are often limited by prior knowledge of target surface properties and detector sensitivity. Here the present work describes a multispectral pyrometry method for temperature estimation that does not require information on surface emissivity or calibration. Digital camera simulations considering a silicon-based sensor and five bandpass filters are used to create synthetic images of targets. The detector sensitivity is compensated via high dynamic range imaging technique. The effect of natural and detector noise on temperature estimates is assessed via Monte Carlo simulations. Results from a wavelength-independent model (Gray) are compared with those from the Band model (with emissivity varying between constant spectral bands). The effect of detector dynamic range and spectral position of bandpass filters is discussed. Temperatures as low as 520 K are obtained, with an overall uncertainty of the order of 10 K. The proposed method is applicable to temperature measurements using commercial-grade CMOS/CCD cameras.

42 ENGINEERING↗

Excitonic structure and charge separation in the heliobacterial reaction center probed by multispectral multidimensional spectroscopy

Photochemical reaction centers are the engines that drive photosynthesis. The reaction center from heliobacteria (HbRC) has been proposed to most closely resemble the common ancestor of photosynthetic reaction centers, motivating a detailed understanding of its structure-function relationship. The recent elucidation of the HbRC crystal structure motivates advanced spectroscopic studies of its excitonic structure and charge separation mechanism. We perform multispectral two-dimensional electronic spectroscopy of the HbRC and corresponding numerical simulations, resolving the electronic structure and testing and refining recent excitonic models. Through extensive examination of the kinetic data by lifetime density analysis and global target analysis, we reveal that charge separation proceeds via a single pathway in which the distinct A 0 chlorophyll a pigment is the primary electron acceptor. In addition, we find strong delocalization of the charge separation intermediate. Our findings have general implications for the understanding of photosynthetic charge separation mechanisms, and how they might be tuned to achieve different functional goals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Active multispectral imaging system for photodiagnosis and personalized phototherapies

The proposed system has been designed to identify dermatopathologies or to apply personalized phototherapy treatments. The system emits electromagnetic waves in different spectral bands in the range of visible and near infrared to irradiate the target (skin or any other object) to be spectrally characterized. Then, an imaging sensor measures the target response to the stimulus at each spectral band and, after processing, the system displays in real time two images. In one of them the value of each pixel corresponds to the more reflected wavenumber whereas in the other image the pixel value represents the energy absorbed at each band. The diagnosis capability of this system lies in its multispectral design, and the phototherapy treatments are adapted to the patient and his lesion by measuring his absorption capability. This “in situ” absorption measurement allows us to determine the more appropriate duration of the treatment according to the wavelength and recommended dose. The main advantages of this system are its low cost, it does not have moving parts or complex mechanisms, it works in real time, and it is easy to handle. For these reasons its widespread use in dermatologist consultation would facilitate the work of the dermatologist and would improve the efficiency of diagnosis and treatment. In fact the prototype has already been successfully applied to pathologies such as carcinomas, melanomas, keratosis, and nevi.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Change detection and classification of land cover in multispectral satellite imagery using clustering of sparse approximations (CoSA) over learned feature dictionaries

Neuromimetic machine vision and pattern recognition algorithms are of great interest for landscape characterization and change detection in satellite imagery in support of global climate change science and modeling. We present results from an ongoing effort to extend machine vision methods to the environmental sciences, using adaptive sparse signal processing combined with machine learning. A Hebbian learning rule is used to build multispectral, multiresolution dictionaries from regional satellite normalized band difference index data. Land cover labels are automatically generated via our CoSA algorithm: Clustering of Sparse Approximations, using a clustering distance metric that combines spectral and spatial textural characteristics to help separate geologic, vegetative, and hydrologie features. We demonstrate our method on example Worldview-2 satellite images of an Arctic region, and use CoSA labels to detect seasonal surface changes. In conclusion, our results suggest that neuroscience-based models are a promising approach to practical pattern recognition and change detection problems in remote sensing.

97 MATHEMATICS AND COMPUTING↗

2-D MEMS Scanner for Handheld Multispectral Dual-Axis Confocal Microscopes

We describe a 2-D microelectromechanical systems (MEMS) scanner for a handheld multispectral confocal microscope for early detection and diagnosis of cervical cancer. This paper is an expansion of work originally reported in the Proceedings of IEEE International Conference on Optical MEMS and Nanophotonics 2012. The MEMS scanner and fabrication process has been designed to improve performance for the dual-axis confocal microscopy architecture. Dual-axis confocal microscopy achieves comparable transverse and depth resolution to high numerical aperture (NA) single-axis confocal microscopy but achieves longer working distance by utilizing low-NA optics. The MEMS scanner has an inner gimbal design with torsional flexures separated from the reflectors to reduce light loss and oxide-free outer axis torsional flexures by utilizing poly vial for electrical access to the inner gimbal electrodes. The devices are large-scale batch fabricated using a double layer silicon-on-insulator (SOI) process and predice postreleasing of dies. The scanner has electrostatic optical deflection angles of 2 degrees for the single-sided inner axis at 75 V and +/- 3 degrees for the outer axis at 120 V. The device has resonance frequencies of similar to 2.48 kHz and similar to 348 z for the inner and outer axis torsional modes, respectively. Reflectance and fluorescence images with 650 mu m x 800 mu m field of view are demonstrated at 15 frames/s. The transverse (axial) resolutions are 4.78 mu m (6.2 mu m), 5.77 mu m (6.2 mu m), and 7.45 mu m (5.6 Am) for wavelengths of 561, 662, and 781 nm, respectively.

cervical cancer↗

ResSR: A Computationally Efficient Residual Approach to Super-Resolving Multispectral Images

Multispectral imaging (MSI) plays a critical role in material classification, environmental monitoring, and remote sensing. However, MSI sensors typically have wavelength-dependent resolution, which limits downstream analysis. MSI super-resolution (MSI-SR) methods address this limitation by reconstructing all bands at a common high spatial resolution. Existing methods can achieve high reconstruction quality but often rely on spatially-coupled optimization or large learning-based models, leading to significant computational cost and limiting their use in large-scale or time-critical settings. In this paper, we introduce ResSR, a computationally efficient, model-based MSI-SR method that achieves high-quality reconstruction without supervised training or spatially-coupled optimization. Notably, ResSR decouples spectral and spatial processing into two sequential steps. ResSR first computes a spectrally-informed high-resolution estimate of the MSI using singular value decomposition together with a spatially-decoupled approximate forward model. It then applies a residual correction step to restore low-frequency spatial consistency while preserving high-frequency detail recovered by the spectral reconstruction. ResSR achieves comparable or improved reconstruction quality relative to existing MSI-SR methods while being

Sullivan, Haley [ORNL] (ORCID:0000000274069217)↗

Heterodyne frequency-domain multispectral diffuse optical tomography of breast cancer in the parallel-plane transmission geometry

Purpose: The authors introduce a state-of-the-art all-optical clinical diffuse optical tomography (DOT) imaging instrument which collects spatially dense, multispectral, frequency-domain breast data in the parallel-plate geometry. Methods: The instrument utilizes a CCD-based heterodyne detection scheme that permits massively parallel detection of diffuse photon density wave amplitude and phase for a large number of source–detector pairs (10{sup 6}). The stand-alone clinical DOT instrument thus offers high spatial resolution with reduced crosstalk between absorption and scattering. Other novel features include a fringe profilometry system for breast boundary segmentation, real-time data normalization, and a patient bed design which permits both axial and sagittal breast measurements. Results: The authors validated the instrument using tissue simulating phantoms with two different chromophore-containing targets and one scattering target. The authors also demonstrated the instrument in a case study breast cancer patient; the reconstructed 3D image of endogenous chromophores and scattering gave tumor localization in agreement with MRI. Conclusions: Imaging with a novel parallel-plate DOT breast imager that employs highly parallel, high-resolution CCD detection in the frequency-domain was demonstrated.

60 APPLIED LIFE SCIENCES↗

UAV-based multispectral time-series imagery of biomass sorghum - 2019

UAV-based high-resolution multispectral time-series orthophotos utilized to understand the relation between growth dynamics, imagery temporal resolution, and end-of-season biomass productivity of biomass sorghum as bioenergy crop. Sensor utilized is a RedEdge Micasense flown at 40 meters above ground level at the Energy Farm- UIUC in 2019.

Bioenergy crops↗