Search NASA⌕ Search

SEARCH · Search NASA

Results for “multispectral”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Artificial illumination identification from an unmanned aerial vehicle

Artificial illumination identification within images is a useful tool for many applications. Performing such identification allows for an estimation of the illumination source spectrum, which in turn can be used for additional applications ranging from spectral detection and exploitation to statistics about nighttime light usage. Illumination identification has been performed in laboratory settings but not from an unmanned aerial vehicle (UAV) platform. Here, we test the feasibility of using a UAV and commercial off-the-shelf multispectral imaging sensor to perform such artificial illumination identification through linear discriminant analysis using nighttime UAV images. The results are very promising, showing source classification accuracies of 83.3%, 92.3%, 100%, and 100% for the incandescent, light-emitting diode, high pressure sodium, and metal halide illumination sources, respectively. We show that the information gained from the source identification can be further used to inform additional analysis, such as spectral identification. The high resolution of UAV imaging techniques combined with the knowledge of the illumination source can lead to better exploitation of such nighttime data for many applications.

42 ENGINEERING↗
DOE OSTI2020

More chemical detection through less sampling: amplifying chemical signals in hyperspectral data cubes through compressive sensing

Compressive sensing (CS) is a method of sampling which permits some classes of signals to be reconstructed with high accuracy even when they were sampled at sub-Nyquist rates. In this paper we explore a phenomenon in which bandwise CS sampling of a hyperspectral data cube followed by reconstruction can actually result in amplification of chemical signals contained in the cube. Perhaps most surprisingly, chemical signal amplification generally seems to increase as the level of sampling decreases. In some examples, the chemical signal is significantly stronger in a data cube reconstructed from 10% CS sampling than it is in the raw, 100% sampled data cube. We explore this phenomenon in two real-world datasets including the Physical Sciences Inc. Fabry-Perot interferometer sensor multispectral dataset and the Johns Hopkins Applied Physics Lab FTIR-based longwave infrared sensor hyperspectral dataset. Each of these datasets contains the release of a chemical simulant, such as glacial acetic acid, triethyl phospate, and sulfur hexafluoride, and in all cases we use the adaptive coherence estimator (ACE) to detect a target signal in the hyperspectral data cube. We end the paper by suggesting some theoretical justifications for why chemical signals would be amplified in CS sampled and reconstructed hyperspectral data cubes and discuss some practical implications.

Hyperspectral imagery, Compressive Sensing, single↗
DOE OSTI2020

A data-driven approach to sampling matrix selection for compressive sensing

Sampling is a fundamental aspect of any implementation of compressive sensing. Typically, the choice of sampling method is guided by the reconstruction basis. However, this approach can be problematic with respect to certain hardware constraints and is not responsive to domain-specific context. We propose a method for defining an order for a sampling basis that is optimal with respect to capturing variance in data, thus allowing for meaningful sensing at any desired level of compression. We focus on the Walsh-Hadamard sampling basis for its relevance to hardware constraints, but our approach applies to any sampling basis of interest. We illustrate the effectiveness of our method on the Physical Sciences Inc. Fabry-Perot interferometer sensor multispectral dataset, the Johns Hopkins Applied Physics Lab FTIR-based longwave infrared sensor hyperspectral dataset, and a Colorado State University Swiss Ranger depth image dataset. The spectral datasets consist of simulant experiments, including releases of chemicals such as GAA and SF6. We combine our sampling and reconstruction with the adaptive coherence estimator (ACE) and bulk coherence for chemical detection and we incorporate an algorithmic threshold for ACE values to determine the presence or absence of a chemical. We compare results across sampling methods in this context. We have successful chemical detection at a compression rate of 90%. For all three datasets, we compare our sampling approach to standard orderings of sampling basis such as random, sequency, and an analog of sequency that we term `frequency.' In one instance, the peak signal to noise ratio was improved by over 30% across a test set of depth images.

compressive sensing, hyperspectral imaging, Walsh-↗
DOE OSTI2025

hdsullivan/ResSR

This is the official implementation of ResSR [1]. ResSR is a computationally efficient MSI-SR method that achieves high-quality reconstructions by using a closed-form spectral decomposition along with a spatial residual correction. ResSR applies singular value decomposition to identify correlations across spectral bands, uses pixel-wise computation to upsample the MSI, and then applies a residual correction process to correct the high-spatial frequency components of the upsampled bands. While ResSR is formulated as the solution to a spatially-coupled optimization problem, we use pixel-wise regularization and derive an approximate closed-form solution, resulting in a pixel-wise algorithm with a dramatic reduction in computation that achieves state-of-the-art reconstructions. [1] Duba-Sullivan, H., Reid, E. J., Voisin, S., Bouman, C. A., & Buzzard, G. T. (2024). ResSR: A Computationally Efficient Residual Approach to Super-Resolving Multispectral Images. arXiv preprint arXiv:2408.13225.

Duba-Sullivan, Haley [Oak Ridge National Laborator↗
DOE OSTI2026

Software for High-Resolution Flood Mapping With Sentinel-1 and Sentinel-2 via Misalignment-Robust Cross-Sensor Learning and Generative Despeckling

SF-26-078 This software provides a high-level workflow for satellite-based flood and surface-water mapping using Sentinel-1 SAR and Sentinel-2 multispectral imagery. It supports preparation of remote-sensing data, training and evaluation of deep-learning models, and generation of high-resolution water extent predictions, including methods to improve robustness to SAR speckle noise and cross-sensor image misalignment.

Feinstein, Jeremy [Argonne National Laboratory (AN↗
DOE OSTI2023

Integrating LEO and GEO Observations: Toward Optimal Summertime Satellite Precipitation Retrieval

Abstract Reliable quantitative precipitation estimation with a rich spatiotemporal resolution is vital for understanding the Earth’s hydrological cycle. Precipitation estimation over land and coastal regions is necessary for addressing the high degree of spatial heterogeneity of water availability and demand, and for resolving the extremes that modulate and amplify hazards such as flooding and landslides. Advancements in computation power along with unique high spatiotemporal and spectral resolution data streams from passive meteorological sensors aboard geosynchronous Earth-orbiting (GEO) and low Earth-orbiting (LEO) satellites offer exciting opportunities to retrieve information about surface precipitation phenomena using data-driven machine learning techniques. In this study, the capabilities of U-Net–like architecture are investigated to map instantaneous, summertime surface precipitation intensity at the spatial resolution of 2 km. The calibrated brightness temperature products from the Global Precipitation Measurement (GPM) Microwave Imager (GMI) radiometer are combined with multispectral images (visible, near-infrared, and infrared bands) from the Advanced Baseline Imager (ABI) aboard the GOES-R satellites as main inputs to the U-Net–like precipitation algorithm. Total precipitable water and 2-m temperature from the Global Forecast System (GFS) model are also used as auxiliary inputs to the model. The results show that the U-Net–like algorithm can capture fine-scale patterns and intensity of surface precipitation at high spatial resolution over stratiform and convective precipitation regimes. The evaluations reveal the potential of extracting relevant, high spatial features over complex surface types such as mountainous regions and coastlines. The algorithm allows users to interpret the inputs’ importance and can serve as a starting point for further exploration of precipitation systems within the field of hydrometeorology.

Meteorology & Atmospheric Sciences↗
DOE OSTI2020

Thunderstorm Cloud-Type Classification from Space-Based Lightning Imagers

The organization and structure of thunderstorms determines the extent and severity of their hazards to the general public and their consequences for the Earth system. Distinguishing vigorous convective regions that produce heavy rain and hail from adjacent regions of stratiform clouds or overhanging anvil clouds that produce light to no rainfall is valuable in operations and physical research. Cloud-type algorithms that partition convection from stratiform regions have been developed for space-based radar, passive microwave, and now Geostationary Operational Environmental Satellites (GOES) Advanced Baseline Imager (ABI) multispectral products. However, there are limitations for each of these products including temporal availability, spatial coverage, and the degree to which they based on cloud microphysics. We report we have developed a cloud-type algorithm for GOES Geostationary Lightning Mapper (GLM) observations that identifies convective/nonconvective regions in thunderstorms based on signatures of interactions with nonconvective charge structures in the lightning flash data. The GLM sensor permits a rapid (20 s) update cycle over the combined GOES-16–GOES-17 domain across all hours of the day. Storm regions that do not produce lightning will not be classified by our algorithm, however. The GLM cloud-type product is intended to provide situational awareness of electrified nonconvective clouds and to complement other cloud-type retrievals by providing a contemporary assessment tied to lightning physics. We propose that a future combined ABI–GLM cloud-type algorithm would be a valuable product that could draw from the strengths of each instrument and approach.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Extreme heat vulnerability of manufactured housing in arid urban environments

This article explores the role of land cover in relation to housing type and tenure in shaping exposure to extreme urban heat, focusing on residents of mobile and manufactured housing (MH). We hypothesize that MH residents will experience greater exposure to extreme heat than those living in other housing types due to lower levels of proximate vegetation. This hypothesis is based on the unique property relations and tenure regimes that characterize MH, which may disincentivize investments in planting and maintaining trees and vegetation in arid environments. To test this hypothesis, we compare the amount of vegetation on properties across housing types, within-type tenure arrangements and between three urbanized areas in Arizona with different levels of exposure to extreme heat. To conduct this comparison, we combine multispectral land cover data for 1.7 million parcels with tax assessor data and building footprints to measure land cover at a high resolution. We find that MH units have significantly less vegetation than single-family residential properties, and that MH units in MH parks have less vegetation than those on individual lots. We conclude that municipalities should promote (e.g. through incentives or other policy interventions) the planting of more vegetation around MH units where there is a risk of extreme heat exposure. Future research can expand this analysis with a closer examination of how municipal ordinances and policies affect land cover by housing type and tenure.

heat↗
DOE OSTI2022

Major to trace element imaging and analysis of iron age glasses using stage scanning in the analytical dual beam microscope (tandem)

Dark and clear silicate glasses formed during an iron age vitrification event ≈ 1500 years ago at the Broborg hillfort near Uppsala, Sweden have been analyzed using a scanning electron microscope equipped with a micro-X-ray fluorescence (μXRF) spectrometer. Correlated µXRF and electron beam-induced energy dispersive spectrometry (EDS) X-ray maps were collected via stage-scanning at constant velocity. This coupled procedure represents a new approach for the cultural heritage community to conduct analytical studies of archaeometric specimens composed of metal, ceramic, or mixed inorganic/organic materials, where major and trace element compositions are registered in space for areas up to the centimeter-length scale at micrometer-scale resolution. Overview images were used to select areas for EDS beam scan maps correlated with multispectral cathodoluminescence (CL) imaging and co-located quantitative EDS and μXRF point analysis. Fe, Ca, Mg, Ti, P, Mn, Zr, Zn, and Y are enriched in the dark glass, while Si, Al, K, Na, Ba, Sr, Rb, and Ga are enriched in the clear glass. Unmelted material is comprised predominately of quartz (SiO 2 ) along with trace apatite (Ca 5 (PO 4 ) 3 [Cl,OH]) and zircon (ZrSiO 4 ). Multivariate statistical analysis was used to measure the area fractions of high variance components while lower variance components represented phase mixtures. Differences between calculated melt viscosities for the glass compositions are consistent with field and laboratory observations. Coupled large area EDS and μXRF imaging shows significant promise for informed selection of higher spatial resolution and higher sensitivity follow-up studies, e.g., those performed using synchrotron analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Heterodyne spectrometer sensitivity limit for quantum networking

We report optical heterodyne detection-based spectrometers are attractive due to their relatively simple construction and ultrahigh resolution. Here we demonstrate a proof-of-principle single-mode optical-fiber-based heterodyne spectrometer that has picometer resolution and quantum-limited sensitivity around 1550 nm. Moreover, we report a generalized quantum limit of detecting broadband multispectral-temporal-mode light using heterodyne detection, which provides a sensitivity limit on a heterodyne detection-based optical spectrometer. We then compare this sensitivity limit to several spectrometer types and dim light sources of interest such as spontaneous parametric downconversion, Raman scattering, and spontaneous four-wave mixing. We calculate that the heterodyne spectrometer is significantly less sensitive than a single-photon detector and is unable to detect these dim light sources, except for the brightest and narrowest-bandwidth examples.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Beam combining of high-power terahertz lasers with semiconductor metasurface gratings

Spectral beam combining (SBC) of an array of single-mode lasers has the potential for realizing a chip-scale electrically tunable multispectral laser source without any moving parts and with emission at closely spaced discrete frequencies. Here, we demonstrate SBC of an array of single-mode THz quantum-cascade lasers (QCLs) with small frequency spacing. Semiconductor-based metasurface THz blazed gratings are developed for integration with QCLs in a compact cryocooler setup. Single-lobed beams of four QCLs emitting around 3.2 THz and spectrally separated by ~14 GHz are combined to achieve collinear propagation of spatially overlapped and collimated beams in the far field with ≲ 0.1° of pointing error. Peak optical power in the range 50–100 mW is detected from each of the QCLs after combining. The dense frequency spacing in our method provides a pathway to incorporate tens of QCLs on a chip to realize a high-power discretely tunable THz laser source for applications in THz spectroscopy.

Jia, Fei [Lehigh Univ., Bethlehem, PA (United Stat↗
DOE OSTI2022

RiverPIXELS: paired Landsat images and expert-labeled sediment and water pixels for a selection of rivers v1.0

RiverPIXELS contains GeoTIFFs of hand-labeled water and sediment pixels from Landsat images containing rivers. Each of the 104 labeled patches contains 256 x 256 Landsat pixels (30 meter resolution). Our aim in releasing RiverPIXELS is to provide an "off-the-shelf" training and testing dataset for building machine-learned models to automatically identify rivers from multispectral imagery. While a number of trained models and/or surface water products already exist, RiverPIXELS aims for pixel-level accuracy in order to precisely identify river boundaries in particular. Our selection of rivers is heavily Arctic, but we include tropical and temperate rivers as well. Patches are provided for the Colville (7), Indigirka (6), Kolyma (4), Ucayali (54), Waitaki (21), and Yana (12) Rivers. For each patch, all surface water pixels are labeled (1) and all in-channel sediment pixels are labeled (2). Sediments not in-channel are considered part of the land (0) class. RiverPIXELS also includes paired surface water data from the Global Surface Water dataset that may be useful as additional features in machine learning models. Each patch therefore contains four aligned GeoTIFFs: labeled, landsat, gswmo, and gswocc.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Topography and Functional Traits Control the Distribution of Key Shrub Plant Functional Types in Low-Arctic Tundra: Supporting Data

High-resolution classification maps derived from occupied aerial systems (UASs). The UAS data were collected in August 2021 using a Skydio 2+ drone equipped with a 4K resolution red-green-blue (RGB) camera (2024 Skydio Inc) and a 3DR SOLO Quadcopter carried a Parrot Sequoia+ Multispectral Sensor (2023 Parrot Drone SAS). This package includes vegetation classification maps at four locations around Next Generation Ecosystem Experiment Arctic (NGEE Arctic) Council watershed study site on the Seward Peninsula, Alaska. The classification maps were generated using a combination of RGB and canopy height information. The map data and metadata are provided as ENVI image (.dat) and text (.txt, *hdr) formats. Additional map quicklooks are provided as GIS *.kml files. These datasets are provided in support of Yang et al., (In review), “Topography and Functional Traits Control the Distribution of Key Shrub Plant Functional Types in Low-Arctic Tundra”.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

The Consortium for Advanced Sorghum Phenomics (CASP). Final report

The goal of CASP was to accelerate breeding of biomass sorghum [Sorghum bicolor (L.) Moench] by identifying genotypes exhibiting high yield under well-watered, pre- or post-drought and/or salinity-stress conditions. We did this by combining high-throughput, non-invasive drone phenotyping with genomics and molecular profiling. Field-based phenotyping utilized a multi-modal sensor suite of LiDAR, multispectral cameras, and thermal cameras mounted on a commercial drone to detect traits required for yield prediction and selection of drought and saline tolerant lines of sorghum. Traits of interest included plant height (PH), leaf area index (LAI), wet biomass (BMW), and biomass at 65% moisture (BM65) and were measured from emergence to harvest on a weekly basis over three growing seasons. The final output were measurements of traits on a plot-by-plot basis, identified by the plot ID used by the Proprietary data processing software enabled raw field data to be turned into plant traits and delivered to the PNNL and JGI within the same workday.

09 BIOMASS FUELS↗
DOE OSTI2021

Oregon Rivers Characterization Tool

DHS’s Regional Resiliency Assessment Program (RRAP) undertook the Oregon State Transportation Systems RRAP project between 2018-2021 to assess the seismic vulnerabilities of the state’s transportation system to a Cascadia Subduction Zone (CSZ) earthquake (CISA 2021). The project primarily focused on the effects of a CSZ earthquake on the mobility of emergency response efforts into the region. In the event that bridges located at crucial river crossings fail during a CSZ earthquake, rivers will become natural barriers affecting the ability to support response and recovery efforts. The characteristics of rivers (e.g., width, depth, and flow) are critical data to inform planning for the recovery of transportation systems across river barriers and determine reopening times following a CSZ earthquake. As part of the transportation system assessment, an Argonne National Laboratory (Argonne) project team developed a River Characterization Tool (RCT) to quantify the physical characteristics of the river system in Oregon, which can be used to inform a system-level analysis of transportation recovery and reopening times. This report mainly discusses approaches, methods, development, and applications of the RCT. The use of the river data generated from this tool for a system-level analysis of transportation recovery is discussed in the Oregon Transportation Systems RRAP Resiliency Assessment report (CISA 2021). The primary goal of the RCT is to generate statewide dataset of widths, depths, and flows for all rivers across Oregon to assess the effects of river barriers on emergency response and recovery efforts following a CSZ earthquake. The RCT leverages remote sensing data that multispectral sensors collect from satellites, employs a deep learning model to characterize river predictions, and computes river channel geometric dimensions with hydraulic relationships and river predictions. The entire process of river characterization is automated and implemented through the RCT.

58 GEOSCIENCES↗
DOE OSTI2023

Multiparametric optical label-free imaging to analyze plant cell wall assembly and metabolism. (Final Report)

Plant tissues are often considered not ideal for fluorescence imaging because of the pervasive intrinsic fluorescence of many plant metabolites and the intricate interactions with light of the many semi-crystalline polymers at the cell wall. Our project aims to take advantage of this observed shortcoming by developing a label-free, optical microscopy platform for characterizing multiple fingerprints of important cell wall components and stress-related, at subcellular scale resolution. The new imaging system can collect fingerprints from both emitted and scattered light that can inform on the chemical nature, subcellular distribution, anisotropy, and molecular environment of multiple cell wall components in intact plant tissues. We are combining these imaging capabilities with computational tools that enable correlated registration, integration, and analysis. This fully integrated, multiparametric optical system will be used to address biological problems connected to cell wall assembly in grasses. This includes a focus on developmental and environmental variation of cell wall impregnation with silica, lignin, suberin, and cutin in different tissues and cell types. Our research plan comprises three main goals: (1) To develop an accessible imaging platform and associated open-source software able to extract and integrate fingerprints from fluorescence-associated (multispectral emission, lifetime, and polarization), wide-field polarimetry, second harmonic generation (SHG), and stimulated Raman scattering signals (SRS); (2) To determine unique combination of fingerprints for various cell wall components and selected metabolites; (3) To analyze the process of cell wall silicification in grasses and determine how silicification affects cell wall properties and lignin, cutin, and suberin deposition in other cell types under differ stress conditions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Automated Sorghum Phenotyping and Trait Development Platform

There is an urgent need to accelerate energy crop development for the production of renewable transportation fuels from biomass. Our interdisciplinary team developed mobile, ground-based and aerial phenotyping platforms and advanced remote sensing data analysis tools to acquire and process imagery from different types of cameras (e.g. RGB, multispectral, hyperspectral, and thermal sensors) and LiDAR point cloud data in large-scale sorghum field trials during phase 1 of the project. Phase 2 focused on Technology to Market activities to deliver these systems to the market place coupled with targeted research programs to address specific limitations or challenges for these systems.

09 BIOMASS FUELS↗
DOE OSTI2023

Gumby: Quantifying multi-modal model resiliency

With the rise of cheap data and sensors, more use cases are emerging for multi-input models. Research has shown that including multiple data modalities can improve performance, suggesting that deep learning models can successfully learn to leverage complementary information from different modalities. However, this improved predictive power comes with unanticipated costs: additional inputs change model resiliency and expand the threat space for adversarial attacks. We first provide theoretical underpinnings for how adversarial success scales with input dimension. We then characterize the performance of a suite of multispectral deep learning models with different fusion approaches, quantify their relative reliance on different input bands, and evaluate their robustness to naturalistic and adversarial image corruptions.

97 MATHEMATICS AND COMPUTING↗