Search NASA⌕ Search

SEARCH · Search NASA

Results for “remote imagery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Large-Scale Classification of Urban Structural Units From Remote Sensing Imagery

Remote sensing in combination with deep learning has become instrumental for efficiently and accurately classifying land-use and land-cover across large geographic areas. These technologies have also been successful in characterizing urban environments in terms of their structural units, structure types, or morphological regions. In these approaches, an urban area is partitioned into regions that exhibit homogeneous physical characteristics. However, existing approaches are typically limited to a single city, use inconsistent typologies, and lack scalability and generalization capacity. In this article, we propose an urban structural units categorization scheme and demonstrate its utility by applying it to 13 cities. Inspired by the lack of scalability and generalization capacity in urban structural units mapping, we extend the reach of deep learning and conduct a set of classification experiments in all 13 cities. These experiments offer insights into the strengths and limitations of deep neural networks for classifying urban structural units over diverse geographic regions and on heterogeneous collections of satellite imagery. The efficacy of the proposed deep learning approach is compared to a baseline method of multiscale image features and support vector machines. Our validation on five cities shows that better performance is achieved with deep neural networks. Additionally, we evaluate the impact of input size, model depth, and spatial pyramid pooling to assess the generalization capacity of deep neural networks.

47 OTHER INSTRUMENTATION↗

Systems and methods for verification and authentication of remote sensing imagery

A system for generating and authenticating remote sensing imagery includes a remote sensing platform. The remote sensing platform includes an imaging sensor and a hardware logic device that is directly coupled to the imaging sensor. The hardware logic device receives image data from the imaging sensor and generates a cryptographic signature based upon the image data. The hardware logic device outputs a signed image that includes the image data and the cryptographic signature. A computing device operated by a downstream user receives the signed image and can determine whether the image data has been modified from its original content based upon the cryptographic signature.

Crosby, Sean Michael↗

Multi-sensor anomalous change detection in remote sensing imagery

Combining multiple satellite remote sensing sources provides a far richer, more frequent view of the earth than that of any single source; the challenge is in distilling these petabytes of heterogeneous sensor imagery into meaningful characterizations of the imaged areas. Meeting this challenge requires effective algorithms for combining multi-modal imagery over time to identify subtle but real changes among the intrinsic data variation. Here, we implement a joint-distribution framework for multi-sensor anomalous change detection (MSACD) that can effectively account for these differences in modality, and does not require any signal resampling of the pixel measurements. This flexibility enables the use of satellite imagery from different sensor platforms and modalities. We use multi-year construction of the SoFi Stadium in California as our testbed, and exploit synthetic aperture radar imagery from Sentinel-1 and multispectral imagery from both Sentinel-2 and Landsat 8. We show results for MSACD using real imagery with implanted, measurable changes, as well as real imagery with real, observable changes, including scaling our analysis over multiple years.

47 OTHER INSTRUMENTATION↗

Quantification of Off-Channel Inundated Habitat for Pacific Chinook Salmon ( Oncorhynchus tshawytscha ) along the Sacramento River, California, Using Remote Sensing Imagery

Off-channel areas are one of the most impacted aquatic habitats by humans globally, as extensive agricultural and urban development has limited them to roughly 10% of historical extent. This is also true for California’s Sacramento River Valley, where historically frequent widespread inundation has been reduced to a few off-channel water bodies along the mid-Sacramento River. This remaining shallow-water habitat provides crucial ecological benefits to multiple avian and fish species, but especially to floodplain-adapted species such as Chinook salmon (Oncorhynchus tshawytscha). Characterizing spatiotemporal off-channel dynamics, including inundation extent and residence time, is fundamental to better understanding the intrinsic value of such habitats and their potential to support recovery actions. Remote sensing techniques have been increasingly used to map surface water at regional and local scales, with improved resolutions. As such, this study maps off-channel inundation areas and describes their temporal dynamics by analyzing pixel-based time- series of multiple water indices, modified Normalized Difference Water Index (mNDWI) and the Automated Water Extraction Index (AWEI), generated from LandSat-8 and Sentinel-2 data between 2013–2021. Quantified off-channel area was similar with each water index and method used, but improved performance was associated with Sentinel-2 products and AWEI index to identify wetted areas under lower mainstem discharges. Results indicate an uneven distribution of off-channel habitat in the study area, with limited inundated areas in upstream reaches (<16% of total off-channel area for greater flows). In addition, much less habitat exists for flows under 400 m 3 /s, an important migration cue for endangered winter-run Chinook salmon, limiting juvenile access to areas with enhanced rearing conditions. Off-channel habitat residence times averaged between 7 and 16 days, primarily defined by the rate of receding flows, with rapid flow recession providing marginal off-channel habitat. This study shows reasonable performance of moderate resolution LandSat-8 and Sentinel-2 remote sensing imagery to characterize shallow-water inundated habitat in higher-order rivers, and as a method to inform restoration and native fish recovery efforts.

54 ENVIRONMENTAL SCIENCES↗

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗

Assessing the Impacts of Extreme Weather Events on Photovoltaic Installations Using Remote Sensing Imagery

In this study, we analyze poststorm satellite imagery to assess solar photovoltaic (PV) damage for over 11,300 systems following a catastrophic hailstorm in Austin, TX, in September 2023, which produced softball‐sized hail and for over 1500 systems across Puerto Rico and the US Virgin Islands after Hurricanes Irma and Maria in September 2017. Findings show that approximately 5.5% of identified PV sites were damaged in the hailstorm and approximately 17% of PV installations were damaged after the hurricanes. A weak correlation between hurricane wind gust speed and percent site damage was determined, with installation practices playing a heavy role in site resilience. Additionally, we show that newer module vintages are more susceptible to hail damage than older modules, possibly due to a convergence of larger size modules, decreased frame dimensions, and decreased front glass thickness but more research is needed. For hail sizes of 60 mm or greater, consistent hail damage is sustained by PV installations, regardless of system configuration.

14 SOLAR ENERGY↗

UAV remote sensing imagery - Miscanthus trials 2020 - Energy Farm - UIUC

Aerial imagery utilized as input in the manuscript "Deep convolutional neural networks exploit high spatial and temporal resolution aerial imagery to predict key traits in miscanthus" . Data was collected over M. Sacchariflorus and Sinensis breeding trials at the Energy Farm, UIUC in 2020. Flights were performed using a DJI M600 mounted with a Micasense Rededge multispectral sensor at 20 m altitude around solar noon. Imagery is available as tif file by field trial and date (10). The post-processing of raw images into orthophoto was performed in Agisoft Metashape software. Each crop surface model and multispectral orthophoto was stacked into an unique raster stack by date and uploaded here. Each raster stack includes 6 layers in the following order: Layer 1 = crop surface model, Layer 2 = Blue, Layer 3 = Green, Layer 4 = Red, Layer 5 = Rededge, and Layer 6 = NIR multispectral bands. Msa raster stacks were resampled to 1.67 cm spatial resolution and Msi raster stacks were resampled to 1.41 cm spatial resolution to ease their integration into further analysis. 'MMDDYYYY' is the date of data collection, 'MSA' is M. Sacchariflorus trial, 'MSI' is Miscanthus Sinensis trial, 'CSM' is crop surface model layer, and 'MULTSP' are the five multispectral bands.

bioenergy↗

A Weakly-Supervised, Multitask Deep Learning Framework for Shadow Mitigation in Remote Sensing Imagery

We propose a weakly-supervised, multitask framework for training a convolutional neural network to solve the problem of cloud shadow mitigation given only cloud and shadow masks as labels. The network minimizes the Wasserstein distance between shadows and their proximal sunlit neighborhoods, generating a supervisory signal directly from within the input image. We extract further utility from the shadow mask through multitask learning by introducing an auxiliary task of shadow segmentation. Our approach is advantageous since it performs mitigation in an end-to-end framework which requires only a shadowed image for inference. We apply this process to the Landsat 8 OLI SPARCS validation data set and demonstrate plausible results.

Couwenhoven, Scott↗

Identification and Analysis of Backwater Nursery Habitats in the Middle Green River, Utah, during 2014, 2017, and 2018 Using High-Resolution Optical Remotely Sensed Imagery

Low-velocity channel-margin habitats, known as backwaters, serve as important nursery habitats for the endangered Colorado pikeminnow (Ptychocheilus lucius) in the middle Green River between Jensen and Ouray, Utah. The backwater synthesis report for the 1987–2013 period (Grippo et al. 2017) reported a decreased number of backwaters per river mile (RM) and an increased mean backwater size across the middle Green River. Information about backwaters is critical for understanding habitat characteristics that are important for Colorado pikeminnow recruitment. The goal of this study was to determine backwater number and size in the middle Green River using high-resolution imagery for 2018 to add to our understanding of long-term trends of backwater habitat availability across the reach. For comparative analysis of backwater habitats between 2004 and 2018, information for 2004, 2006, 2013, 2014 and 2017 from our previous studies was also utilized (Grippo et al. 2017; Hamada et al. 2017, 2021, and in review). Across the 2004, 2006, 2013, 2014, 2017, and 2018 study years, mean daily flow at the Jensen gage during image collection ranged from 1,220 cfs (2004) to 2,940 cfs (2014), which was approximately 140% greater in 2014 than in 2004. The number of delineated backwaters ranged from 88 (2013) to 245 (2017), and total backwater area ranged from 118,938 m 2 (2006) to 209,611 m 2 (2014). Mean backwater size ranged from 822 m 2 (2017) to 1,508 m 2 (2018), but there was considerable variability in backwater size for each of the study years. Backwater areas differed significantly among the study years based on a Kruskal-Wallis Rank Sum test ( P < 0.001). Pairwise Wilcoxon tests indicated that the median backwater areas in 2017 and 2014 were significantly lower than in the other sample years ( P ≤ 0.05), even though these years had the highest total backwater area. 2018 had the greatest median backwater area, although the distribution of backwater area values was not statistically different from backwater areas measured in 2013 ( P > 0.05). These two years also had the lowest maximum backwater area values among all sample years. The distribution of backwater area values was not significantly different ( P > 0.05) among the 2006, 2004, and 2013 sample years.

54 ENVIRONMENTAL SCIENCES↗

Interactive Rotated Object Detection for Novel Class Detection in Remotely Sensed Imagery

In this paper we propose IRTR-DETR an Interactive and Real-Time Rotated DEtection TRansformer that extends IRTDETR to predict rotated bounding boxes. IRTR-DETR maintains the Human-In-The-Loop (HIL) workflow of IRTDETR but introduces rotation-aware heads for improved detection of objects with arbitrary orientations. Similarly to IRTDETR IRTR-DETR can be trained with a small labeled sample set in an interactive setting but we show that it can also be pretrained on related but not identical data--such as a building damage dataset--before being applied to tasks like identifying buildings under construction. We demonstrate the efficacy of our approach on the publicly available Tiny-DOTA and xBD dataset as well as two study-cases on proprietary datasets of greenhouses and houses under construction ("waffle homes"). Detecting greenhouses is highly relevant in the context of damage assessment while "waffle homes" aid understanding typical floorplans and building codes in different areas both thereby supporting population modeling emergency response and policy planning. Our method outperforms the state of the art in interactive rotated object detection on the Tiny-DOTA dataset by 5.7 percent and improves upon the non interactive RTDETR by 7.85 to 19.39 percent (depending on the number of provided samples) while maintaining its real-time efficiency.

Burges, Marvin [ORNL] (ORCID:0000000312690769)↗

Assessing the Consistency of Estimated Ground Cover Fractions between the BLM AIM Method and Optical Remote Sensing Method

Since 2012, Argonne National Laboratory (Argonne) has supported the Bureau of Land Management (BLM) in developing remote sensing methodologies for long-term environmental monitoring of Palo Verde Mesa in eastern Riverside County, California, including methods for: detailed mapping of ephemeral streams, estimating fractional cover of desert-land surface components (e.g., trees, shrubs, litters, and bare ground), evaluating erosion risk or land stability, and characterizing vegetation alliances using spatial structure and geostatistical approaches. These studies showed the promise of remote sensing for monitoring changes in desert landscapes by providing information that would be difficult to obtain through field surveys. During this time the BLM has also worked to establish long-term monitoring protocols and compiled field-observation data collected using standardized protocols from the Assessment, Inventory, and Monitoring (AIM) strategy. The AIM data can be compared to data derived from remote sensing methods to evaluate their relative operational utility in monitoring landscape change. If ground cover estimated using remotely sensed imagery is comparable to AIM ground cover estimates, then remote sensing can be used to monitor whether any land cover change in desert landscapes may be related to solar energy development. Therefore, the goal of this study was to determine the consistency in ground cover estimates between AIM data and those derived from publicly- available remotely sensed imagery, such as that available through the U.S. Department of Agriculture, National Agricultural Imagery Program (NAIP), to examine feasibility of a remote sensing method for complementing AIM monitoring. Based on the image analysis in this study, we also provide recommendations for how small unmanned aerial system (sUAS) data may be used to complement BLM’s AIM data and NAIP imagery for future vegetation monitoring. The ground cover types we originally planned to investigate were trees, shrubs, and bare ground. However, the small sample size and a limited range of cover fraction of trees and shrubs in the AIM dataset (e.g., 33 samples with a maximum shrub cover of 18%, 14 samples with a maximum tree cover of 17%) did not allow for performing a meaningful evaluation for the remote sensing approach. Therefore, we conducted the study focusing on bare ground, foliar, and rock cover, all of which are indicators reported in the AIM remote sensing dataset.

47 OTHER INSTRUMENTATION↗

Multiscale assessment of land surface phenology from harmonized Landsat 8 and Sentinel-2, PlanetScope, and PhenoCam imagery

As the spatial and temporal resolution of remotely sensed imagery has improved over the last four decades, algorithms for monitoring and mapping seasonal changes in surface properties have evolved rapidly. Most recently, the availability of daily PlanetScope imagery has created new opportunities for monitoring the land surface phenology (LSP) of terrestrial ecosystems at high spatial resolution. However, the quality and value of LSP information from PlanetScope imagery have not been systematically examined. In this paper, we evaluate the character and quality of LSP information derived from PlanetScope by comparing time series of vegetation indices and LSP metrics from PlanetScope to corresponding time series and LSP metrics derived from Harmonized Landsat 8 and Sentinel-2 (HLS) imagery and PhenoCams at six sites that span a diverse range of land cover types and climate. Results show that vegetation index time series from all three data sources show high temporal correlation, and LSP metrics derived from HLS, PlanetScope, and PhenoCam show high agreement with negligible bias. Semi-variograms for phenometrics estimated from PlanetScope imagery indicate that the majority of spatial variance captured in PlanetScope phenometrics occurs well below the spatial resolution HLS imagery. At the same time, LSP metrics from HLS are most strongly correlated with the 50–75% quantiles of 3 m LSP metrics from PlanetScope. This indicates that HLS captures the average phenology at sub-pixel scale captured in PlanetScope imagery. Here, our results represent the first comprehensive comparison of LSP metrics estimated from PlanetScope and publicly available moderate spatial resolution imagery, and provide insights regarding: (1) the quality and character of LSP metrics derived from HLS and PlanetScope; and (2) the relative merits and trade-offs associated with the use of each data source for LSP studies.

54 ENVIRONMENTAL SCIENCES↗

BlueHat

"Bluehat" is a collection of python routines to facilitate the analysis of spectral (multispectral and hyperspectral) remote sensing imagery, with an emphasis on various kind of target detection. The package provides collections of utilities that developers can use in producing algorithms for specific target detection scenarios. Although "bluehat" is mostly expected to be used for remote sensing imagery (which often comes from satellite sensors), and although early versions of "bluehat" were used to design algorithms that were then rewritten for onboard processing; "bluehat" itself is not not specially designed for space and/or satellite application.

Theiler, James↗

Segmenting water and shadow regions within WorldView imagery using local binary patterns

Many shadow detection algorithms pertaining to remotely sensed imagery exist. Several of these algorithms exploit the spectral characteristics of shadows within imagery to identify shaded regions. However, these algorithms can have problems when water is also present within the imagery because water shares similar spectral characteristics with shadows. Many of these algorithms are applied to small image subsets instead of the image as a whole and frequently are applied to urban environments that require additional use of the normalized difference water index or other features to affect the removal of water from the shadow mask. This diversity of the image scene content coupled with the complexity and wide variety of environmental conditions that satellite imagery can acquire makes reliably separating shadow and water within larger images a complex problem. Thresholding various spectral indices to produce segmentation maps can be challenging when large, complex, and often imbalanced scenes are captured, which may require manual adjustment of algorithmic parameters for different image areas. Here, we present a methodology that makes use of the near-infrared channel using a watershed segmentation algorithm, local binary pattern measurements, and a support vector machine to classify shadow and water within a full WorldView scene. Results are promising with initial accuracies above 97% for both shadow and water.

47 OTHER INSTRUMENTATION↗

Introducing SpaceNet 9 - Cross-Modal Satellite Imagery Registration for Natural Disaster Responses

Computer vision algorithms are increasingly leveraged to accelerate geospatial analysis for disaster response and recovery. As the diversity of remote sensing imagery grows with optical, SAR, and other modalities, a perquisite for analytics is cross-modal image registration. There is a high potential to harness computer vision for this pre-processing requirement toward enabling downstream analytics such as heterogeneous change detection, automated feature extraction, and data fusion. Advancement in these areas has the potential to simplify data wrangling tasks and further accelerate disaster response timelines. The SpaceNet 9 challenge (launching in mid-2024) focuses on addressing the cross-modal image registration problem and demonstrating the utility of such modules on earthquake impacted scenarios. This paper describes the motivation for the SpaceNet 9 and provides a first overview of the dataset, the baseline algorithm, and implications for seeking cross-modal image registration in Earth observation. Code is available at https://github.com/SpaceNetChallenge/SpaceNet9.

Hansch, Ronny↗