SEARCH · Search NASA

Results for “remote sensing (RS)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

17 records

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Model Assumptions and Data Characteristics: Impacts on Domain Adaptation in Building Segmentation

Studies on domain adaptation (DA) for remote sensing (RS) imagery analysis lack consistency in selection and description of evaluation scenarios. Without properly characterizing datasets, model assumptions, and evaluation scenarios, it is difficult to objectively compare DA methods and reach conclusions about their suitability across different applications. With this motivation, this work seeks to empirically assess to which extent the interaction between data characteristics and model assumptions influences the effectiveness of DA methods. Using the widely explored task of building footprint segmentation as a case study, we perform a large-scale study across over 200 DA scenarios that include variations across view angles, areas observed, and sensors used for data acquisition. Rather than adopting different model architectures or optimization criteria, we contrast the performances of two DA methods based on adversarial learning that differ only in their assumptions about source and target domains. Informed by metadata and data characteristics unveiled using traditional computer vision (CV) techniques as well as pretrained deep models, we provide a detailed meta-analysis of experiments highlighting the importance of accurately considering data assumptions for DA in RS segmentation tasks. As demonstrated by a “cherry-picking” exercise, different claims regarding which model is best could be made by selecting different subsets of evaluation scenarios. While well-calibrated assumptions can be beneficial, mismatching assumptions can lead to negative biases in DA applications. Furthermore, this study intends to motivate the community toward more consistent evaluation protocols while providing recommendations and insights toward creating novel benchmark datasets, documenting data characteristics, application-specific knowledge, and model assumptions.

42 ENGINEERING↗

DOE OSTI2020

Multi-Temporal Predictive Modelling of Sorghum Biomass Using UAV-Based Hyperspectral and LiDAR Data

High-throughput phenotyping using high spatial, spectral, and temporal resolution remote sensing (RS) data has become a critical part of the plant breeding chain focused on reducing the time and cost of the selection process for the “best” genotypes with respect to the trait(s) of interest. In this paper, the potential of accurate and reliable sorghum biomass prediction using visible and near infrared (VNIR) and short-wave infrared (SWIR) hyperspectral data as well as light detection and ranging (LiDAR) data acquired by sensors mounted on UAV platforms is investigated. Predictive models are developed using classical regression-based machine learning methods for nine experiments conducted during the 2017 and 2018 growing seasons at the Agronomy Center for Research and Education (ACRE) at Purdue University, Indiana, USA. The impact of the regression method, data source, timing of RS and field-based biomass reference data acquisition, and the number of samples on the prediction results are investigated. R2 values for end-of-season biomass ranged from 0.64 to 0.89 for different experiments when features from all the data sources were included. Geometry-based features derived from the LiDAR point cloud to characterize plant structure and chemistry-based features extracted from hyperspectral data provided the most accurate predictions. Evaluation of the impact of the time of data acquisition during the growing season on the prediction results indicated that although the most accurate and reliable predictions of final biomass were achieved using remotely sensed data from mid-season to end-of-season, predictions in mid-season provided adequate results to differentiate between promising varieties for selection. The analysis of variance (ANOVA) of the accuracies of the predictive models showed that both the data source and regression method are important factors for a reliable prediction; however, the data source was more important with 69% significance, versus 28% significance for the regression method.

09 BIOMASS FUELS↗

DOE OSTI2022

Tracking the environmental impacts of ecological engineering on coastal wetlands with numerical modeling and remote sensing

Coastal wetlands are the most valuable ecosystems on the earth but facing severe degradation and losses owing to climate change and anthropogenic activities. Many ecological engineering projects (EEP) have been conducted to mitigate the degradation of coastal wetlands. However, the geomorphological impacts of EEP on coastal wetlands have not been well documented. In this study, a method employed a process-based hydrodynamic model and remote sensing (RS) was developed to evaluate the impacts of EEP on the geomorphological change of a prototype Ramsar site. Results demonstrated that RS has great potential in improving the quality of bathymetry data for the numerical model with a decrease of RMSE from 0.52 m to 0.3 m. It also showed good capacity in trend detection of geomorphological change spatially. Results showed the Chongming Dongtan wetland experienced erosion with an annual rate of -0.035 m/yr from 2013 to 2016 after the implementation of EEP. The deposition rate changed significantly in the area within 200 m of the EEP. It is found that the EEP modified the composition of vegetation, sediment transportation, as well as substrate stability, affecting the geomorphological change of coastal wetlands. It is suggested that the EEP with moderate anthropogenic disturbance is a direct and effective way to recover the coastal habitats for waterbirds. However, the modification of the coastal wetland ecosystem by EEP will lead to the potential vulnerability to global climate change. Therefore, how to mitigate the advantages and disadvantages of the EEP is needed to be further studied to find a more sustainable way for coastal management.

geomorphological change, coastal wetlands, Ecologi↗

DOE OSTI2022

The Geothermal Artificial Intelligence for geothermal exploration

Exploration of geothermal resources involves analysis and management of a large number of uncertainties, which makes investment and operations decisions challenging. Remote Sensing (RS), Machine Learning (ML) and Artificial Intelligence (AI) have potential in managing the challenges of geothermal exploration. In this paper, we present a methodology that integrates RS, ML and AI to create an initial assessment of geothermal potential, by resorting to known indicators of geothermal areas namely mineral markers, surface temperature, faults and deformation. We demonstrated the implementation of the method in two sites (Brady and Desert Peak geothermal sites) that are close to each other but have different characteristics (Brady having clear surface manifestations and Desert Peak being a blind site). Here, we processed various satellite images and geospatial data for mineral markers, temperature, faults and deformation and then implemented ML methods to obtain pattern of surface manifestation of geothermal sites. We developed an AI that uses patterns from surface manifestations to predict geothermal potential of each pixel. We tested the Geothermal AI using independent data sets obtaining accuracy of 92-95%; also tested the Geothermal AI trained on one site by executing it for the other site to predict the geothermal / non-geothermal delineation, the Geothermal AI performed quite well in prediction with 72-76% accuracy.

15 GEOTHERMAL ENERGY↗

DOE OSTI2025

Can Large‐Scale Satellite Products Track the Effects of Atmospheric Dryness and Soil Water Deficit on Ecosystem Productivity Under Droughts?

Drought stress, characterized by increased vapor pressure deficit (VPD) and soil water content (SWC) deficit, significantly impacts ecosystem productivity (GPP). Accurately assessing these factors in satellite remote sensing (RS) GPP products is crucial for understanding the large-scale ecological consequences of drought. However, the accuracy of RS GPP in capturing the effects of VPD and SWC deficit, compared to EC flux data, remains under-investigated. Here we evaluated 10 RS GPP products and their mean (RSmean) concerning VPD and SWC deficit across diverse ecosystems along a dryness gradient. Our results revealed that RSmean and individual products generally capture the GPP response direction (VPD: mainly negative, SWC deficit: mixed positive/negative) but consistently misestimate the absolute GPP changes. This discrepancy is ecosystem-specific and consistent across all RS products, underscoring the need to enhance RS products to better account for ecosystem-specific VPD effects and non-linear SWC deficit responses, thereby improving RS GPP accuracy under drought.

Wang, Xiaorong [Univ. of Hong Kong, Pokfulam (Hong↗

DOE OSTI2023

Scaling Automatic Vector Data Alignment to Satellite Imagery

Given the tremendous volume of accessible Earth Observation (EO) data, there is a need to develop scalable Geospatial Artificial Intelligence (GeoAI) solutions for time-sensitive applications. Scalability in this context refers to rapidly processing large-scale EO data using high performance computing resources. Accurate mapping of the built environment from remote sensing (RS) imagery has been one of the crucial components in GeoAI workflows for a wide spectrum of humanitarian applications. Derived vector data of built environment is often leveraged for disaster preparedness and response activities. However, factors such as differences in ortho-rectification, atmospheric conditions and human error, results in spatial misalignment between vector data and the timely available RS imagery. Model training for downstream tasks such as object detection, change analysis, etc., is negatively impacted due to such spatial misalignment. Although there has been progress towards automatic alignment of vector data, the lack of scalability remains an open research challenge. This paper proposes to leverage parallel computing to optimize an automatic vector data alignment workflow. It further employs CPU-level multi-core parallelism for improving the performance of the workflow for scalable built environment mapping. We report observations and discuss findings from the preliminary experiments performed on the Summit Supercomputer.

Potnis, Abhishek↗

DOE OSTI2025

Vision Foundation Models in Remote Sensing: A survey

Artificial intelligence (AI) technologies have profoundly transformed the field of remote sensing (RS), revolutionizing data collection, processing, and analysis. Traditionally reliant on manual interpretation and task-specific models, RS research has been significantly enhanced by the advent of foundation models (FMs)—large-scale pretrained AI models capable of performing a wide array of tasks with unprecedented accuracy and efficiency. This article provides a comprehensive survey of FMs in the RS domain. We categorize these models based on their architectures, pretraining datasets, and methodologies. Through detailed performance comparisons, we highlight emerging trends and the significant advancements achieved by those FMs. Additionally, we discuss technical challenges, practical implications, and future research directions, addressing the need for high-quality data, computational resources, and improved model generalization. Our research also finds that pretraining methods, particularly self-supervised learning (SSL) techniques like contrastive learning (CL) and masked autoencoders (MAEs), remarkably enhance the performance and robustness of FMs. This survey aims to serve as a resource for researchers and practitioners by providing a panorama of advances and promising pathways for the continued development and application of FMs in RS.

data models↗

DOE OSTI2024

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D labs. In this work, we pair high-performance computing resources including Frontier supercomputer, America's first exascale system, and high-resolution optical RS data to pretrain billion-scale FMs. Our study assesses performance of different pretrained variants of vision Transformers across image classification, semantic segmentation and object detection benchmarks, which highlight the importance of data scaling for effective model scaling. Moreover, we discuss construction of a novel TIU pretraining dataset, model initialization, with data and pretrained models intended for public release. By discussing technical challenges and details often lacking in the related literature, this work is intended to offer best practices to the geospatial community toward efficient training and benchmarking of larger FMs.

Ambrozio Dias, Philipe↗

DOE OSTI2021

Building Intelligent Cyberinfrastructure to Learn Iteratively from both Observations and Models for Understanding Watershed Dynamics

Focal Area(s): Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI-driven model/component/parameterization selection). Science Challenge: Watershed processes, such as the fate and transport of sediment, carbon and nutrients across landscapes and their fluxes to water bodies (e.g., streams, rivers and lakes), have important implications for global and regional carbon and nutrient dynamics, biogeochemical functioning of terrestrial ecosystems, and soil functions. The magnitude of lateral surface/subsurface transport and fluxes of sediment, carbon and nutrients are key factors controlling the vulnerability of watersheds to climate extremes such as droughts, wildfires, and floods. Recent field observations and other scientific evidence suggest that the magnitudes of lateral transport and fluxes of sediment, carbon and nutrients are governed primarily by the spatial and vertical heterogeneity of landscape and soil properties and by pedogenic processes. However, the current generation of land surface and watershed models do not mechanistically couple the terrestrial and hydrologic systems, nor do they represent sufficiently the spatial and vertical heterogeneity of land surface and subsurface properties. On the other hand, increasing complexity of coupled watershed and land surface models requires more data to parameterize, calibrate and validate. Remote sensing (RS) provides a means to acquire spatial data and characterize their heterogeneity at the watershed scale, overcoming a major limitation associated with conventional point measurements. To improve the representation of land-surface and surface/subsurface process coupling and sub-grid heterogeneity in watershed models, it is essential to build our predictive understanding by learning from both the multi-scale multi-process modeling and diverse multi-scale data while leveraging powerful artificial intelligence (AI) techniques.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Automatic Image Point Matching

Sparse Image Point Matching (SIPM) is a foundational technology for photo triangulation, structure from motion (SfM), Simultaneous Location and Mapping (SLAM), and data fusion. The goal of the matching is to automatically generate sets of image coordinates that identify the same feature across images. Ideally, the process should be robust to lighting, scale, perspective, and modality changes. The scope of the image matching topic in the field of remote sensing (RS) is enormous because of the variety of collection platforms, modalities, sensor types, applications, and subjects. In this work, we report the history of and assess the state of the art of visible-spectrum (panchromatic and color) image matching of the Earth’s surface. Work specific to large-format images (LFI) (e.g., metric aerial cameras and Earth-observing satellites) will be highlighted. However, the state of the art in this century will mostly be traced through machine vision research and benchmarks because research specific to LFI is rare.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Mapping Vegetation at Species Level with High-Resolution Multispectral and Lidar Data Over a Large Spatial Area: A Case Study with Kudzu

Mapping vegetation species is critical to facilitate related quantitative assessment, and mapping invasive plants is important to enhance monitoring and management activities. Integrating high-resolution multispectral remote-sensing (RS) images and lidar (light detection and ranging) point clouds can provide robust features for vegetation mapping. However, using multiple sources of high-resolution RS data for vegetation mapping on a large spatial scale can be both computationally and sampling intensive. Here, we designed a two-step classification workflow to potentially decrease computational cost and sampling effort and to increase classification accuracy by integrating multispectral and lidar data in order to derive spectral, textural, and structural features for mapping target vegetation species. We used this workflow to classify kudzu, an aggressive invasive vine, in the entire Knox County (1362 km2) of Tennessee (U.S.). Object-based image analysis was conducted in the workflow. The first-step classification used 320 kudzu samples and extensive, coarsely labeled samples (based on national land cover) to generate an overprediction map of kudzu using random forest (RF). For the second step, 350 samples were randomly extracted from the overpredicted kudzu and labeled manually for the final prediction using RF and support vector machine (SVM). Computationally intensive features were only used for the second-step classification. SVM had constantly better accuracy than RF, and the producer’s accuracy, user’s accuracy, and Kappa for the SVM model on kudzu were 0.94, 0.96, and 0.90, respectively. SVM predicted 1010 kudzu patches covering 1.29 km2 in Knox County. We found the sample size of kudzu used for algorithm training impacted the accuracy and number of kudzu predicted. The proposed workflow could also improve sampling efficiency and specificity. Our workflow had much higher accuracy than the traditional method conducted in this research, and could be easily implemented to map kudzu in other regions as well as map other vegetation species.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Remote-sensing detectability of airborne Arctic dust

Remote-sensing (RS)-based estimates of Arctic dust are oftentimes overestimated due to a failure in separating out the dust contribution from that of spatially homogeneous clouds or low-altitude cloud-like plumes. A variety of illustrations are given with a particular emphasis on questionable claims of using brightness temperature differences (BTDs) as a signature indicator of Arctic dust transported from mid-latitude deserts or generated by local Arctic sources. While there is little dispute about the presence of both Asian and local dust across the Arctic, the direct RS detectability of airborne dust, as ascribed to satellite (MODIS and AVHRR) measurements of significantly negative brightness temperature differences at 11 and 12 µm (BTD 11–12 ), has been misrepresented in certain cases. While it is difficult to account for all examples of strongly negative BTD 11–12 values in the Arctic, it is unlikely that airborne dust plays a significant role. One much more likely contributor would be water clouds in the Arctic inversion layer. The RS detectability of the impact of Arctic dust (notably due to Arctic dust from local sources) can, however, be of significance. Sustained dust deposition can substantially decrease (visible to shortwave IR) snow and ice reflectance albedo (pan-chromatic reflectance) and the signal measured by satellite sensors. Significantly negative BTD 11–12 values would, however, only represent a limited area near the drainage basin sources according to our event-level case studies. The enhanced ice-nucleating particle (INP) role of local Arctic dust can, for example, induce significant changes in the properties of low-level mixed-phase clouds (cloud optical depth changes <~ 1) that can readily be detected by active and passive RS instruments. It is critical that the distinction between the RS detectability of airborne Arctic dust versus the RS detectability of the impacts of that dust be understood if we are to appropriately parameterize, for example, the radiative forcing influence of dust in this climate-sensitive region.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Convolutional Neural Networks Based Remote Sensing Scene Classification under Clear and Cloudy Environments

Remote sensing (RS) scene classification has wide applications in the environmental monitoring and geological survey. In the real-world applications, the RS scene images taken by the satellite might have two scenarios: clear and cloudy environments. However, most of existing methods did not consider these two environments simultaneously. In this paper, we assume that the global and local features are iscriminative in either clear or cloudy environments. Many existing Convolution Neural Networks (CNN) based models have made excellent achievements in the image classification, however they somewhat ignored the global and local features in their network structure. In this paper, we propose a new CNN based network (named GLNet) with the Global Encoder and Local Encoder to extract the discriminative global and local features for the RS scene classification, where the constraints for inter-class dispersion and intra-class compactness are embedded in the GLNet training. The experimental results on two publicized RS scene classification datasets show that the proposed GLNet could achieve better performance based on many existing CNN backbones under both clear and cloudy environments.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2023

An Agenda for Multimodal Foundation Models for Earth Observation

Archives of remote sensing (RS) data are increasing swiftly as new sensing modalities with enhanced spatiotemporal resolution become operational. While promising new breakthroughs, the sheer volume of RS archives stretches the limits of human analysts and existing AI tools, as most models are: i) limited to single data modalities; ii) task-specific; iii) heavily reliant on labeled data. The emerging Foundation Models (FMs) have the potential to address these limitations. Trained on vast unlabeled datasets through self-supervised learning, FMs enable generic feature extraction that facilitate specialization to a wide variety of downstream tasks. This paper describes a vision towards an FM for multimodal Earth Observation data (FM4EO), discussing key building blocks and open challenges. We put particular emphasis on multimodal reasoning, a topic underexplored in EO. Our ultimate goal is a practical path toward FM4EO with capacity to unlock breakthroughs in few-shot learning scenarios, multimodal geographic knowledge integration, synthesis, and hypothesis generation.

Ambrozio Dias, Philipe↗

DOE OSTI2022

What lies beneath: Vertical temperature heterogeneity in a Mediterranean woodland savanna

As the availability of satellite and airborne thermal infrared remote sensing (TIR-RS) data increases and their spatial, temporal, and spectral resolutions improve, researchers are finding diverse applications for TIR-RS measurements. TIR-RS is now commonly applied in regional- and continental-scale analyses, such as those focused on fire and surface energy balance. However, its application lags in plant physiology and ecology, for which a finer-scale understanding of plant canopy temperatures would be useful to elucidate plant water dynamics, for example. In particular, while methods to disaggregate TIR-RS pixels in horizontal space have advanced, possible vertical stratification of plant canopy temperature and its implications for understanding the correspondence between TIR-RS and finer-scale, field-based thermal measurements (e.g. made with a thermal camera) remain unexplored. Here, we use data from a thermal camera deployed concurrently with the recent ECOSTRESS mission to quantify vertical temperature gradients within tree canopies and temperatures of over- vs. under-story plants in a Mediterranean woodland savanna. We then leverage diverse ancillary data to maximize the geometric comparability of ECOSTRESS and thermal camera measurements, in order to assess the extent to which the two forms of thermal measurements correspond. Specifically, we ask: (1) What are the patterns of intra-canopy and over- vs. under-story vertical temperature in a Mediterranean woodland savanna?, and (2) How can vertically-resolved, but spatially-limited field-based temperature measurements be reconciled with spatially-extensive, but surface-only, temperature measurements of a space-borne remote sensor? Further, we found consistent patterns of vertical thermal heterogeneity both within tree canopies and between ecosystem over- and under-stories. The daytime difference between the top and bottom thirds of blue oak canopies was, on average, 0.48 ° C – and sometimes several times larger. Notably, canopy tops are cooler, likely associated with the under-story grass reaching daytime temperatures often exceeding over-story temperatures by 10° C. Given the consistency of the intra-canopy temperature gradients, we expected the ECOSTRESS sensor would be in better agreement with camera measurements of canopy tops than bulk canopies or canopy bottoms. However, within-canopy gradients were overwhelmed by other sources of disagreement between the measurements, in part associated with upscaling camera measurements across space. Overall, thermal camera and ECOSTRESS measurements were largely in agreement at night (pixel RMSE = 1.1°C), but they were more divergent during times of low (but >0 W/m2) and high incoming solar radiation (daytime pixel RMSE = 3.5°C).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Acoustic Travel-Time Tomography for Wind Energy

New remote sensing technologies for direct observation of the atmospheric flow in the proximity of operating wind turbines are necessary for the advancement of wind turbine design, wind plant control, and the validation of high-fidelity numerical models; fundamental goals of the DOE Wind Energy Technology Office's (WETO's) A2e program. Modern remote sensing technologies for commercial and research applications rely on the backscatter of light or sound waves, which limits spatial and temporal resolution and cannot produce reliable flow estimates near solid bodies or reflective surfaces. Acoustic tomography (AT) is an innovative sensing technology based on fundamental thermodynamic properties of the atmosphere and an inverse algorithm that can reconstruct both velocity and temperature fields within a network of acoustic transducers. AT relies on the direct travel path of acoustic signals between speakers and microphones in the network and can achieve much higher resolutions than conventional backscatter technologies. For wind energy R&D applications, AT represents an extremely economical option over other remote sensing technologies, integrating mature and commonly available acoustic and signal processing hardware. This report is intended as an update on the development of the AT array on the NREL Flatirons Campus (FC) and includes a brief review of the instrumentation, the calibration of equipment, signal processing, and resulting flow field estimates. Designs for future AT systems and applications are detailed in this report, including summaries of new capabilities, engineering and theoretical challenges, and anticipated costs help to outline future directions for AT technology R\&D. The potential for application of AT to utility-scale turbines is also discussed. Investing in the development of the proposed instrument will establish AT as a transformational RS technique that represents a significant advance in measurement instrumentation, enabling new fundamental insights into the structure of the atmospheric boundary layer and supporting applications for wind energy, pollution transport, and resource characterization. AT is also an extremely economical option over other RS instruments, integrating mature and commonly available acoustic and signal processing hardware.

17 WIND ENERGY↗

DOE OSTI2023

Row selection in remote sensing from four-row plots of maize and sorghum based on repeatability and predictive modeling

Remote sensing enables the rapid assessment of many traits that provide valuable information to plant breeders throughout the growing season to improve genetic gain. These traits are often extracted from remote sensing data on a row segment (rows within a plot) basis enabling the quantitative assessment of any row-wise subset of plants in a plot, rather than a few individual representative plants, as is commonly done in field-based phenotyping. Nevertheless, which rows to include in analysis is still a matter of debate. The objective of this experiment was to evaluate row selection and plot trimming in field trials conducted using four-row plots with remote sensing traits extracted from RGB (red-green-blue), LiDAR (light detection and ranging), and VNIR (visible near infrared) hyperspectral data. Uncrewed aerial vehicle flights were conducted throughout the growing seasons of 2018 to 2021 with data collected on three years of a sorghum experiment and two years of a maize experiment. Traits were extracted from each plot based on all four row segments (RS) (RS1234), inner rows (RS23), outer rows (RS14), and individual rows (RS1, RS2, RS3, and RS4). Plot end trimming of 40 cm was an additional factor tested. Repeatability and predictive modeling of end-season yield were used to evaluate performance of these methodologies. Plot trimming was never shown to result in significantly different outcomes from non-trimmed plots. Significant differences were often observed based on differences in row selection. Plots with more row segments were often favorable for increasing repeatability, and excluding outer rows improved predictive modeling. These results support long-standing principles of experimental design in agronomy and should be considered in breeding programs that incorporate remote sensing.

59 BASIC BIOLOGICAL SCIENCES↗