SEARCH · Search NASA
Results for “remote imaging”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
ResSR: A Computationally Efficient Residual Approach to Super-Resolving Multispectral Images
Multispectral imaging (MSI) plays a critical role in material classification, environmental monitoring, and remote sensing. However, MSI sensors typically have wavelength-dependent resolution, which limits downstream analysis. MSI super-resolution (MSI-SR) methods address this limitation by reconstructing all bands at a common high spatial resolution. Existing methods can achieve high reconstruction quality but often rely on spatially-coupled optimization or large learning-based models, leading to significant computational cost and limiting their use in large-scale or time-critical settings. In this paper, we introduce ResSR, a computationally efficient, model-based MSI-SR method that achieves high-quality reconstruction without supervised training or spatially-coupled optimization. Notably, ResSR decouples spectral and spatial processing into two sequential steps. ResSR first computes a spectrally-informed high-resolution estimate of the MSI using singular value decomposition together with a spatially-decoupled approximate forward model. It then applies a residual correction step to restore low-frequency spatial consistency while preserving high-frequency detail recovered by the spectral reconstruction. ResSR achieves comparable or improved reconstruction quality relative to existing MSI-SR methods while being
System Calibration Including Time Delay Estimation for GNSS/INS-Assisted Pushbroom Scanners Onboard UAV Platforms
Unmanned aerial vehicles (UAVs ) equipped with imaging sensors and integrated global navigation satellite system/inertial navigation system (GNSS/INS ) units are used for numerous applications. Deriving reliable 3D coordinates from such UAVs is contingent on accurate geometric calibration, which encompasses the estimation of mounting parameters and synchronization errors. Through a rigorous impact analysis of such systematic errors, this article proposes a direct approach for spatial and temporal calibration (estimating system parameters through a bundle adjustment procedure) of a GNSS/INS -assisted pushbroom scanner onboard a UAV platform. The calibration results show that the horizontal and vertical accuracies are within the ground sampling distance of the sensor. Unlike for frame camera systems, this article also shows that the indirect approach is not a feasible solution for pushbroom scanners due to their limited ability for decoupling system parameters. This finding provides further support that the direct approach is recommended for spatial and temporal calibration of UAV pushbroom scanner systems.
Effectiveness of Deep Learning Trained on SynthCity Data for Urban Point-Cloud Classification
3D object recognition is one of the most popular areas of study in computer vision. Many of the more recent algorithms focus on indoor point clouds, classifying 3D geometric objects, and segmenting outdoor 3D scenes. One of the challenges of the classification pipeline is finding adequate and accurate training data. Hence, this article seeks to evaluate the accuracy of a synthetically generated data set called SynthCity, tested on two mobile laser-scan data sets. Varying levels of noise were applied to the training data to reflect varying levels of noise in different scanners. The chosen deep-learning algorithm was Kernel Point Convolution, a convolutional neural network that uses kernel points in Euclidean space for convolution weights.
Detecting Arsenic Contamination Using Satellite Imagery and Machine Learning
Arsenic, a potent carcinogen and neurotoxin, affects over 200 million people globally. Current detection methods are laborious, expensive, and unscalable, being difficult to implement in developing regions and during crises such as COVID-19. This study attempts to determine if a relationship exists between soil’s hyperspectral data and arsenic concentration using NASA’s Hyperion satellite. It is the first arsenic study to use satellite-based hyperspectral data and apply a classification approach. Four regression machine learning models are tested to determine this correlation in soil with bare land cover. Raw data are converted to reflectance, problematic atmospheric influences are removed, characteristic wavelengths are selected, and four noise reduction algorithms are tested. The combination of data augmentation, Genetic Algorithm, Second Derivative Transformation, and Random Forest regression (R 2 =0.840 and normalized root mean squared error (re-scaled to [0,1]) = 0.122) shows strong correlation, performing better than past models despite using noisier satellite data (versus lab-processed samples). Three binary classification machine learning models are then applied to identify high-risk shrub-covered regions in ten U.S. states, achieving strong accuracy (=0.693) and F1-score (=0.728). Overall, these results suggest that such a methodology is practical and can provide a sustainable alternative to arsenic contamination detection.
Energy-resolved fast-neutron radiography using an event-mode neutron imaging detector
Energy-resolved fast-neutron radiography is a powerful non-destructive technique that can be used to remotely measure the quantity and distribution of elements and isotopes in a sample. This is done by comparing the energy-dependent neutron transmission of a sample with the known cross-sections of individual isotopes. The reconstruction of the composition is possible due to the unique features (e.g. resonances) in the cross-sections of individual isotopes. At short-pulsed (≲ 1 ns) neutron sources, such information is accessible via time-of-flight neutron imaging in principle, but requires a detector with nanosecond temporal resolution. Conventional neutron detectors can meet this requirement only by heavily compromising spatial resolution or efficiency. Here, we present a unique approach on fast neutron resonance radiography using a scintillator-based event-mode imaging detector at a short-pulsed neutron source, including first results on spatially mapped resonance profiles using MeV neutrons. The event mode approach applied in the presented detector allows recording of individual neutron interactions with nanosecond precision in time and sub-mm resolution in space. As a result, the entire available neutron energy spectrum can be measured for each pulse. At the same time, the use of a thick scintillator screen and lenses to focus the produced light results in a highly flexible field of view and a high interaction probability in the sensitive volume of the detector.
Satellite solar-induced chlorophyll fluorescence and near-infrared reflectance capture complementary aspects of dryland vegetation productivity dynamics
Mounting evidence indicates dryland ecosystems play an important role in driving the interannual variability and trend of the terrestrial carbon sink. Nevertheless, our understanding of the seasonal dynamics of dryland ecosystem carbon uptake through photosynthesis [gross primary productivity (GPP)] remains relatively limited due in part to the limited availability of long-term data and unique challenges associated with satellite remote sensing across dryland ecosystems. Here, we comprehensively evaluated longstanding and emerging satellite vegetation proxies in their ability to capture seasonal dryland GPP dynamics. Specifically, we evaluated: 1) reflectance-based proxies normalized difference vegetation index (NDVI), soil adjusted vegetation index (SAVI), near infrared reflectance index (NIR v ), and kernel NDVI (kNDVI) from the MODerate resolution Imaging Spectroradiometer (MODIS); and 2) newly available physiologically-based proxy solar-induced chlorophyll fluorescence (SIF) from the TROPOspheric Monitoring Instrument (TROPOMI). As a performance benchmark, we used GPP estimates from a robust network of 21 western United States eddy covariance tower sites that span representative gradients in dryland ecosystem climate and functional composition. We found that NIR v and SIF were the best performing GPP proxies and captured complementary aspects of seasonal GPP dynamics across dryland ecosystem types. NIR v offered better performance than the other proxies across relatively low-productivity, sparsely non-evergreen vegetated sites (R 2 = 0.59 ± 0.13); whereas SIF best captured seasonal dynamics across relatively high-productivity sites, including evergreen-dominated sites (R 2 = 0.74 ± 0.07). Notably, across grass-dominated sites, all reflectance-based proxies (NDVI, SAVI, NIRv and kNDVI) showed significant seasonal bias (hysteresis) that strengthened with the total fraction of woody vegetation cover, likely due to seasonal patterns in woody vegetation reflectance that are unrelated to or decoupled from GPP. In conclusion, future efforts to fully integrate the complementary strengths of NIR v and SIF could significantly improve our understanding and representation of dryland GPP dynamics in satellite-based models.
DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes
By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.
How High to Fly? Mapping Evapotranspiration from Remotely Piloted Aircrafts at Different Elevations
Recent advancements in remotely piloted aircrafts (RPAs) have made frequent, low-flying imagery collection more economical and feasible than ever before. The goal of this work was to create, compare, and quantify uncertainty associated with evapotranspiration (ET) maps generated from different conditions and image capture elevations. We collected optical and thermal data from a commercially irrigated potato (Solanum tuberosum) field in the Wisconsin Central Sands using a quadcopter RPA system and combined multispectral/thermal camera. We conducted eight mission sets (24 total missions) during the 2019 growing season. Each mission set included flights at 90, 60, and 30 m above ground level. Ground reference measurements of surface temperature and soil moisture were collected throughout the domain within 15 min of each RPA mission set. Evapotranspiration values were modeled from the flight data using the High-Resolution Mapping of Evapotranspiration (HRMET) model. We compared HRMET-derived ET estimates to an Eddy Covariance system within the flight domain. Additionally, we assessed uncertainty for each flight using a Monte Carlo approach. Results indicate that the primary source of uncertainty in ET estimates was the optical and thermal data. Despite some additional detectable features at low elevation, we conclude that the tradeoff in resources and computation does not currently justify low elevation flights for annual vegetable crop management in the Midwest USA.
Vegetation Warming Experiment: Landscape-scale digital camera imagery for vegetation phenology, Utqiagvik (Barrow), Alaska, 2018
Images captured using a StarDot NetCam SC phenocamera looking east from the top of the Barrow Environmental Observatory (BEO) Sled Shed, Utqiagvik, Alaska. The camera was installed to remotely monitor plant phenology and operation of the BNL TEST group's ZPW (Zero Power Warming) chambers during the growing season of 2018. Images were captured from early spring (13 April) through to mid fall (18 October). Snowmelt, vegetation growth and senescence, and snow accumulation were captured. Images were uploaded to the BNL FTP server every hour until 16 June, and then every 10 minutes. Files were renamed with the date and time of the image. jpg images have been compressed in *.tar.gz format (7.9 GB). Different fields of view (northeasterly) were also captured using 3 Wingscapes TimelapseCam cameras mounted on a mast on the sled shed. Images were recorded from 21 June to 24 September, 2018, at 30 minute intervals, from 11:00 - 14:30, Alaska daylight time (AKDT, UTC-8). Movie files (.mp4) of each Wingscapes camera dataset. Additional metadata included in *.pdf and *.csv files. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
Projecting Stratocumulus Transitions on the Albedo—Cloud Fraction Relationship Reveals Linearity of Albedo to Droplet Concentrations
Satellite images show solid marine stratocumulus cloud decks (Sc) that break up over the remote oceans. The Sc breakup is initiated by precipitation and is accompanied by a strong reduction in the cloud radiative effect. Aerosol has been shown to delay the Sc breakup by postponing the onset of precipitation, however its climatic effect is uncertain. Here we introduce a new approach that allows us to re-cast currently observed cloud cover and albedo to their counterfactual cleaner world, enabling the first estimate of the radiative effect due to delayed cloud breakup. Using simple radiative approximation, the radiative forcing with respect to pre-industrial times due to delayed Sc breakup is –0.39 W m –2 . The radiative effect changes nearly linearly with aerosol due to the droplet concentration control on the cloud cover, suggesting a potentially accelerated warming if the current trend of reduction in aerosol emissions continues.
Vegetation Warming Experiment: Landscape-scale digital camera imagery for vegetation phenology, Utqiagvik (Barrow), Alaska, 2017
Images captured using a StarDot NetCam SC phenocamera looking east from the top of the Barrow Environmental Observatory (BEO) Sled Shed, Barrow (now Utqiagvik), Alaska. The camera was installed to remotely monitor plant phenology and operation of the BNL TEST group's ZPW (Zero Power Warming) chambers during the growing season of 2017. Images were captured from early spring (24 April) through to late fall (15 November). Snowmelt, vegetation growth and senescence, and snow accumulation were captured. Images were uploaded to the BNL FTP server every 10 minutes. jpg images have been compressed in *.tar.gz format (12.1 GB) and additional information in *.pdf and *.txt files. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
Multi-campaign ship and aircraft observations of marine cloud condensation nuclei and droplet concentrations
In situ marine cloud droplet number concentrations (CDNCs), cloud condensation nuclei (CCN), and CCN proxies, based on particle sizes and optical properties, are accumulated from seven field campaigns: ACTIVATE; NAAMES; CAMP 2 EX; ORACLES; SOCRATES; MARCUS; and CAPRICORN2. Each campaign involves aircraft measurements, ship-based measurements, or both. Measurements collected over the North and Central Atlantic, Indo-Pacific, and Southern Oceans, represent a range of clean to polluted conditions in various climate regimes. With the extensive range of environmental conditions sampled, this data collection is ideal for testing satellite remote detection methods of CDNC and CCN in marine environments. Remote measurement methods are vital to expanding the available data in these difficult-to-reach regions of the Earth and improving our understanding of aerosol-cloud interactions. The data collection includes particle composition and continental tracers to identify potential contributing CCN sources. Several of these campaigns include High Spectral Resolution Lidar (HSRL) and polarimetric imaging measurements and retrievals that will be the basis for the next generation of space-based remote sensors and, thus, can be utilized as satellite surrogates.
OrganiCam
Researchers at Los Alamos have developed OrganiCam, a compact, lightweight laser-induced fluorescence imaging camera and a Raman spectrometer for Mars caves, icy-moon and asteroid surface exploration, and terrestrial sterile laboratory use. It was designed to make remote observations in extreme environments to identify organic molecules and the biosignatures of life. OrganiCam is a bold step in a new direction—space missions need an imager that can “see” (observe and positively identify) organic molecules and potential biosignatures and direct the arm to sample the most promising locations. This ability to clearly see and characterize organic materials is exactly what OrganiCam does. We are seeking a commercialization partner to license the technology or participate in a Cooperative Research and Development Agreement (CRADA) to develop the technology into a commercial ready product for terrestrial applications.
Uncertainty-aware Continuous Implicit Neural Representations for Remote Sensing Object Counting
Many existing object counting methods rely on density map estimation (DME) of the discrete grid representation by decoding extracted image semantic features from designed convolutional neural networks (CNNs). Relying on discrete density maps not only leads to information loss dependent on the original image resolution, but also has a scalability issue when analyzing high-resolution images with cubically increasing memory complexity. Furthermore, none of the existing methods can offer reliable uncertainty quantification (UQ) for the derived count estimates. To overcome these limitations, we design UNcertainty-aware, hypernetwork-based Implicit neural representations for Counting (UNIC) to assign probabilities and the corresponding counting confidence over continuous spatial coordinates. We derive a sampling-based Bayesian counting loss function and develop the corresponding model training algorithm. UNIC outperforms existing methods on the Remote Sensing Object Counting (RSOC) dataset with reliable UQ and improved interpretability of the derived count estimates. Our code is available at https://github.com/SiyuanXu-tamu/UNIC.
Vegetation Warming Experiment: Landscape-scale digital camera imagery for vegetation phenology, Utqiagvik (Barrow), Alaska, 2020
Images captured using a StarDot NetCam SC phenocamera looking east from the top of the Barrow Environmental Observatory (BEO) Sled Shed, Utqiagvik, Alaska. The camera was installed to remotely monitor plant phenology and operation of the Brookhaven National Laboratory (BNL) TEST group's ZPW (Zero Power Warming) chambers during the growing season of 2020. Images were captured from early spring (14 April) through to late fall (10 November). Snowmelt, vegetation growth and senescence, and snow accumulation were captured. Images (*.jpg) have been combined into *.zip format (1.9 GB) and the data package includes a metadata document with example fields of view from the camera (*.pdf).The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
Vegetation Warming Experiment: Landscape-scale digital camera imagery for vegetation phenology, Utqiagvik, Alaska, 2021
Images captured using a StarDot NetCam SC phenocamera looking east from the top of the Barrow Environmental Observatory (BEO) Sled Shed, Utqiagvik, Alaska. The camera was installed to remotely monitor plant phenology and operation of the Brookhaven National Laboratory (BNL) TEST group's ZPW (Zero Power Warming) chambers during the growing season of 2021. Images were captured from early spring (1 April) through to mid fall (22 October). Snowmelt, vegetation growth and senescence, and snow accumulation were captured. Images were uploaded to the BNL FTP server every hour, then from 2021-07-09 images were recorded every 10 minutes until the end of data collection on 2021-10-22. Images have been combined in *.zip format (6.1 GB). Closer fields of view (northeasterly) were also captured using 4 Wingscapes TimelapseCam cameras mounted on a mast on the sled shed. These cameras were operated from 2021-06-19 to 2021-09-22, with images recorded every 30 minutes from 9:00 to 16:30 Alaska daylight time (AKDT, UTC-8). Individual jpg images from each camera have been combined in zip format. The data package includes a metadata document with example fields of view from each camera (*.pdf). The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).
Vegetation Warming Experiment: Landscape-scale digital camera imagery for vegetation phenology, Utqiagvik (Barrow), Alaska, 2019
Images captured using a StarDot NetCam SC phenocamera looking east from the top of the Barrow Environmental Observatory (BEO) Sled Shed, Utqiagvik, Alaska. The camera was installed to remotely monitor plant phenology and operation of the Brookhaven National Laboratory (BNL) TEST group's ZPW (Zero Power Warming) chambers during the growing season of 2019. Images were captured from early spring (4 April) through to mid fall (30 October). Snowmelt, vegetation growth and senescence, and snow accumulation were captured. Images were uploaded to the BNL FTP server every hour, then from 2019-06-27 to 2019-10-02 images were recorded every 10 minutes, then at hourly intervals until the end of data collection on 2019-10-30. Files were renamed with the date and time of the image. jpg images have been compressed in *.tar.gz format (5.6 GB). Closer fields of view (northeasterly) were also captured using 4 Wingscapes TimelapseCam cameras mounted on a mast on the sled shed. These cameras were operated from 2019-06-23 to 2019-09-25, with images recorded every 30 minutes from 9:00 to 16:30 Alaska daylight time (AKDT, UTC-8). Individual jpg images have been compressed in zip format for each camera and also presented as mp4 timelapse movies.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).