MegaStitch: Robust Large-Scale Image Stitching
Not Available
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
SEARCH · Search NASA
Results for “remote imaging”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Displacement Analysis of Geothermal Field Based on PSInSAR And SOM Clustering Algorithms A Case Study of Brady Field, Nevada—USA
The availability of free and high temporal resolution satellite data and advanced SAR techniques allows us to analyze ground displacement cost-effectively. Our aim was to properly define subsidence and uplift areas to delineate a geothermal field and perform time-series analysis to identify temporal trends. A Persistent Scatterer Interferometry (PSI) algorithm was used to estimate vertical displacement in the Brady geothermal field located in Nevada by analyzing 70 Sentinel-1A Synthetic-Aperture Radar (SAR) images, between January 2017 and December 2019. To classify zones affected by displacement, an unsupervised Self-Organizing Map (SOM) algorithm was applied to classify points based on their behavior in time, and those clusters were used to determine subsidence, uplift, and stable regions automatically. Finally, time-series analysis was applied to the clustered data to understand the inflection dates. The maximum subsidence is –19 mm/yr with an average value of –6 mm/yr within the geothermal field. The maximum uplift is 14 mm/yr with an average value of 4 mm/yr within the geothermal field. The uplift occurred on the NE of the field, where the injection wells are located. On the other hand, subsidence is concentrated on the SW of the field where the production wells are located. The coupling of the PSInSAR and the SOM algorithms was shown to be effective in analyzing the direction and pattern of the displacements observed in the field.
54 ENVIRONMENTAL SCIENCES↗
Thresholding Analysis and Feature Extraction from 3D Ground Penetrating Radar Data for Noninvasive Assessment of Peanut Yield
This study explores the efficacy of utilizing a novel ground penetrating radar (GPR) acquisition platform and data analysis methods to quantify peanut yield for breeding selection, agronomic research, and producer management and harvest applications. Sixty plots comprising different peanut market types were scanned with a multichannel, air-launched GPR antenna. Image thresholding analysis was performed on 3D GPR data from four of the channels to extract features that were correlated to peanut yield with the objective of developing a noninvasive high-throughput peanut phenotyping and yield-monitoring methodology. Plot-level GPR data were summarized using mean, standard deviation, sum, and the number of nonzero values (counts) below or above different percentile threshold values. Best results were obtained for data below the percentile threshold for mean, standard deviation and sum. Data both below and above the percentile threshold generated good correlations for count. Correlating individual GPR features to yield generated correlations of up to 39% explained variability, while combining GPR features in multiple linear regression models generated up to 51% explained variability. The correlations increased when regression models were developed separately for each peanut type. This research demonstrates that a systematic search of thresholding range, analysis window size, and data summary statistics is necessary for successful application of this type of analysis. The results also establish that thresholding analysis of GPR data is an appropriate methodology for noninvasive assessment of peanut yield, which could be further developed for high-throughput phenotyping and yield-monitoring, adding a new sensor and new capabilities to the growing set of digital agriculture technologies.
54 ENVIRONMENTAL SCIENCES↗
Advancing Tassel Detection and Counting: Annotation and Algorithms
Tassel counts provide valuable information related to flowering and yield prediction in maize, but are expensive and time-consuming to acquire via traditional manual approaches. High-resolution RGB imagery acquired by unmanned aerial vehicles (UAVs), coupled with advanced machine learning approaches, including deep learning (DL), provides a new capability for monitoring flowering. In this article, three state-of-the-art DL techniques, CenterNet based on point annotation, task-aware spatial disentanglement (TSD), and detecting objects with recursive feature pyramids and switchable atrous convolution (DetectoRS) based on bounding box annotation, are modified to improve their performance for this application and evaluated for tassel detection relative to Tasselnetv2+. The dataset for the experiments is comprised of RGB images of maize tassels from plant breeding experiments, which vary in size, complexity, and overlap. Results show that the point annotations are more accurate and simpler to acquire than the bounding boxes, and bounding box-based approaches are more sensitive to the size of the bounding boxes and background than point-based approaches. Overall, CenterNet has high accuracy in comparison to the other techniques, but DetectoRS can better detect early-stage tassels. The results for these experiments were more robust than Tasselnetv2+, which is sensitive to the number of tassels in the image.
54 ENVIRONMENTAL SCIENCES↗
Using automated machine learning for the upscaling of gross primary productivity
Estimating gross primary productivity (GPP) over space and time is fundamental for understanding the response of the terrestrial biosphere to climate change. Eddy covariance flux towers provide in situ estimates of GPP at the ecosystem scale, but their sparse geographical distribution limits larger-scale inference. Machine learning (ML) techniques have been used to address this problem by extrapolating local GPP measurements over space using satellite remote sensing data. However, the accuracy of the regression model can be affected by uncertainties introduced by model selection, parameterization, and choice of explanatory features, among others. Recent advances in automated ML (AutoML) provide a novel automated way to select and synthesize different ML models. In this work, we explore the potential of AutoML by training three major AutoML frameworks on eddy covariance measurements of GPP at 243 globally distributed sites. We compared their ability to predict GPP and its spatial and temporal variability based on different sets of remote sensing explanatory variables. Explanatory variables from only Moderate Resolution Imaging Spectroradiometer (MODIS) surface reflectance data and photosynthetically active radiation explained over 70 % of the monthly variability in GPP, while satellite-derived proxies for canopy structure, photosynthetic activity, environmental stressors, and meteorological variables from reanalysis (ERA5-Land) further improved the frameworks' predictive ability. We found that the AutoML framework Auto-sklearn consistently outperformed other AutoML frameworks as well as a classical random forest regressor in predicting GPP but with small performance differences, reaching an r 2 of up to 0.75. We deployed the best-performing framework to generate global wall-to-wall maps highlighting GPP patterns in good agreement with satellite-derived reference data. This research benchmarks the application of AutoML in GPP estimation and assesses its potential and limitations in quantifying global photosynthetic activity.
54 ENVIRONMENTAL SCIENCES↗
Sidewall Breach During Lithium-Ion Battery Thermal Runaway Triggered by Cell-to-Cell Propagation Visualized Using High-Speed X-Ray Imaging
With the rapid deployment of Li-ion batteries (LiBs) in a range of applications, it is crucial to ensure their safe operation. Therefore, it is necessary to investigate the rapid thermal runaway failure that LiBs can undergo if improperly operated or subjected to abuse scenarios so that hazardous events can be avoided or mitigated. Sidewall breaches or ruptures of LiBs during thermal runaway are considered the most hazardous failure scenario, resulting in hot abrasive flare from the casing of the cell that can impinge on neighbouring cells and lead to the propagation of thermal runaway throughout a battery pack. Yet, the process leading up to the sidewall breach is not well understood due to the extreme difficulty in visualizing such a failure in commercially relevant cells. With the application of a newly developed chamber for remote-controlled abuse testing of batteries coupled with simultaneous X-ray imaging, we demonstrate here for the first time an in-situ visualization of a sidewall breach. By further applying spatiotemporal mapping techniques, the internal thermal runaway events leading up to the sidewall breach can be analyzed in detail. Subsequently, the speed of the electrode layer delamination could be calculated to a speed of 0.6 m/s. These new insights bring more clarity regarding this phenomenon, that in turn can help battery designers improve battery safety.
battery safety↗
Computer Vision on Edge Devices for the Short Term Prediction of Cloud Cover
Edge Computing and IoT are important pieces of today's technological landscape. Here, we build a low-cost IoT sensor for sky imaging and program it using AWS GreenGrass, one of the leading IoT platforms. We demonstrate remote reprogramming of this device to load software that predicts sun shading events through the linear advection method, which is a baseline algorithm that can be used to benchmark algorithmic improvements in future work. Some future directions for sky imaging research are enumerated.
14 SOLAR ENERGY↗
Classification of Wetland Vegetation Based on NDVI Time Series from the HLS Dataset
Natural wetlands are intrinsically heterogeneous and typically composed of a mosaic of ecosystem patches with different vegetation types. Hydrological and biogeochemical processes in wetlands vary strongly among these ecosystem patches. To date, most remote sensing classification approaches for wetland vegetation either rely on coarse images that cannot capture the spatial variability of wetland vegetation or rely on very-high-resolution multi-spectral images that are detailed but very sporadic in time (less than once per year). This study aimed to use NDVI time series, generated from NASA’s HLS dataset, to classify vegetation patches. We demonstrate our approach at a temperate, coastal lake, estuarine marsh. To classify vegetation patches, a standard time series library of the four land-cover patch types was built from referencing specific locations that were identified as “pure” pixels. These were identified using a single-time high-resolution image. We calculated the distance between the HLS-NDVI time series at each pixel and the “pure”-pixel standards for each land-cover type. The resulting true-positive classified rate was >73% for all patch types other than water lily. The classification accuracy was higher in pixels of a more uniform composition. A set of vegetation maps was created for the years 2016 to 2020 at our research site to identify the vegetation changes at the site as it is affected by rapid water elevation increases in Lake Erie. Our results reveal how changes in water elevation have changed the patch distribution in significant ways, leading to the local extinction of cattail by 2019 and a continuous increase in the area cover of water lily patches.
54 ENVIRONMENTAL SCIENCES↗
Towards Diverse and Representative Global Pretraining Datasets for Remote Sensing Foundation Models
The design of a pretraining dataset is emerging as a critical component for the generality of foundation models. In the remote sensing realm, large volumes of imagery and benchmark datasets exist that can be leveraged to pretrain foundation models, however using this imagery in absence of a well-crafted sampling strategy is inefficient and has the potential to create biased and less generalizable models. Here, we provide a discussion and vision for the curation and assessment of pretraining datasets for remote sensing geospatial foundation models. We highlight the importance of geographic, temporal, and image acquisition diversity and review possible strategies to enable such diversity at global scale. In addition to these characteristics, support for various spatial-temporal pretext tasks within the dataset is also critical. Ultimately, our primary objective is to place emphasis on and draw attention to the data curation stage of the foundation model development pipeline. By doing so, we think it is possible to reduce biases of geospatial foundation models, as well as enable broader generalization to downstream remote sensing tasks and applications.
Arndt, Jacob↗
Towards operational atmospheric correction of airborne hyperspectral imaging spectroscopy: Algorithm evaluation, key parameter analysis, and machine learning emulators
Atmospheric correction of airborne hyperspectral imaging spectroscopy (AHIS) to obtain high-quality surface reflectance is the prerequisite for remote sensing applications. Over the last decades, different atmospheric correction methods have been developed based on radiative transfer models (RTMs), however, the relative performances of different algorithms are unclear. Automated operational atmospheric correction methods to process large-volume AHIS data in a high-accurate and high-throughput manner are still lacking. Therefore, this study proposed an operational atmospheric correction pipeline for deriving surface reflectance from AHIS data. To ensure the accuracy and efficiency of the pipeline, we focused on three specific aspects: (1) selecting a suitable RTM for the development of atmospheric lookup tables (LUTs) by comparing the commercial MODerate resolution atmospheric TRANsmission (MODTRAN) and open-sourced Library for Radiative TRANsfer (LibRadTRAN) models, where the widely-used software, Atmospheric/Topographic Correction for Airborne Imagery (ATCOR), was used as benchmarks; (2) identifying key atmospheric correction parameters and determining suitable sources for parameter retrievals including AHIS, Moderate Resolution Imaging Spectroradiometer (MODIS), and AErosol RObotic NETwork (AERONET); and (3) testing the performance of using machine learning emulators to speed up the RTM-based atmospheric correction. Results indicate that (1) atmospheric correction based on MODTRAN LUTs can produce surface reflectance accurately with mean absolute errors < 0.05 and cosine similarities > 0.98 compared to field measurements, which is comparable to the software ATCOR and slightly outperforms the LibRadTRAN LUTs; (2) sobol global sensitivity analysis demonstrates that in the atmospheric correction, visibility and water vapor are two key parameters that can be accurately derived from AHIS in contrast to MODIS or AERONET data; and (3) Random Forest emulators can produce accurate estimations of surface reflectance with mean absolute errors < 0.03 and cosine similarities > 0.98 for higher processing efficiency and determine a suitable set of wavelengths for retrieving atmospheric visibility and water vapor. In conclusion, the proposed atmospheric correction pipeline also improved the four-stream radiative transfer theory for airborne applications by considering adjacent effects from airborne surrounding pixels and can also be applied for atmospheric correction of hyperspectral data from spaceborne missions.
47 OTHER INSTRUMENTATION↗
Stationary and drone-assisted methane plume localization with dispersion spectroscopy
This work presents stationary and mobile retroreflector-based remote sensing techniques for methane leak localization and quantification using chirped laser dispersion spectroscopy equipped with a custom laser transceiver capable of continuous tracking of a flying drone and coupled with inverse atmospheric gas dispersion modeling. The techniques demonstrate the ability to localize leaks as low as 0.13 g CH 4 ·s -1 , which are up to 25 times smaller than those typically observed at natural gas facilities, as well as actively track a moving retroreflector mounted on a lightweight (~250 g) drone to enable spatial plume reconstruction. This system exhibited a 2.3 ppm-m sensitivity over pathlengths of 40–150 m. Source localization to within ±7 m is demonstrated using a modified horizontal radial plume mapping technique with a stationary retroreflector grid. Meanwhile, the mobile system utilizing a drone-mounted retroreflector is able to localize a controlled release within ±1 m of its source location and estimate leak rates using inversion techniques assuming type B Gaussian plume stability class within ±30% error with respect to the actual low flow rate releases.
47 OTHER INSTRUMENTATION↗
Estimating Fine-Resolution Shortwave Broadband Albedo of Croplands from Harmonized Landsat and Sentinel-2 Data
Altered surface albedo due to land-cover conversions and management is a significant driver of global climate change. Albedo can be directly measured at ground stations, and remote sensing data can be used to scale-up albedo values to regional and global levels. Some previous studies have retrieved fine-resolution (10–30 m) instantaneous albedo and coarse-resolution (500–1000 m) daily mean albedo from remote sensing data, but they all required the input of Moderate Resolution Imaging Spectroradiometer (MODIS) albedo information at 500-m resolution, and none have assembled both instantaneous and daily albedo based exclusively on fine-resolution satellite data. Here, to address this issue, we compiled 387 instantaneous and 346 daily albedo records using field net radiometer measurements from the bioenergy croplands at the W. K. Kellogg Biological Station in southwest Michigan. We then connected these albedo records with a suite of variables derived from harmonized Landsat and Sentinel-2 data through two machine learning algorithms (random forest regression and extreme gradient boosting) to retrieve clear-sky instantaneous and daily shortwave broadband albedo. The performance statistics indicate reasonable accuracy of model results [root-mean-square error (RMSE)] around or below 0.03 except for snow-covered surfaces), suggesting that the retrieval of both instantaneous and daily albedo based exclusively on fine-resolution satellite data is promising. To facilitate the use of fine-resolution albedo products at the global level, future efforts need to include more albedo records of diverse surface cover types, as well as to accurately model daily albedo for cloudy days to address the “clear-sky bias.”
Harmonized Landsat and Sentinel-2↗
Hardening DOE R&D Software Tools for Web-based Visualization SBIR Phase I Final Report
Ubiquitous web-based visualization is essential to delivering large-scale data visualization to various stakeholders, from the scientist to the board member. These stakeholders will not tolerate a stalled application or a pop-up window asking them to wait for the processing to complete. They require a responsive and interactive visualization environment with high-quality imagery suitable for detailed analysis and boardroom presentations. At Kitware, Inc., we have accomplished web visualization to this point, leveraging state-of-the-art tools like HTML5, CSS3, SVG, Canvas, and WebGL. Solutions that leverage a combination of these technologies are necessary to handle workloads that vary significantly in data size efficiently. However, it is not always practical to move large data to the web client for visualization. Kitware's ParaView as a Service combines client-side visualization using both distributed processing and remote rendering on big data impractical to move. Existing distributed processing and remote rendering solution's interactivity is below the expectations of web-based applications. Our project examined proposed solutions to the areas outlined above in ParaView as a Service. We have investigated concurrent pipelines, streaming images, progressive rendering, and optimization of algorithms and data movement to address these concerns. For the Phase I project, we completed the proposed work plan. As a result, the project produced three prototypes of essential importance for web visualization and the ParaView as a Service community. We created a simple desktop application for an interactive streamline placement prototype, a web-based interactive streamline placement prototype, and a web-based progressive rendering utilizing raytracing prototype. These prototypes relied on the hardening of emerging software toolkits funded by the Department of Energy (DOE) Advanced Scientific Computing Research (ASCR) program (such as ParaView, VTK-m, and Mochi). We blended these components into web-based visualization prototypes that meet the industry's expectations for interactivity and responsiveness. The Phase I project had four essential focus areas: 1. Develop prototype ParaView as a Service backend server using asynchronous, non-blocking design principles. 2. Develop a prototype web application that uses the ParaView as a Service backend server for remote data visualization. 3. Implement image streaming with encoding/compression and progressive rendering capabilities in the proposed platform. 4. Evaluate the prototype developed and summarize observations, including the challenges and pitfalls of our approach. After our successful completion of Phase I, we are strongly positioned to propose a successful Phase II project.
Geveci, Berk↗
Opinion: Lighting Research During and After the Pandemic
For many lighting researchers, the recent restrictions related to COVID-19 have paused most in-person laboratory or field experiments. In certain countries, regulatory institutions have allowed such experiments to resume but issued safety recommendations like pre-checking participants for disease symptoms and excluding those that are especially vulnerable. To avoid potential complications and delays, researchers are likely to resort to other research designs that enable remote research — eliminating the need for the experimenter and subjects to be in the same room. While unanticipated, this shift to remote research methods is an opportunity to revisit and further develop remote experimental techniques, which can have beneficial long-lasting implications on lighting research during and after the pandemic. Perhaps the most common type of remote research is online experiments; which can greatly benefit from improved techniques to allow for greater control or characterization of experimental conditions, like those proposed by Villa and Labayrade . These techniques require validation specific to the type of response collected and context, e.g. space type and attributes. New research techniques continue to emerge and will enable remote collection of objective measures such as gaze direction and high dynamic range images (HDRIs) without specialized equipment. In fact, many of these methods and techniques are commonly used in other disciplines, like vision science and psychology, and can be adapted for lighting research. Not all lighting studies can be conducted online, but in the age of ubiquitous and connected technologies, there is a largely missed opportunity to utilize crowdsourced responses to lighting conditions in real environments where people live and go about their daily lives without the research being limited to a certain time and laboratory locations. For instance, outdoor street luminaires can be rated by passersby using ecological momentary assessments on mobile phones. While this approach does not provide laboratory-level control over experimental conditions, it can provide more contextual responses resulting from ‘normal’ dynamic gaze, behavior, and interactions. Further, it can also reduce bias related to the experimental setting. Further development of remote research methods and their use in lighting research can improve the quality of lighting research. Given that sample sizes in most lighting research are relatively small, remote research can substantially increase sample sizes, reduce research costs, and shorten study duration, all while reducing interaction between experimenter and subjects. Another benefit is reaching a wider audience and including under-represented individuals who typically are not reachable using common recruitment methods. The pandemic has set back our plans for in-lab experiments, but can it inspire us to think of new and creative ways to expand lighting research?
Abboushi, Belal K.↗
Tightly-coupled camera/LiDAR integration for point cloud generation from GNSS/INS-assisted UAV mapping systems
Unmanned aerial vehicles (UAVs) equipped with integrated global navigation satellite systems/inertial navigation systems (GNSS/INS) together with cameras and/or LiDAR sensors are being widely used for topographic mapping in a variety of applications such as precision agriculture, coastal monitoring, and archaeological documentation. Integration of image-based and LiDAR point clouds can provide a comprehensive 3D model of the area of interest. For such integration, ensuring a good alignment between data from the different sources is critical. Although many works have been conducted on this topic, there is still a need for a rigorous integration approach that minimizes the discrepancy between camera and LiDAR data caused by inaccurate system calibration parameters and/or trajectory artifacts. This study proposes an automated tightly-coupled camera/LiDAR integration workflow for GNSS/INS-assisted UAV systems. The proposed strategy is conducted in three main steps. First, an image-based point cloud is generated using a LiDAR/GNSS/INS-assisted structure from motion (SfM) strategy. Then, feature correspondences between image-based and LiDAR point clouds are automatically identified. Finally, an integrated-bundle adjustment procedure including image points, LiDAR raw measurements, and GNSS/INS information is conducted to minimize the discrepancy between point clouds from different sensors while estimating system calibration parameters and refining the trajectory information. The proposed SfM strategy and integration framework are evaluated using five datasets. The SfM results show that using LiDAR data can facilitate feature matching and further increase the number of reconstructed 3D points. The experimental results also illustrate that the developed automated camera/LiDAR integration strategy is capable of accurately estimating system calibration parameters to achieve good alignment among camera/LiDAR data from single/multiple systems. Finally, an absolute accuracy in the range of 3–5 cm is achieved for the image/LiDAR point clouds after the integration process.
42 ENGINEERING↗
Multiscale Image Matching for Automated Calibration of UAV-Based Frame and Line Camera Systems
Not provided.
Engineering↗