Multiscale Image Matching for Automated Calibration of UAV-Based Frame and Line Camera Systems
Not provided.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Not provided.
Accurate Leaf Area Index (LAI) estimations at the soybean plot scale is achievable using high-resolution Unmanned Aerial Vehicle (UAV) imagery and field measurement samples. However, the limited coverage of UAV flights restricts large-scale remote sensing monitoring in expansive soybean fields. This study leverages the broad coverage and 3-m resolution of PlanetScope satellite imagery to extend LAI prediction from UAV to satellite scales through transfer learning, using UAV-scale LAI estimates as a benchmark to validate cross-scale consistency. To address this challenge, this study proposed the LAI-TransNet, a two-stage transfer learning framework designed for precise and scalable soybean LAI prediction across large areas, demonstrating its effectiveness in cross-scale monitoring. In Stage 1, a UAV-scale benchmark is established using PROSAIL-simulated UAV reflectance data (UAV-Sim) and field-measured soybean LAI. Traditional machine learning, deep learning, and transfer learning models are trained on a hybrid UAV-Sim and field-measured dataset (UAV-Sim_Measured), with the transfer learning model CNN-TL, fine-tuned using pre-trained weights derived from UAV-Sim, achieving the highest accuracy (R 2 = 0.81, RMSE = 0.64 m 2 /m 2 , rRMSE = 11.5 %). In Stage 2, LAI-TransNet is developed by fine-tuning the CNN-TL model on PlanetScope simulated data (PS-Sim), preprocessed via cross-domain mapping to align UAV and satellite spectral features. Real PlanetScope imagery is corrected for reflectance consistency with reference to UAV imagery spectral profiles. LAI-TransNet outperforms other deep learning models trained directly on PS-Sim (R 2 = 0.69 vs. 0.60–0.63), ensuring robust cross-scale consistency. In conclusion, by bridging UAV and satellite scales, LAI-TransNet enables large-scale soybean LAI monitoring, enhancing precision agriculture management through improved monitoring with the PlanetScope imagery.
Unmanned aerial vehicles (UAVs) provide an intermediate scale of spatial and spectral data collection that yields increased accuracy and consistency in data collection for morphological and physiological traits than satellites and expanded flexibility and high-throughput compared to ground-based data collection. In this study, we used UAV-based remote sensing for automated phenotyping of field-grown switchgrass (Panicum virgatum), a leading bioenergy feedstock. Using vegetation indices calculated from a UAV-based multispectral camera, statistical models were developed for rust disease caused by Puccinia novopanici, leaf chlorophyll, nitrogen, and lignin contents. For the first time, UAV remote sensing technology was used to explore the potentials for multiple traits associated with sustainable production of switchgrass, and one statistical model was developed for each individual trait based on the statistical correlation between vegetation indices and the corresponding trait. Also, for the first time, lignin content was estimated in switchgrass shoots via UAV-based multispectral image analysis and statistical analysis. The UAV-based models were verified by ground-truthing via correlation analysis between the traits measured manually on the ground-based with UAV-based data. The normalized difference red edge (NDRE) vegetation index outperformed the normalized difference vegetation index (NDVI) for rust disease and nitrogen content, while NDVI performed better than NDRE for chlorophyll and lignin content. Overall, linear models were sufficient for rust disease and chlorophyll analysis, but for nitrogen and lignin contents, nonlinear models achieved better results. As the first comprehensive study to model switchgrass sustainability traits from UAV-based remote sensing, these results suggest that this methodology can be utilized for switchgrass high-throughput phenotyping in the field.
To integrate unmanned aerial vehicles (UAVs) in future large-scale deployments, a new wireless communication paradigm, namely, the cellular-connected UAV has recently attracted interest. However, the line-of-sight dominant air-to-ground channels along with the antenna pattern of the cellular ground base stations (GBSs) introduce critical interference issues in cellular-connected UAV communications. In particular, the complex antenna pattern and the ground reflection (GR) from the down-tilted antennas create both coverage holes and patchy coverage for the UAVs in the sky, which leads to unreliable connectivity from the underlying cellular network. To overcome these challenges, in this paper, we propose a new cellular architecture that employs an extra set of co-channel antennas oriented towards the sky to support UAVs on top of the existing down-tilted antennas for ground user equipment (GUE). To model the GR stemming from the down-tilted antennas, we propose a path-loss model, which takes both antenna radiation pattern and configuration into account. Next, we formulate an optimization problem to maximize the minimum signal-to-interference ratio (SIR) of the UAVs by tuning the up-tilt (UT) angles of the up-tilted antennas. Since this is an NP-hard problem, we propose a genetic algorithm (GA) based heuristic method to optimize the UT angles of these antennas. After obtaining the optimal UT angles, we integrate the 3GPP Release-10 specified enhanced inter-cell interference coordination (eICIC) to reduce the interference stemming from the down-tilted antennas. Our simulation results based on the hexagonal cell layout show that the proposed interference mitigation method can ensure higher minimum SIRs for the UAVs over baseline methods while creating minimal impact on the SIR of GUEs.
Unmanned aerial vehicles (UAVs) depend on software components to automate dangerous or critical missions; these components are then a desirable target for adversaries seeking to sabotage the UAV. Some work has been done to prevent an attacker who has either compromised a ground control station or parts of a UAV’s software from sabotaging the vehicle, but not both. We present an architecture running a UAV software stack with runtime monitoring and seL4-based software isolation that prevents attackers from both exploiting software bugs and utilizing stealthy attacks. Our architecture retrofits legacy UAVs and secures the popular MAVLink protocol, making it widely applicable for UAVs to adopt.
In this paper, we apply the Non-Orthogonal Multiple Access (NOMA) technique to improve the massive channel access of a wireless IoT network where solar-powered Unmanned Aerial Vehicles (UAVs) relay data from IoT devices to remote servers. Specifically, IoT devices contend for accessing the shared wireless channel using an adaptive p-persistent slotted Aloha protocol; and the solar-powered UAVs adopt Successive Interference Cancellation (SIC) to decode multiple received data from IoT devices to improve access efficiency. To enable an energy-sustainable capacity-optimal network, we study the joint problem of dynamic multi-UAV altitude control and multi-cell wireless channel access management of IoT devices as a stochastic control problem with multiple energy constraints. We first formulate this problem as a Constrained Markov Decision Process (CMDP), and propose an online model-free Constrained Deep Reinforcement Learning (CDRL) algorithm based on Lagrangian primal-dual policy optimization to solve the CMDP. Extensive simulations demonstrate that our proposed algorithm learns a cooperative policy in which the altitude of UAVs and channel access probability of IoT devices are dynamically controlled to attain the maximal long-term network capacity while ensuring energy sustainability of UAVs, outperforming baseline schemes. The proposed CDRL agent can be trained on a small network, yet the learned policy can efficiently manage networks with a massive number of IoT devices and varying initial states, which can amortize the cost of training the CDRL agent.
In this letter, we investigate the tradeoff between reliability and beam training overhead in cooperative millimeter wave (mmWave) unmanned aerial vehicle (UAV) communications. In particular, we analyze how outage probability varies with the number of neighboring UAVs being probed as potential relays for relay selection. Unlike existing work, the limited number of UAV beams as well as UAV orientations are explicitly considered in our analysis. Here we derive the outage probability in closed form and verify our analysis via simulations. The results facilitate us to understand the fundamental limits of cooperative mmWave UAV communications.
Supporting reliable and seamless wireless connectivity for unmanned aerial vehicles (UAVs) has recently become a critical requirement to enable various different use cases of UAVs. Due to their widespread deployment footprint, cellular networks can support beyond visual line of sight (BVLOS) communications for UAVs. In this paper, we consider cellular connected UAVs (C-UAVs) that are served by massive multiple input-multiple-output (MIMO) links to extend coverage range, while also improving physical layer security and authentication. Here, we consider Rician channel and propose a novel linear precoder design for transmitting data and artificial noise (AN). We derive the closed-form expression of the ergodic secrecy rate of CUAVs for both conventional and proposed precoder designs. In addition, we obtain the optimal power splitting factor that divides the power between data and AN by asymptotic analysis. Then, we apply the proposed precoder design in the fingerprint embedding authentication framework, where the goal is to minimize the probability of detection of the authentication tag at an eavesdropper. In simulation results, we show the superiority of the proposed precoder in both secrecy rate and the authentication probability considering moderate and large number of antenna massive MIMO scenarios.
Here, we investigate a transmission mechanism aiming to improve the data rate between a base station (BS) and a user equipment (UE) through deploying multiple relaying UAVs. We consider the effect of interference incurred by another established communication network, which makes our problem challenging and different from the state of the art. We aim to design the 3D trajectories and power allocation for the UAVs to maximize the data flow of the network while keeping the interference on the existing communication network below a threshold. We utilize the mobility feature of the UAVs to evade the (un)-intended interference caused by (un)-intentional interferers. To this end, we propose an alternating-maximization approach to jointly obtain the 3D trajectories and the UAVs transmission powers. We handle the 3D trajectory design by resorting to spectral graph the power allocation through convex optimization techniques. We also approach the problem from the intentional interferer’s perspective where smart jammers chase the UAVs to effectively degrade the data flow of the network. We also extend our work to the case for multiple UEs. Finally, we demonstrate the efficacy of our proposed method through extensive simulations.
As commercial and non-commercial unmanned aerial vehicles (UAVs) improve technologically and increase in accessibility, their potential for use in actions antithetical to nuclear non-proliferation efforts increases as well. The ability to identify and locate UAVs using ubiquitous, inexpensive hardware and software would be advantageous as both a deterrent and an initial warning system. Our team looks to utilize smartphones as acoustic sensors to record and characterize UAV movement based on the sound produced while in flight. Multi-rotor UAVs produce identifiable acoustic spectral characteristics with frequencies and harmonics corresponding to motor revolutions per minute and the propeller characteristics. As the source moves closer to the receiver these spectral patterns remain relatively stable (at slow speeds), while the energy observed from the waves increases. The goal of this work is to utilize a small network of smartphone sensors with known, fixed positions to infer the relative position of an in-flight UAV with respect to the position of the smartphones through the variation in acoustic energy.
Wireless power transfer (WPT) systems for unmanned aerial vehicles (UAVs) must satisfy stringent design requirements to ensure reliable operation under constraints related to efficiency, thermal performance, altitude, weight, and reliability, particularly in airborne and high-altitude environments. Thermal management becomes increasingly challenging at higher altitudes due to reduced air density, while reliability is strongly affected by the number and complexity of active components. The weight and compactness of secondary-side rectifiers directly impact UAV flight endurance and system integration, influencing energy consumption and payload allocation. These factors collectively define the practical feasibility of UAV WPT systems and guide rectifier topology selection. This paper presents a comparative and experimentally validated evaluation framework for secondary-side rectifiers under UAV-specific constraints. Three representative rectifier architectures are analyzed using component-based assessment of weight, thermal behavior, and reliability, together with experimental efficiency measurements obtained from a 1 kW WPT prototype. The results show that the single-switch active rectifier achieves the highest peak efficiency of approximately 93.2% and an overall efficiency of 91%, while also offering advantages in weight and reliability. The findings demonstrate how constraint-oriented analysis, combined with experimental validation, enables informed selection of secondary-side rectifiers for UAV wireless power transfer applications, including emerging airborne and high-altitude platforms.
Satellite and aerial imagery have been used extensively for mapping the abundance and distribution of giant kelp ( Macrocystis pyrifera ) in southern California. There is now great potential for using unoccupied aerial vehicles (UAVs) to map kelp canopy at very high resolutions. However, tides and currents have been shown to affect the amount of floating kelp canopy on the water surface, and the impacts of these processes on remotely sensed kelp estimates in this region have not been fully quantified. UAVs were used to map fine-scale changes in canopy area due to tidal height and current speed at kelp forests off the coast of Palos Verdes, CA and Santa Barbara, CA. An automated method for detecting kelp canopy was developed that was 67% accurate using red-green-blue (RGB) UAV imagery and 93% accurate using multispectral UAV imagery across a range of weather, ocean, and illumination conditions. Increases in tidal height of 1 m reduced the amount of floating kelp canopy by 15% in Santa Barbara and by over 30% in Palos Verdes. The effect of current speed on visible kelp canopy was inconclusive, but there was a trend towards lower canopy area with increased current speed. Therefore, while tidal height and current speed can introduce significant variability to estimates of kelp abundance, the magnitude of this variability is site specific. Still, UAVs are a valuable tool for mapping of kelp canopy and can provide greater spatial resolution and temporal coverage than is possible from many satellite sensors. This data can provide insight into the patterns and drivers of high frequency fluctuations in kelp abundance.
Wireless power transfer technology is getting more attention these days as a part of expanded battery charging infrastructure and network at a wide range of power levels. Charging Unmanned aerial vehicles (UAVs) is one wireless charging application, and charging their batteries can be challenging because they have short flight times and are frequently charged. For wireless charging of UAVs, the misalignment performance of the magnetic coupler pads is critical because landing on a charging pad at a perfectly aligned position is difficult and can be time-consuming. Different coil shapes and system structures have been proposed in the literature to overcome this challenge. A new design with a high misalignment tolerance is needed; therefore, to fill this gap, a wireless power transfer system has been designed for a 250 W UAV battery charging system with a new magnetic coupler design. A 3D model of the proposed design was created, and finite element simulations were performed. To prove the proposed design, the magnetic coupler prototypes were developed, and experimental results are presented herein. The misalignment tolerance of the proposed system was observed for various rotational positions of the secondary coil, from 0° to 360°. The results demonstrate that DC–DC efficiency varies between 80% and 85% within full 360° rotation of the receiver coil. This result enables the proposed system to address the misalignment problem for wireless charging of UAVs.
First person view (FPV) technology for unmanned aerial vehicles (UAVs) provides an immersive experience for pilots and enables various personal and commercial applications such as aerial photography, drone racing, search and rescue operations, agricultural surveillance, and structural inspection. While real time video streaming from a UAV and vision-based collision avoidance strategies have been studied in literature as separate topics, in this paper we tackle collision avoidance in FPV scenarios, taking into account network delays and real time video parameters. We present a theoretical model for obstacle collisions that considers the current communication channel conditions, the real time video parameters, and the UAV's position relative to the closest obstacle. A video adaptation algorithm is then designed, using this metric, to tune the FPV video resolution, number of re-transmission attempts, and the modulation scheme to maximize the probability of avoiding collisions. This algorithm also takes into account specific latency constraints of the application. This video algorithm was evaluated in various scenarios and its ability to respond to both distances to the obstacle as well as the communication channel conditions was demonstrated. It was found that, for the considered scenarios, the performance of the proposed adaptive algorithm was, on an average, 58.63% higher than the closest non-adaptive one in terms of maximizing the probability of avoiding collision. Such collision avoidance strategies could be used to make UAV FPV applications safer and more reliable.
The increasing accessibility and technological advancements of unmanned aerial vehicles (UAVs) pose legitimate concerns to nuclear non-proliferation efforts. To deter and combat unwanted or nefarious UAV activity near or around nuclear sensitive sites, the ability to quickly and easily detect drones becomes vital. Our team is exploring the use of ubiquitous smartphones as multi-modal sensors (microphone, accelerometer, gyroscope, etc.) to meet this challenge. In conjunction with Idaho National Lab, two UAV flight tests and one stationary in-air test were conducted and recorded with eight Samsung Galaxy S8 smartphones. This work presents initial characterization and annotation of acoustic signals associated with UAV activity.
Screening for drought tolerance is critical to ensure high biomass production of bioenergy sorghum in arid or semi-arid environments. The bottleneck in drought tolerance selection is the challenge of accurately predicting biomass for a large number of genotypes. Although biomass prediction by low-altitude remote sensing has been widely investigated on various crops, the performance of the predictions are not consistent, especially when applied in a breeding context with hundreds of genotypes. In some cases, biomass prediction of a large group of genotypes benefited from multimodal remote sensing data; while in other cases, the benefits were not obvious. In this study, we evaluated the performance of single and multimodal data (thermal, RGB, and multispectral) derived from an unmanned aerial vehicle (UAV) for biomass prediction for drought tolerance assessments within a context of bioenergy sorghum breeding. The biomass of 360 sorghum genotypes grown under well-watered and water-stressed regimes was predicted with a series of UAV-derived canopy features, including canopy structure, spectral reflectance, and thermal radiation features. Biomass predictions using canopy features derived from the multimodal data showed comparable performance with the best results obtained with the single modal data with coefficients of determination (R 2 ) ranging from 0.40 to 0.53 under water-stressed environment and 0.11 to 0.35 under well-watered environment. The significance in biomass prediction was highest with multispectral followed by RGB and lowest with the thermal sensor. Finally, two well-recognized yield-based drought tolerance indices were calculated from ground truth biomass data and UAV predicted biomass, respectively. Results showed that the geometric mean productivity index outperformed the yield stability index in terms of the potential for reliable predictions by the remotely sensed data. Collectively, this study demonstrated a promising strategy for the use of different UAV-based imaging sensors to quantify yield-based drought tolerance.
Understanding the interactions among agricultural processes, soil, and plants is necessary for optimizing crop yield and productivity. This study focuses on developing effective monitoring and analysis methodologies that estimate key soil and plant properties. These methodologies include data acquisition and processing approaches that use unmanned aerial vehicles (UAVs) and surface geophysical techniques. In particular, we applied these approaches to a soybean farm in Arkansas to characterize the soil–plant coupled spatial and temporal heterogeneity, as well as to identify key environmental factors that influence plant growth and yield. UAV-based multitemporal acquisition of high-resolution RGB (red–green–blue) imagery and direct measurements were used to monitor plant height and photosynthetic activity. We present an algorithm that efficiently exploits the high-resolution UAV images to estimate plant spatial abundance and plant vigor throughout the growing season. Such plant characterization is extremely important for the identification of anomalous areas, providing easily interpretable information that can be used to guide near-real-time farming decisions. Additionally, high-resolution multitemporal surface geophysical measurements of apparent soil electrical conductivity were used to estimate the spatial heterogeneity of soil texture. By integrating the multiscale multitype soil and plant datasets, we identified the spatiotemporal co-variance between soil properties and plant development and yield. Our novel approach for early season monitoring of plant spatial abundance identified areas of low productivity controlled by soil clay content, while temporal analysis of geophysical data showed the impact of soil moisture and irrigation practice (controlled by topography) on plant dynamics. Our study demonstrates the effective coupling of UAV data products with geophysical data to extract critical information for farm management.