Search NASA⌕ Search

SEARCH · Search NASA

Results for “bundle adjustment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Oak Ridge National Laboratory Bundle Adjustment of Maxar WorldView and GeoEye Imagery

Since the 1950s, bundle adjustment has been used to correct the geopositioning of imagery. With the increased availability of very high resolution satellite imagery, bundle adjustment has become an increasingly critical topic for both researchers and practitioners. Many studies have explored the bundle adjustment of satellite imagery from Maxar sensors, including the WorldView and GeoEye sensors. In this work, we review some of the recent and relevant literature pertaining to this topic.

47 OTHER INSTRUMENTATION↗

Vision-Based Distributed Sensing at Vertiports for Advanced Air Mobility and Urban Air Mobility Approach and Landing

Advanced Air Mobility (AAM) encompasses a broad vision for air transportation, including Urban Air Mobility (UAM) as a subset. AAM aims to create a more connected and efficient transportation network across various geographical settings. However, navigating AAM aircraft in GPS-denied or degraded environments during approach and landing is challenging. Traditional vision aids like glideslopes and localizers are limited in vertiport environments due to narrow beam constraints and reduced landing angle options. This paper addresses the need for accurate navigation solutions at vertiports by proposing a vision-based distributed sensing (VIDIS) system utilizing cameras with bundle adjustment to assist incoming AAM aircraft during approach and landing while monitoring surface movements to enhance safety and efficiency. Key focus areas for current and future vertiport developers include identifying suitable sensor types and infrastructure standards to support AAM operations and including vertiport markings as vision-based navigation aids. The proposed system offers a novel approach to overcoming navigation challenges in AAM operations, particularly in urban settings where traditional aids may be insufficient. Preliminary simulation results with distributed cameras demonstrate promising outcomes for implementing bundle adjustment techniques to enhance vision-based navigation solutions at vertiports. Generating waypoint-based trajectories via waypoint integration using explicit guidance synthesis (WINGS) creates smooth AAM trajectories for landing at vertiports by using the current waypoint's terminal conditions as the initial conditions for the next waypoint. Combining bundle adjustment's ground-based solution of vertiport features with WINGS, Coplanar Pose from Orthography and Scaling with Iterations (COPOSIT), and an extended Kalman filter (EKF) estimates the state of an incoming aircraft during approach and landing at vertiports. Future work includes testing VIDIS in a high-fidelity simulation and with real-world data.

Distributed sensing↗

Vision-Based Distributed Sensing at Vertiports for Advanced Air Mobility and Urban Air Mobility Approach and Landing

Advanced Air Mobility (AAM) encompasses a broad vision for air transportation, including Urban Air Mobility (UAM) as a subset. AAM aims to create a more connected and efficient transportation network across various geographical settings. However, navigating AAM aircraft in GPS-denied or degraded environments during approach and landing is challenging. Traditional vision aids like glideslopes and localizers are limited in vertiport environments due to narrow beam constraints and reduced landing angle options. This paper addresses the need for accurate navigation solutions at vertiports by proposing a vision-based distributed sensing (VIDIS) system utilizing cameras with bundle adjustment to assist incoming AAM aircraft during approach and landing while monitoring surface movements to enhance safety and efficiency. Key focus areas for current and future vertiport developers include identifying suitable sensor types and infrastructure standards to support AAM operations and including vertiport markings as vision-based navigation aids. The proposed system offers a novel approach to overcoming navigation challenges in AAM operations, particularly in urban settings where traditional aids may be insufficient. Preliminary simulation results with distributed cameras demonstrate promising outcomes for implementing bundle adjustment techniques to enhance vision-based navigation solutions at vertiports. Generating waypoint-based trajectories via waypoint integration using explicit guidance synthesis (WINGS) creates smooth AAM trajectories for landing at vertiports by using the current waypoint's terminal conditions as the initial conditions for the next waypoint. Combining bundle adjustment's ground-based solution of vertiport features with WINGS, Coplanar Pose from Orthography and Scaling with Iterations (COPOSIT), and an extended Kalman filter (EKF) estimates the state of an incoming aircraft during approach and landing at vertiports. Future work includes testing VIDIS in a high-fidelity simulation and with real-world data.

Distributed sensing↗

Tightly-coupled camera/LiDAR integration for point cloud generation from GNSS/INS-assisted UAV mapping systems

Unmanned aerial vehicles (UAVs) equipped with integrated global navigation satellite systems/inertial navigation systems (GNSS/INS) together with cameras and/or LiDAR sensors are being widely used for topographic mapping in a variety of applications such as precision agriculture, coastal monitoring, and archaeological documentation. Integration of image-based and LiDAR point clouds can provide a comprehensive 3D model of the area of interest. For such integration, ensuring a good alignment between data from the different sources is critical. Although many works have been conducted on this topic, there is still a need for a rigorous integration approach that minimizes the discrepancy between camera and LiDAR data caused by inaccurate system calibration parameters and/or trajectory artifacts. This study proposes an automated tightly-coupled camera/LiDAR integration workflow for GNSS/INS-assisted UAV systems. The proposed strategy is conducted in three main steps. First, an image-based point cloud is generated using a LiDAR/GNSS/INS-assisted structure from motion (SfM) strategy. Then, feature correspondences between image-based and LiDAR point clouds are automatically identified. Finally, an integrated-bundle adjustment procedure including image points, LiDAR raw measurements, and GNSS/INS information is conducted to minimize the discrepancy between point clouds from different sensors while estimating system calibration parameters and refining the trajectory information. The proposed SfM strategy and integration framework are evaluated using five datasets. The SfM results show that using LiDAR data can facilitate feature matching and further increase the number of reconstructed 3D points. The experimental results also illustrate that the developed automated camera/LiDAR integration strategy is capable of accurately estimating system calibration parameters to achieve good alignment among camera/LiDAR data from single/multiple systems. Finally, an absolute accuracy in the range of 3–5 cm is achieved for the image/LiDAR point clouds after the integration process.

42 ENGINEERING↗

System Calibration Including Time Delay Estimation for GNSS/INS-Assisted Pushbroom Scanners Onboard UAV Platforms

Unmanned aerial vehicles (UAVs ) equipped with imaging sensors and integrated global navigation satellite system/inertial navigation system (GNSS/INS ) units are used for numerous applications. Deriving reliable 3D coordinates from such UAVs is contingent on accurate geometric calibration, which encompasses the estimation of mounting parameters and synchronization errors. Through a rigorous impact analysis of such systematic errors, this article proposes a direct approach for spatial and temporal calibration (estimating system parameters through a bundle adjustment procedure) of a GNSS/INS -assisted pushbroom scanner onboard a UAV platform. The calibration results show that the horizontal and vertical accuracies are within the ground sampling distance of the sensor. Unlike for frame camera systems, this article also shows that the indirect approach is not a feasible solution for pushbroom scanners due to their limited ability for decoupling system parameters. This finding provides further support that the direct approach is recommended for spatial and temporal calibration of UAV pushbroom scanner systems.

47 OTHER INSTRUMENTATION↗

Automatic Calibration and Health Monitoring of Infrastructure Sensors

Smart transportation infrastructure relies on networks of heterogeneous sensors - cameras, radars, and lidars - continuously monitoring traffic conditions. However, executing the initial spatial calibration of multiple sensors and the subsequent health monitoring presents significant operational challenges. Environmental factors, mechanical vibrations, and gradual drift cause spatial misalignment, degrading fusion performance and tracking accuracy. Traditional calibration approaches require manual intervention with specialized targets or survey equipment, resulting in service interruptions and high maintenance costs. This work presents an automated framework for initial calibration and continuous health monitoring without human intervention or service disruption. Our approach addresses two critical problems: (1) detecting when sensors become miscalibrated during operation, and (2) automatically re-establishing spatial alignment using only operational traffic data. The health monitoring component analyzes measurement innovations - differences between sensor observations and predicted object states - to detect systematic biases indicative of calibration drift. By computing bias magnitude, directional consistency, and rejection rates, the system identifies miscalibrations as small as 0.5 meters. Unlike traditional methods requiring known calibration targets, our diagnostic operates continuously on live traffic observations, enabling early detection before fusion quality degrades. The automatic recalibration algorithm leverages overlapping sensor fields-of-view and temporal correlation of vehicle observations. Using graph-based optimization, the system automatically discovers which sensor pairs observe common regions, estimates pairwise spatial transformations using RANSAC-based robust estimation, and jointly optimizes all sensor poses through bundle adjustment. The framework handles practical deployment challenges, including different sensor sampling rates (1-10 Hz), varying installation positions, unknown orientations, and limited overlap regions (>10%). When approximate sensor positions are available from installation surveys (+/-1m accuracy), the algorithm additionally estimates sensor orientations, refining both position and rotation to sub-meter and sub-degree accuracy. We validate the framework on multi-hour traffic datasets from six heterogeneous sensors with sampling rates ranging from 1 Hz to 10 Hz. Results demonstrate successful calibration even with sparse overlap (<20%) and automatic detection of miscalibrations exceeding 0.8 meters. This work enables a "deploy-and-forget" sensor infrastructure that maintains calibration autonomously, reducing maintenance costs while improving tracking accuracy. The techniques generalize beyond transportation to any multi-sensor monitoring application requiring robust spatial alignment, including smart cities, industrial monitoring, and surveillance systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Preparing for Themis Controlled Global Mars Mosaics

We have begun work to prepare for producing controlled 2001 Mars Odyssey THEMIS infrared (IR) and visible (VIS) global mosaics of Mars. This effort is being coordinated with colleagues from Arizona State University and on the THEMIS team who plan to address radiometric issues in making such mosaics. We are concentrating on geometric issues. Several areas of investigation are now in progress, including: a) characterizing the absolute pointing accuracy of THEMIS images; b) investigating whether automatic tie point matching algorithms could be used to provide connections between overlapping THEMIS images; c) developing algorithms to allow for the photogrammetric (bundle) adjustment of the THEMIS IR (line scanner) camera images. Our primary goal in this pilot study effort will be to make several test control THEMIS mosaics and better determine which methods could be used, which require development, and what level of effort is required, in order to make large regional or global controlled THEMIS mosaics.

Archinal, B. A.↗

Localization and physical properties experiments conducted by Spirit at Gusev Crater

The precise location and relative elevation of Spirit during its traverses from the Columbia Memorial station to Bonneville crater were determined with bundle-adjusted retrievals from rover wheel turns, suspension and tilt angles, and overlapping images. Physical properties experiments show a decrease of 0.2% per Mars solar day in solar cell output resulting from deposition of airborne dust, cohesive soil-like deposits in plains and hollows, bright and dark rock coatings, and relatively weak volcanic rocks of basaltic composition. Volcanic, impact, aeolian, and water-related processes produced the encountered landforms and materials.

Mars↗

3D Lunar Terrain Reconstruction from Apollo Images

Generating accurate three dimensional planetary models is becoming increasingly important as NASA plans manned missions to return to the Moon in the next decade. This paper describes a 3D surface reconstruction system called the Ames Stereo Pipeline that is designed to produce such models automatically by processing orbital stereo imagery. We discuss two important core aspects of this system: (1) refinement of satellite station positions and pose estimates through least squares bundle adjustment; and (2) a stochastic plane fitting algorithm that generalizes the Lucas-Kanade method for optimal matching between stereo pair images.. These techniques allow us to automatically produce seamless, highly accurate digital elevation models from multiple stereo image pairs while significantly reducing the influence of image noise. Our technique is demonstrated on a set of 71 high resolution scanned images from the Apollo 15 mission

Broxton, Michael J.↗

Orthographic Stereo Correlator on the Terrain Model for Apollo Metric Images

A stereo correlation method on the object domain is proposed to generate the accurate and dense Digital Elevation Models (DEMs) from lunar orbital imagery. The NASA Ames Intelligent Robotics Group (IRG) aims to produce high-quality terrain reconstructions of the Moon from Apollo Metric Camera (AMC) data. In particular, IRG makes use of a stereo vision process, the Ames Stereo Pipeline (ASP), to automatically generate DEMs from consecutive AMC image pairs. Given camera parameters of an image pair from bundle adjustment in ASP, a correlation window is defined on the terrain with the predefined surface normal of a post rather than image domain. The squared error of back-projected images on the local terrain is minimized with respect to the post elevation. This single dimensional optimization is solved efficiently and improves the accuracy of the elevation estimate.

Terrain Model↗

Mid-Air Range-Visual-Inertial Estimator Initialization for Micro Air Vehicles

Monocular Visual-Inertial Odometry (VIO) has become ubiquitous for navigation of autonomous Micro Air Vehicles (MAVs). Yet, state-of-the-art VIO is still very failure- prone, which can have dramatic consequences. To prevent this, VIO must be able to re-initialize in mid-air, either during a free fall or on a constant horizontal velocity trajectory after attitude control has been re-established. However, for both of these trajectories, the visual scale cannot be observed with VIO batch initializers because of the absence of acceleration change. We propose to use a small and lightweight laser range finder and a scene facet model to initialize vision-based navigation at the right scale under any motion condition and over any scene structure. This new range constraint is integrated into a visual-inertial bundle adjustment initializer. We demonstrate in simulation and real data how this approach can address mid-air state estimation failure in real-time and analyze the sensitivity of estimators to initial state errors.

Brockers, Roland↗

Vision-based Velocimetry over Unknown Terrain with a Low-Noise IMU

This paper presents a novel approach to terrain-relative navigation with a visual camera and Inertial Measurement Unit (IMU). The proposed algorithm uses an Extended Kalman Filter (EKF) to combine an IMU propagated state estimate with batch correction estimates computed over a sliding window of measurements. The batch correction algorithm follows the Maximum Likelihood Estimation (MLE) approach used in other Bundle Adjustment systems. Unlike other systems, the proposed system parameterizes the state over the entire window in terms of the state at a single epoch. By ignoring IMU error over the window duration, we obtain a state epoch MLE that jointly estimates the epoch state and terrain parameters with drastically reduced computationally cost. This paper presents the general architecture which can be adapted for various state parameterizations and measurement inputs. For space applications with high-accuracy IMUs, the reduction in computational cost comes with only a modest increase in estimation errors. The increase in error is quantified via a linear covariance analysis presented in this paper. Furthermore, we present simulation results which show the applicability of this algorithm to planetary landing problems.

San Martin, A. Miguel↗

Development of the Model Deformation System at the National Transonic Facility

This paper describes the model deformation system currently being developed for the National Transonic Facility at NASA Langley Research Center. The photogrammetry system uses up to eight network cameras that are time synced with an external hardware trigger. Camera extrinsics are calculated per frame with a bundle adjustment process with coded targets painted to the floor and walls of the test section. We describe our algorithm pipeline including the coded target system for target correspondence between camera views. We also present our future plans for modernizing the system.

Timothy Fahringer↗

Development of the model deformation system at the National Transonic Facility

This paper describes the model deformation system currently being developed for the National Transonic Facility at NASA Langley Research Center. The photogrammetry system uses up to eight network cameras that are time synced with an external hardware trigger. Camera extrinsics are calculated per frame with a bundle adjustment process with coded targets painted to the floor and walls of the test section. We describe our algorithm pipeline including the coded target system for target correspondence between camera views. We also present our future plans for modernizing the system.

Timothy Fahringer↗

Accuracy Analysis on Large Blocks of High Resolution Images

Although high altitude frequencies effects are removed at the time of basic image generation, low altitude (Yaw) effects are still present in form of affinity/angular affinity. They are effectively removed by additional parameters. Bundle block adjustment based on properly weighted ephemeris/altitude quaternions (BBABEQ) are not enough to remove the systematic effect. Moreover, due to the narrow FOV of the HRSI, position and altitude are highly correlated making it almost impossible to separate and remove their systematic effects without extending the geometric model (Self-Calib.) The systematic effects gets evident on the increase of accuracy (in terms of RMSE at GCPs) for looser and relaxed ground control at the expense of large and strong block deformation with large residuals at check points. Systematic errors are most freely distributed and their effects propagated all over the block.

Passini, Richardo M.↗

Automated Data Production For A Novel Airborne Multiangle Spectropolarimetric Imager (AIRMSPI)

A novel polarimetric imaging technique making use of rapid retardance modulation has been developed by JPL as a part of NASA's Instrument Incubator Program. It has been built into the Airborne Multiangle SpectroPolarimetric Imager (AirMSPI) under NASA's Airborne Instrument Technology Transition Program, and is aimed primarily at remote sensing of the amounts and microphysical properties of aerosols and clouds. AirMSPI includes an 8-band (355, 380, 445, 470, 555, 660, 865, 935 nm) pushbroom camera that measures polarization in a subset of the bands (470, 660, and 865 nm). The camera is mounted on a gimbal and acquires imagery in a configurable set of along-track viewing angles ranging between +67 deg and -67 deg relative to nadir. As a result, near simultaneous multi-angle, multi-spectral, and polarimetric measurements of the targeted areas at a spatial resolution ranging from 7 m to 20 m (depending on the viewing angle) can be derived. An automated data production system is being built to support high data acquisition rate in concert with co-registration and orthorectified mapping requirements. To date, a number of successful engineering checkout flights were conducted in October 2010, August-September 2011, and January 2012. Data products resulting from these flights will be presented.

Multi-angle↗