Search NASA⌕ Search

SEARCH · Search NASA

Results for “pose estimation algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Automatic Calibration and Health Monitoring of Infrastructure Sensors

Smart transportation infrastructure relies on networks of heterogeneous sensors - cameras, radars, and lidars - continuously monitoring traffic conditions. However, executing the initial spatial calibration of multiple sensors and the subsequent health monitoring presents significant operational challenges. Environmental factors, mechanical vibrations, and gradual drift cause spatial misalignment, degrading fusion performance and tracking accuracy. Traditional calibration approaches require manual intervention with specialized targets or survey equipment, resulting in service interruptions and high maintenance costs. This work presents an automated framework for initial calibration and continuous health monitoring without human intervention or service disruption. Our approach addresses two critical problems: (1) detecting when sensors become miscalibrated during operation, and (2) automatically re-establishing spatial alignment using only operational traffic data. The health monitoring component analyzes measurement innovations - differences between sensor observations and predicted object states - to detect systematic biases indicative of calibration drift. By computing bias magnitude, directional consistency, and rejection rates, the system identifies miscalibrations as small as 0.5 meters. Unlike traditional methods requiring known calibration targets, our diagnostic operates continuously on live traffic observations, enabling early detection before fusion quality degrades. The automatic recalibration algorithm leverages overlapping sensor fields-of-view and temporal correlation of vehicle observations. Using graph-based optimization, the system automatically discovers which sensor pairs observe common regions, estimates pairwise spatial transformations using RANSAC-based robust estimation, and jointly optimizes all sensor poses through bundle adjustment. The framework handles practical deployment challenges, including different sensor sampling rates (1-10 Hz), varying installation positions, unknown orientations, and limited overlap regions (>10%). When approximate sensor positions are available from installation surveys (+/-1m accuracy), the algorithm additionally estimates sensor orientations, refining both position and rotation to sub-meter and sub-degree accuracy. We validate the framework on multi-hour traffic datasets from six heterogeneous sensors with sampling rates ranging from 1 Hz to 10 Hz. Results demonstrate successful calibration even with sparse overlap (<20%) and automatic detection of miscalibrations exceeding 0.8 meters. This work enables a "deploy-and-forget" sensor infrastructure that maintains calibration autonomously, reducing maintenance costs while improving tracking accuracy. The techniques generalize beyond transportation to any multi-sensor monitoring application requiring robust spatial alignment, including smart cities, industrial monitoring, and surveillance systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Human-Robot Control Strategies for the NASA/DARPA Robonaut

The Robotic Systems Technology Branch at the NASA Johnson Space Center (JSC) is currently developing robot systems to reduce the Extra-Vehicular Activity (EVA) and planetary exploration burden on astronauts. One such system, Robonaut, is capable of interfacing with external Space Station systems that currently have only human interfaces. Robonaut is human scale, anthropomorphic, and designed to approach the dexterity of a space-suited astronaut. Robonaut can perform numerous human rated tasks, including actuating tether hooks, manipulating flexible materials, soldering wires, grasping handrails to move along space station mockups, and mating connectors. More recently, developments in autonomous control and perception for Robonaut have enabled dexterous, real-time man-machine interaction. Robonaut is now capable of acting as a practical autonomous assistant to the human, providing and accepting tools by reacting to body language. A versatile, vision-based algorithm for matching range silhouettes is used for monitoring human activity as well as estimating tool pose.

Diftler, M. A.↗

On three dimensional object recognition and pose-determination: An abstraction based approach

A method of computing reliable Gaussian and mean curvature sign-map descriptors from the polynomial approximation of surfaces was demonstrated. Such descriptors which are invariant under perspective variation are suitable for hypothesis generation. A means for determining the pose of constructed geometric forms whose algebraic surface descriptors are nonlinear in terms of their orienting parameters was developed. This was done by means of linear functions which are capable of approximating nonlinear forms and determining their parameters. It was shown that biquadratic surfaces are suitable companion linear forms for cylindrical approximation and parameter estimation. The estimates provided the initial parametric approximations necessary for a nonlinear regression stage to fine tune the estimates by fitting the actual nonlinear form to the data. A hypothesis-based split-merge algorithm for extraction and pose determination of cylinders and planes which merge smoothly into other surfaces was developed. It was shown that all split-merge algorithms are hypothesis-based. A finite-state algorithm for the extraction of the boundaries of run-length regions was developed. The computation takes advantage of the run list topology and boundary direction constraints implicit in the run-length encoding.

Quek, Kok How Francis↗

Autonomous 3D and Radiation Mapping in Tunnel Environments Using Aerial Robots - 18156

In this paper we present the algorithms and systems developed to enable autonomous 3D and radiation mapping, as well as radiological source localization in tunnel environments using aerial robots. The developed technologies aim to address the need of autonomous robotic inspection of nuclear sites such as facilities in the process of being decommissioned. As a motivational example, the PUREX tunnels at the Hanford Site are considered and the robot is designed to be able to conduct multi-modal 3D/radiation characterization of the tunnel environment without any prior knowledge or map provided beforehand. In order to enable the necessary GPS-denied simultaneous localization and mapping in dark, visually-degraded tunnel environments, a multi-modal mapping unit was developed which fuses the data from stereo vision cameras synchronized with flashing LEDs, inertial sensors, and three time-of-flight 3D depth sensors. The robot's pose and surrounding map are estimated at 20 Hz through a depth-enhanced visual- inertial localization and mapping framework. Provided this ability to estimate the robot's pose and develop a dense map in real-time, a receding horizon sampling-based autonomous exploration path planning algorithm was utilized and equips the robot with the ability to explore its environment given no prior map. The aforementioned key robotic functionalities are further extended through the integration of miniaturized fully solid-state scintillation detectors, utilizing advanced scintillators and Silicon Photomultipliers. The derived sensor data is employed for radiation mapping, which when fused with the 3D maps and the spectroscopic source localization methods, allow the aerial robotic platform to localize the radiation source and identify the specific source isotope. The source location is estimated through a geometric algorithm which can localize a source given only three measurements and short dwell times. The developed systems were tested using two small aerial robot platforms of the F450 and F550 frame classes with weights of 2.6 kg and 2.9 kg respectively. All localization and planning as well as high-level control algorithms are executed onboard. The scintillation detector is integrated on the robot and its data is collected through a dedicated microcontroller. A set of field experiments were conducted inside the dark and GPS-denied environment of a 4.25 m wide, 7.5 m tall, and 137 m long railroad tunnel. A Cs-137 source was placed within the tunnel, the associated 3D/radiation maps were derived, and the source location was estimated. Through these efforts, the goal is to develop the robotic technology that would enable the autonomous systematic inspection or emergency response in nuclear waste decommissioning facilities. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

History matching by spline approximation and regularization in single-phase areal reservoirs

An automatic history matching algorithm is developed based on bi-cubic spline approximations of permeability and porosity distributions and on the theory of regularization to estimate permeability or porosity in a single-phase, two-dimensional real reservoir from well pressure data. The regularization feature of the algorithm is used to convert the ill-posed history matching problem into a well-posed problem. The algorithm employs the conjugate gradient method as its core minimization method. A number of numerical experiments are carried out to evaluate the performance of the algorithm. Comparisons with conventional (non-regularized) automatic history matching algorithms indicate the superiority of the new algorithm with respect to the parameter estimates obtained. A quasioptimal regularization parameter is determined without requiring a priori information on the statistical properties of the observations.

Lee, T. Y.↗

Optimal Estimation Retrievals and Their Uncertainties: What Every Atmospheric Scientist Should Know

Remote sensing instruments are heavily used to provide observations for both the operational and research communities. These sensors do not provide direct observations of the desired atmospheric variables, but instead, retrieval algorithms are necessary to convert the indirect observations into the variable of interest. It is critical to be aware of the underlying assumptions made by many retrieval algorithms, including that the retrieval problem is often ill posed and that there are various sources of uncertainty that need to be treated properly. In short, the retrieval challenge is to invert a set of noisy observations to obtain estimates of atmospheric quantities. The problem is often complicated by imperfect forward models, by imperfect prior knowledge, and by the existence of nonunique solutions. Optimal estimation (OE) is a widely used physical retrieval method that combines measurements, prior information, and the corresponding uncertainties based on Bayes’s theorem to find an optimal solution for the atmospheric state. Furthermore, OE also allows the relative contributions of the different sources of error to the uncertainty in the final retrieved atmospheric state to be understood. Here, we provide a novel Python library to illustrate the use of OE for inverse problems in the atmospheric sciences. We introduce two example problems: how to retrieve drop size distribution parameters from radar observations and how to retrieve the temperature profile from ground-based microwave sensors. Using these examples, we discuss common pitfalls, how the various error sources impact the retrieval, and how the quality of the retrieval results can be quantified.

54 ENVIRONMENTAL SCIENCES↗

Visual SLAM Using Variance Grid Maps

An algorithm denoted Gamma-SLAM performs further processing, in real time, of preprocessed digitized images acquired by a stereoscopic pair of electronic cameras aboard an off-road robotic ground vehicle to build accurate maps of the terrain and determine the location of the vehicle with respect to the maps. Part of the name of the algorithm reflects the fact that the process of building the maps and determining the location with respect to them is denoted simultaneous localization and mapping (SLAM). Most prior real-time SLAM algorithms have been limited in applicability to (1) systems equipped with scanning laser range finders as the primary sensors in (2) indoor environments (or relatively simply structured outdoor environments). The few prior vision-based SLAM algorithms have been feature-based and not suitable for real-time applications and, hence, not suitable for autonomous navigation on irregularly structured terrain. The Gamma-SLAM algorithm incorporates two key innovations: Visual odometry (in contradistinction to wheel odometry) is used to estimate the motion of the vehicle. An elevation variance map (in contradistinction to an occupancy or an elevation map) is used to represent the terrain. The Gamma-SLAM algorithm makes use of a Rao-Blackwellized particle filter (RBPF) from Bayesian estimation theory for maintaining a distribution over poses and maps. The core idea of the RBPF approach is that the SLAM problem can be factored into two parts: (1) finding the distribution over robot trajectories, and (2) finding the map conditioned on any given trajectory. The factorization involves the use of a particle filter in which each particle encodes both a possible trajectory and a map conditioned on that trajectory. The base estimate of the trajectory is derived from visual odometry, and the map conditioned on that trajectory is a Cartesian grid of elevation variances. In comparison with traditional occupancy or elevation grid maps, the grid elevation variance maps are much better for representing the structure of vegetated or rocky terrain.

Howard, Andrew B.↗

Raven: An On-Orbit Relative Navigation Demonstration Using International Space Station Visiting Vehicles

Since the last Hubble Servicing Mission five years ago, the Satellite Servicing Capabilities Office (SSCO) at the NASA Goddard Space Flight Center (GSFC) has been focusing on maturing the technologies necessary to robotically service orbiting legacy assets-spacecraft not necessarily designed for in-flight service. Raven, SSCO's next orbital experiment to the International Space Station (ISS), is a real-time autonomous non-cooperative relative navigation system that will mature the estimation algorithms required for rendezvous and proximity operations for a satellite-servicing mission. Raven will fly as a hosted payload as part of the Space Test Program's STP-H5 mission, which will be mounted on an external ExPRESS Logistics Carrier (ELC) and will image the many visiting vehicles arriving and departing from the ISS as targets for observation. Raven will host multiple sensors: a visible camera with a variable field of view lens, a long-wave infrared camera, and a short-wave flash lidar. This sensor suite can be pointed via a two-axis gimbal to provide a wide field of regard to track the visiting vehicles as they make their approach. Various real-time vision processing algorithms will produce range, bearing, and six degree of freedom pose measurements that will be processed in a relative navigation filter to produce an optimal relative state estimate. In this overview paper, we will cover top-level requirements, experimental concept of operations, system design, and the status of Raven integration and test activities.

Rendezvous↗

Localization from Visual Landmarks on a Free-Flying Robot

We present the localization approach for Astrobee, a new free-flying robot designed to navigate autonomously on the International Space Station (ISS). Astrobee will accommodate a variety of payloads and enable guest scientists to run experiments in zero-g, as well as assist astronauts and ground controllers. Astrobee will replace the SPHERES robots which currently operate on the ISS, whose use of fixed ultrasonic beacons for localization limits them to work in a 2 meter cube. Astrobee localizes with monocular vision and an IMU, without any environmental modifications. Visual features detected on a pre-built map, optical flow information, and IMU readings are all integrated into an extended Kalman filter (EKF) to estimate the robot pose. We introduce several modifications to the filter to make it more robust to noise, and extensively evaluate the localization algorithm.

Coltin, Brian↗

Interannual Variability of the Tropical Water Cycle: Capabilities in the TRMM Era and Challenges for GPM

Considerable uncertainty surrounds the issue of whether precipitation over the tropical oceans (30" NE) systematically changes with interannual sea-surface temperature (SST) anomalies that accompany El Nino (warm) and La Nina (cold) events. Although it is well documented that El Nino-Southern Oscillation (ENSO) events with marked SST changes over the tropical oceans, produce significant regional changes in precipitation, water vapor, and radiative fluxes in the tropics, we still cannot yet adequately quantify the associated net integrated changes to water and heat balance over the entire tropical oceanic or land sectors. Robertson et al., [2001 GRL] for example, showed that substantial disagreement exists among contemporary satellite estimates of interannual variations in tropical rainfall that are associated with SST changes. Berg et al., [2002 J. Climate] have documented the distinct differences between precipitation structure over the eastern and western Pacific ITCZ and noted how various satellite precipitation algorithms may respond quite differently to ENSO modulations of these precipitation regimes. Resolving this uncertainty is important since precipitation and latent heat release variations over land and ocean sectors are key components of the tropical heat balance in its most aggregated form. Rainfall estimates from the Tropical Rainfall Measuring Mission (TRMM) Precipitation Radar (PR) averaged over the tropical oceans have not solved this issue and, in fact, show marked differences with estimates from two TRMM Microwave Imager (TMI) passive microwave algorithms. In this paper we will focus on findings that uncertainties in microphysical assumptions necessitated by the single-frequency PR measurement pose difficulties for detecting climate-related precipitation signals. Recent work has shown that path-integrated attenuation derived from the effects of precipitation on the radar return from the ocean surface exhibits interannual variability that agrees closely with the TMI time series, yet the PR rainfall interannual variability (and attenuation derived predominantly from reflectivity) differs even in sign. We will explore these apparent inconsistencies and detail their impact on estimates of how ENSO events perturb the tropical rainfall. We will place these results in perspective by considering requirements for precipitation accuracy for global climate variability and change studies involving ENSO, monsoon dynamics and variations, and climate model improvement and validation. The discussion will conclude with an assessment of the implications of these findings for Global Precipitation Mission (GPM) requirements.

Robertson, Franklin R.↗

Fuzzy set methods for object recognition in space applications

Progress on the following tasks is reported: (1) fuzzy set-based decision making methodologies; (2) feature calculation; (3) clustering for curve and surface fitting; and (4) acquisition of images. The general structure for networks based on fuzzy set connectives which are being used for information fusion and decision making in space applications is described. The structure and training techniques for such networks consisting of generalized means and gamma-operators are described. The use of other hybrid operators in multicriteria decision making is currently being examined. Numerous classical features on image regions such as gray level statistics, edge and curve primitives, texture measures from cooccurrance matrix, and size and shape parameters were implemented. Several fractal geometric features which may have a considerable impact on characterizing cluttered background, such as clouds, dense star patterns, or some planetary surfaces, were used. A new approach to a fuzzy C-shell algorithm is addressed. NASA personnel are in the process of acquiring suitable simulation data and hopefully videotaped actual shuttle imagery. Photographs have been digitized to use in the algorithms. Also, a model of the shuttle was assembled and a mechanism to orient this model in 3-D to digitize for experiments on pose estimation is being constructed.

Keller, James M.↗

Interannual Variability of Tropical Rainfall as Seen From TRMM

Considerable uncertainty surrounds the issue of whether precipitation over the tropical oceans (30deg N/S) systematically changes with interannual sea-surface temperature (SST) anomalies that accompany El Nino (warm) and La Nina (cold) events. Although it is well documented that El Nino-Southern Oscillation (ENSO) events with marked SST changes over the tropical oceans produce significant regional changes in precipitation, water vapor, and radiative fluxes in the tropics, we still cannot yet adequately quantify the associated net integrated changes to water and heat balance over the entire tropical oceanic or land sectors. Resolving this uncertainty is important since precipitation and latent heat release variations over land and ocean sectors are key components of the tropical heat balance in its most aggregated form. Rainfall estimates from the Version 5 Tropical Rainfall Measuring Mission (TRMM) Precipitation Radar (PR) averaged over the tropical oceans have not solved this issue and, in fact, show marked differences with estimates from two TRMM Microwave Imager (TMI) passive microwave algorithms. In this paper we will focus on findings that uncertainties in microphysical assumptions necessitated by the single-frequency PR measurement pose difficulties for detecting climate-related precipitation signals. Recent work has shown that path-integrated attenuation derived from the effects of precipitation on the radar return from the ocean surface exhibits interannual variability that agrees closely with the TMI time series, yet the PR rainfall interannual variability (and attenuation derived predominantly from reflectivity) differs even in sign. We will explore these apparent inconsistencies and examine changes in new TRMM Version 6 retrievals. To place these results in a tropical water balance perspective we also examine interannual variations in evaporation over the tropical oceans made from TRMM and SSM/I (Special Sensor Microwave Imager) measurements of surface winds and humidity. Evaporation estimates from reanalysis and several global model experiments will also be compared to the TRMM findings and evaluated for consistency. The ability to detect regional shifts in freshwater flux over the oceans (equivalently, integrated moisture convergence) and moisture transport will be discussed.

Robertson, Franklin R.↗

Total Variation Majorization Minimization (TV-MM) Approach to Radiometer Brightness Temperature Gridding and Reconstruction

This paper presents the implementation of an algorithm to enhance the image resolution of the Earth's surface brightness temperature (T B ) data measured by radiometers such as the one onboard of the Soil Moisture Active Passive (SMAP) mission. A key step in radiometer T B processing is the conversion of the swath-based calibrated antenna temperature (T A ) measurements to the Level 3 Earth-centered grid. The simplest algorithm to transform this data from swath to gridded format is called drop-in-the-bucket which simply averages surrounding noisy T A samples to form a T B value at the gridded location. This method reduces noise, however produces low resolution products. To obtain a higher resolution product, SMAP uses other techniques such the Backus-Gilbert (BG) algorithm, which is the conventional method used in microwave radiometry. Although this method performs the required interpolation, it is not effective in denoising and removing blurring effects due to antenna filtering of the radiometer image data. Our motivation for this development is to further improve the resolution through post-processing of the radiometer T B image, a highly cost-effective method of image enhancement. The approach adapted in this work is based on the minimization of the Total Variation (TV) regularized objective function that is used extensively in solving general ill-posed linear inverse problems in image processing. Since the TV-based objective function is convex but not everywhere differentiable, there exists many numerical algorithms that can estimate the solution and the one selected for this work is called Majorization- Minimization (MM). By applying this algorithm, simulation experiments were performed based on synthetic data from the Geophysical model as well as real SMAP data to demonstrate the effectiveness of the technique. Results were then compared against the BG method.

Wing Lee↗

Vision based object pose estimation for mobile robots

Mobile robot navigation using visual sensors requires that a robot be able to detect landmarks and obtain pose information from a camera image. This paper presents a vision system for finding man-made markers of known size and calculating the pose of these markers. The algorithm detects and identifies the markers using a weighted pattern matching template. Geometric constraints are then used to calculate the position of the markers relative to the robot. The selection of geometric constraints comes from the typical pose of most man-made signs, such as the sign standing vertical and the dimensions of known size. This system has been tested successfully on a wide range of real images. Marker detection is reliable, even in cluttered environments, and under certain marker orientations, estimation of the orientation has proven accurate to within 2 degrees, and distance estimation to within 0.3 meters.

Wu, Annie↗

Phase estimation algorithm for the multibeam optical metrology

Unitary Fourier transform lies at the core of the multitudinous computational and metrological algorithms. Here we show experimentally how the unitary Fourier transform-based phase estimation protocol, used namely in quantum metrology, can be translated into the classical linear optical framework. The developed setup made of beam splitters, mirrors and phase shifters demonstrates how the classical coherence, similarly to the quantum coherence, poses a resource for obtaining information about the measurable physical quantities. Our study opens route to the reliable implementation of the small-scale unitary algorithms on path-encoded qudits, thus establishing an easily accessible platform for unitary computation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Spacecraft Operation Emulation Via Six DOF Tendon-Actuated Robot

NASA Johnson Space Center’s (JSC) Simulation, Emulation, Navigation, Sensors and STAR (SENSS) Laboratory has developed a large-scale six degree of freedom tendon-actuated robot (STAR) for emulation of spacecraft proximity operations and Entry, Descent, and Landing approach trajectories to aid in the rapid development and testing of a wide range of guidance, navigation, and control algorithms at low cost.

navigation↗

An adaptive synchronous extraction (ASE) method for estimating intensity and footprint of surface urban heat islands: A case study of 254 North American cities

The urban heat island (UHI) effect has attracted great attention due to its potential impacts on rapidly growing urban areas. Using remotely sensed estimates of land surface temperature (LST), a large number of studies have focused on the surface UHI (SUHI) effect, which can be characterized by its two fundamental properties: intensity and footprint. The SUHI intensity reflects the LST difference between the urban area and the background reference area (BRA), and the SUHI footprint indicates the spatial extent influenced by the heat island. Currently, numerous methods have been developed to estimate the SUHI intensity and footprint, but are still greatly challenged by three main issues. Namely, the discrepancy in BRA selection criterion brings great uncertainty to the estimated SUHI intensity, the estimation of SUHI footprint is largely constrained by the predefined models, and the quantification of SUHI effect is potentially influenced by several confounding factors. Here, we proposed an adaptive synchronous extraction (ASE) method, which is capable of adaptively selecting the most optimal BRA while removing the influence of confounding factors, and achieving synchronous estimation of SUHI intensity and footprint. We applied the ASE method to 254 North American cities and conducted an in-depth comparative analysis to discuss its applicability and benefits. The main results include: (1) The ASE method avoids the limitations of existing methods in BRA selection and model presetting, and shows resilience to parameter variations. This makes the ASE method highly applicable to quantify the SUHI intensity and footprint in cities with various thermal characteristics. (2) The ASE method can better highlight the spatial, seasonal and day-night contrasts in the estimated SUHI intensity. This superiority is particularly evident when comparing it to methods based on the equal-area buffer or the simplified urban-extent algorithm. (3) Confounding factors pose non-negligible impacts on the quantification of the SUHI effect. Typically, ignoring the influence of topographic relief or missing LST data can lead to an overall overestimation of the SUHI intensity, while not removing surrounding urban areas will cause some underestimation of the SUHI intensity. In conclusion, overall, the proposed ASE method provides a new generalizable tool for quantifying the SUHI effect, which has great potentials for future studies and urban climate assessments.

54 ENVIRONMENTAL SCIENCES↗

Convective precipitation retrievals from space-borne dual frequency (Ka- and W-band) radar observations

The 2017 Decadal Survey highlighted Earth System Science themes, science and application questions that led to the inclusion aerosols (A), clouds, convection, and precipitation (CCP) in the list of designated observables (DOs) to be pursued within the decade following the survey. Multiple observing system architectures were considered during the NASA A-CCP study, and dual frequency Ka-W band radars have been identified as components of the most likely architectures due to their ability to significantly contribute to the achievement of the science objectives and their synergy with other essential instruments. We present an algorithm to estimate convective precipitation from dual frequency, Ka- and W-band, observations applicable to the observing system architectures considered in the A-CCP study. The algorithm is based on the radar profiling algorithm used within the operational NASA GPM combined algorithm but features an additional module that makes the retrieval problem well-posed in cases of severe attenuation and potential loss of signal below the freezing level. The additional module is developed from GPM combined retrievals and consists of a procedure that generates an ensemble of potential retrievals consistent with the portions of the Ka-band and W-band observation profiles above the noise level. The ensemble solution is refined based on estimates of Path Integrated Attenuation (PIA) from the Surface Reference Technique (SRT) and radiometric observations.

Mircea Grecu↗