Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image navigation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

An improved method for precise automatic co-registration of moderate and high-resolution spacecraft imagery

Improvements to the automated co-registration and change detection software package, AFIDS (Automatic Fusion of Image Data System) has recently completed development for and validation by NGA/GIAT. The improvements involve the integration of the AFIDS ultra-fine gridding technique for horizontal displacement compensation with the recently evolved use of Rational Polynomial Functions/ Coefficients (RPFs/RPCs) for image raster pixel position to Latitude/Longitude indexing. Mapping and orthorectification (correction for elevation effects) of satellite imagery defies exact projective solutions because the data are not obtained from a single point (like a camera), but as a continuous process from the orbital path. Standard image processing techniques can apply approximate solutions, but advances in the state-of-the-art had to be made for precision change-detection and time-series applications where relief offsets become a controlling factor. The earlier AFIDS procedure required the availability of a camera model and knowledge of the satellite platform ephemeredes. The recent design advances connect the spacecraft sensor Rational Polynomial Function, a deductively developed model, with the AFIDS ultrafine grid, an inductively developed representation of the relationship raster pixel position to latitude /longitude. As a result, RPCs can be updated by AFIDS, a situation often necessary due to the accuracy limits of spacecraft navigation systems. An example of precision change detection will be presented from Quickbird.

co-registration↗

Implementation of an algorithm for cylindrical object identification using range data

One of the problems in 3-D object identification and localization is addressed. In robotic and navigation applications the vision system must be able to distinguish cylindrical or spherical objects as well as those of other geometric shapes. An algorithm was developed to identify cylindrical objects in an image when range data is used. The algorithm incorporates the Hough transform for line detection using edge points which emerge from a Sobel mask. Slices of the data are examined to locate arcs of circles using the normal equations of an over-determined linear system. Current efforts are devoted to testing the computer implementation of the algorithm. Refinements are expected to continue in order to accommodate cylinders in various positions. A technique is sought which is robust in the presence of noise and partial occlusions.

Bozeman, Sylvia T.↗

GPS/MEMS IMU/Microprocessor Board for Navigation

A miniaturized instrumentation package comprising a (1) Global Positioning System (GPS) receiver, (2) an inertial measurement unit (IMU) consisting largely of surface-micromachined sensors of the microelectromechanical systems (MEMS) type, and (3) a microprocessor, all residing on a single circuit board, is part of the navigation system of a compact robotic spacecraft intended to be released from a larger spacecraft [e.g., the International Space Station (ISS)] for exterior visual inspection of the larger spacecraft. Variants of the package may also be useful in terrestrial collision-detection and -avoidance applications. The navigation solution obtained by integrating the IMU outputs is fed back to a correlator in the GPS receiver to aid in tracking GPS signals. The raw GPS and IMU data are blended in a Kalman filter to obtain an optimal navigation solution, which can be supplemented by range and velocity data obtained by use of (l) a stereoscopic pair of electronic cameras aboard the robotic spacecraft and/or (2) a laser dynamic range imager aboard the ISS. The novelty of the package lies mostly in those aspects of the design of the MEMS IMU that pertain to controlling mechanical resonances and stabilizing scale factors and biases.

Gender, Thomas K.↗

Alignment Jig for the Precise Measurement of THz Radiation

A miniaturized instrumentation package comprising a (1) Global Positioning System (GPS) receiver, (2) an inertial measurement unit (IMU) consisting largely of surface-micromachined sensors of the microelectromechanical systems (MEMS) type, and (3) a microprocessor, all residing on a single circuit board, is part of the navigation system of a compact robotic spacecraft intended to be released from a larger spacecraft [e.g., the International Space Station (ISS)] for exterior visual inspection of the larger spacecraft. Variants of the package may also be useful in terrestrial collision-detection and -avoidance applications. The navigation solution obtained by integrating the IMU outputs is fed back to a correlator in the GPS receiver to aid in tracking GPS signals. The raw GPS and IMU data are blended in a Kalman filter to obtain an optimal navigation solution, which can be supplemented by range and velocity data obtained by use of (l) a stereoscopic pair of electronic cameras aboard the robotic spacecraft and/or (2) a laser dynamic range imager aboard the ISS. The novelty of the package lies mostly in those aspects of the design of the MEMS IMU that pertain to controlling mechanical resonances and stabilizing scale factors and biases.

Javadi, Hamid H.↗

NASA Tech Briefs, March 2011

Topics covered include: Optimal Tuner Selection for Kalman-Filter-Based Aircraft Engine Performance Estimation; Airborne Radar Interferometric Repeat-Pass Processing; Plug-and-Play Environmental Monitoring Spacecraft Subsystem; Power-Combined GaN Amplifier with 2.28-W Output Power at 87 GHz; Wallops Ship Surveillance System; Source Lines Counter (SLiC) Version 4.0; Guidance, Navigation, and Control Program; Single-Frame Terrain Mapping Software for Robotic Vehicles; Auto Draw from Excel Input Files; Observation Scheduling System; CFDP for Interplanetary Overlay Network; X-Windows Widget for Image Display; Binary-Signal Recovery; Volumetric 3D Display System with Static Screen; MMIC Replacement for Gunn Diode Oscillators; Feature Acquisition with Imbalanced Training Data; Mount Protects Thin-Walled Glass or Ceramic Tubes from Large Thermal and Vibration Loads; Carbon Nanotube-Based Structural Health Monitoring Sensors; Wireless Inductive Power Device Suppresses Blade Vibrations; Safe, Advanced, Adaptable Isolation System Eliminates the Need for Critical Lifts; Anti-Rotation Device Releasable by Insertion of a Tool; A Magnetically Coupled Cryogenic Pump; Single Piezo-Actuator Rotary-Hammering Drill; Fire-Retardant Polymeric Additives; Catalytic Generation of Lift Gases for Balloons; Ionic Liquids to Replace Hydrazine; Variable Emittance Electrochromics Using Ionic Electrolytes and Low Solar Absorptance Coatings; Spacecraft Radiator Freeze Protection Using a Regenerative Heat Exchanger; Multi-Mission Power Analysis Tool; Correction for Self-Heating When Using Thermometers as Heaters in Precision Control Applications; Gravitational Wave Detection with Single-Laser Atom Interferometers; Titanium Alloy Strong Back for IXO Mirror Segments; Improved Ambient Pressure Pyroelectric Ion Source; Multi-Modal Image Registration and Matching for Localization of a Balloon on Titan; Entanglement in Quantum-Classical Hybrid; Algorithm for Autonomous Landing; Quantum-Classical Hybrid for Information Processing; Small-Scale Dissipation in Binary-Species Transitional Mixing Layers; Superpixel-Augmented Endmember Detection for Hyperspectral Images; Coding for Parallel Links to Maximize the Expected Value of Decodable Messages; and Microwave Tissue Soldering for Immediate Wound Closure.

Source record↗

Underwater Mapping Results for Seabotix vLBV300 Vehicle with Tritech Gemini 720i Imaging Sonar near Newport, OR

This document presents results from tests to demonstrate underwater mapping capabilities of an underwater vehicle in conditions typically found in marine renewable energy arrays. These tests were performed with a tethered Seabotix vLBV300 underwater vehicle. The vehicle is equipped with an inertial navigation system (INS) based on a Gladiator Landmark 40 IMU and Teledyne Explorer Doppler Velocity Log, as well as a Gemini 720i scanning sonar acquired from Tritech. The results presented include both indoor pool and offshore deployments. The indoor pool deployments were performed on October 7, 2016 and February 3, 2017 in Corvallis, OR. The offshore deployment was performed on April 20, 2016 off the coast of Newport, OR (44.678 degrees N, 124.109 degrees W). During the mission period, the sea state varied between 3 and 4, with an average significant wave height of 1.6 m. Data was recorded from both the INS and the sonar.

16 TIDAL AND WAVE POWER↗

Tightly-coupled camera/LiDAR integration for point cloud generation from GNSS/INS-assisted UAV mapping systems

Unmanned aerial vehicles (UAVs) equipped with integrated global navigation satellite systems/inertial navigation systems (GNSS/INS) together with cameras and/or LiDAR sensors are being widely used for topographic mapping in a variety of applications such as precision agriculture, coastal monitoring, and archaeological documentation. Integration of image-based and LiDAR point clouds can provide a comprehensive 3D model of the area of interest. For such integration, ensuring a good alignment between data from the different sources is critical. Although many works have been conducted on this topic, there is still a need for a rigorous integration approach that minimizes the discrepancy between camera and LiDAR data caused by inaccurate system calibration parameters and/or trajectory artifacts. This study proposes an automated tightly-coupled camera/LiDAR integration workflow for GNSS/INS-assisted UAV systems. The proposed strategy is conducted in three main steps. First, an image-based point cloud is generated using a LiDAR/GNSS/INS-assisted structure from motion (SfM) strategy. Then, feature correspondences between image-based and LiDAR point clouds are automatically identified. Finally, an integrated-bundle adjustment procedure including image points, LiDAR raw measurements, and GNSS/INS information is conducted to minimize the discrepancy between point clouds from different sensors while estimating system calibration parameters and refining the trajectory information. The proposed SfM strategy and integration framework are evaluated using five datasets. The SfM results show that using LiDAR data can facilitate feature matching and further increase the number of reconstructed 3D points. The experimental results also illustrate that the developed automated camera/LiDAR integration strategy is capable of accurately estimating system calibration parameters to achieve good alignment among camera/LiDAR data from single/multiple systems. Finally, an absolute accuracy in the range of 3–5 cm is achieved for the image/LiDAR point clouds after the integration process.

42 ENGINEERING↗

C/NOFS Observations of Electromagnetic Coupling Between Magnetically Conjugate MSTID Structures

This report demonstrates empirically that couplings between magnetically conjugate medium-scale traveling ionospheric disturbances (MSTIDs) are electromagnetic in nature. This is accomplished by comparing plasma density, electric, and magnetic perturbations sampled simultaneously by sensors on the Communication Navigation Outage Forecasting System (CNOFS) satellite. During the period of interest on 17 February 2010, CNOFS made three consecutive orbits while magnetically conjugate to the field of view of an all-sky imager located at El Leoncito, Argentina (31.8degS, 69.3degW). Imaged 630.0 nm airglow was characterized by alternating bands of relatively bright and dark emissions that were aligned from northeast to southwest and propagated toward the northwest, characteristic of MSTIDs in the southern hemisphere. Measurable Poynting fluxes flow along the Earths magnetic field (S) from generator to load hemispheres. While S was predominantly away from the ionosphere above El Leoncito, interhemispheric energy flows were not one-way streets. Measured Poynting flux intensities diminished with time over the three CNOFS passes, suggesting that source mechanisms of MSTIDs were absent or that initial impedance mismatches between the two hemispheres approached an equilibrium status.

Burke, W. J.↗

Assessing the Relationships Between Sensorimotor Biomarkers and Post-Landing Functional Task Performance

Spaceflight drives adaptive changes in healthy individuals appropriate for sensorimotor function in a microgravity environment. These changes are maladaptive for return to earth's gravity. The inter-individual variability of sensorimotor decrements is striking, although poorly understood. The goal of this study was to identify a set of behavioral, neuroimaging and genetic measures that can be used to predict early post-flight performance on a set of sensorimotor tasks. Astronauts were recruited who previously participated in sensorimotor field tests and/or posturography soon after long-duration spaceflight. Behavioral tests included assessments of sensory dependency and adaptability. Visual dependency involved treadmill walking while viewing a moving virtual visual scene. Vestibular perceptual thresholds were measured while seated during lateral translations. Proprioception dependency was measured during one-legged stance on a horizontal air-bearing surface. Ground assessment of adaptability was performed (1) during treadmill walking with a virtual linear hallway and a moving walking surface, and (2) during multiple trials of navigating an obstacle course while wearing reversing prisms (adaptive Functional Mobility Test, aFMT). The neuroimaging tests characterized individual differences in regional brain volumes (using Structural MRI) and white matter microstructure (using Diffusion Tensor Imaging) to serve as potential predictors of adaptive capacity. The genetic tests utilized saliva samples to examine variations in four genes chosen because of their ability to differentiate sensorimotor adaptation ability in a normative population, including Catechol-O-methyltransferase (COMT), Dopamine Receptor D2 (DRD2), Brain-derived neurotrophic factor (BDNF) and the α2-adrenergic receptor. Thirty ISS crewmembers were recruited, including 12 first-time fliers, 6F, and mission durations lasting 185.5 ± 45.5 days, mean ± std. We utilized a combination of three post-flight functional task outcomes: tandem walk, recovery from fall and dynamic posturography. There was considerable variability among all post-flight performance outcomes. Based on an ordinal scale survey, 72% indicated their ability to perform functional tasks were more impacted postflight relative to inflight with 50% indicating they needed to restrict movements for a longer period postflight relative to inflight. While there is a strong association within tests obtained at different R+0 timepoints, by R+24 hr performance on one post-flight test does not necessarily correlate with performance on other post-flight tests. Preliminary statistical analysis indicates combining biomarkers will increase predictive power and this will be explored with future analyses. Our preliminary findings underscore the importance of a comprehensive post-flight test battery including different types of tasks with varying sensory feedback. Understanding the relationships between these sensorimotor biomarkers and post-flight functional task performance improve both our understanding of the individual variability and our strategy to optimize sensorimotor countermeasures.

biomarkers↗

Results from the ASTERIA CubeSat Extended Mission Experiments

Over the past two years, JPL has used the ASTERIA (Arcsecond Space Telescope Enabling Research In Astrophysics) CubeSat as an in-flight test platform during extended missions. ASTERIA successfully completed its prime mission in early 2018, and continued to operate in low Earth orbit (LEO) for an additional twenty months. This paper describes demonstrations that were performed on the spacecraft and on the ground-based testbed during the extended mission. These demonstrations fall into three categories: Autonomy technology maturation, hardware characterization, and science discovery. Autonomy technology maturation supported three development efforts. The first shifted the spacecraft commanding paradigm from time-based sequences to Task Networks (tasknets), which allow simpler commanding and more robust onboard execution. The second demonstrated onboard orbit determination in Low Earth Orbit (LEO) without GPS. This activity used a fully-independent means of spacecraft orbit determination for Earth orbiters using only passive imaging. The third technology provided in situ hardware health state estimation using a model-based reasoning technique. These three technologies were demonstrated either in flight or on the testbed individually, and then were combined to demonstrate the capability to perform autonomous navigation on board without ground intervention, even in the presence of anomalies. Hardware characterization involved both onboard and ground-based activities. On board, nonstandard attitude control modes were commanded to characterize the spacecraft pointing jitter as a function of target brightness, reaction wheel speed, controller gain, and the number of guide stars. The results provide insights into the contribution of jitter to the ASTERIA photometry and inform the feasibility of future astrophysics small satellite missions for which jitter control is an enabling technology. On the ground, the ASTERIA Operations Team coordinated with Amazon Web Services (AWS) to configure their new ground stations to communicate with ASTERIA to prove out their viability. ASTERIA used AWS ground stations for nominal operations for the last four months of the mission. Finally, ASTERIA continued to perform exoplanet science as the spacecraft was well-suited to execute long-term monitoring of stars such as alpha Centauri to search for small transiting planets. The science team also imaged a number of interesting objects including a comet, an asteroid, cities at night, and the moon, and coordinated with other projects on Targets of Opportunity for follow-up confirmations and co-observations. Throughout the prime and the extended missions, the ASTERIA spacecraft proved to be a mighty platform that “will go into history as an innovative milestone.”[1 - Zurbuchen]

Doran, Patrick↗

Robust Vision-based Multi-spacecraft Guidance Navigation and Control using CNN-based Pose Estimation

In this paper, we present an end-to-end simulation framework for tracking an uncooperative Target spacecraft in Low Earth Orbit using a CubeSat-class Ego spacecraft outfitted with a camera. Currently, capturing high-fidelity realistic images in space for this scenario is difficult and exorbitantly expensive. Therefore, we developed a framework to simulate the spacecraft orbits in Basilisk software and generate high-fidelity realistic images of spacecraft in Unreal Engine, including the effects from Sun, Earth, Moon and stars. The Ego spacecraft uses cameras to capture images of the uncooperative Target and estimates its position and attitude using a CNN based 6DOF pose estimation pipeline, eliminating need for large SWAP-C(Size, Weight, Power and Cost) sensors like LIDAR or reliance on inter-spacecraft communication, This CNN, which is motivated by ESA’s Pose Estimation challenge of 2019, is trained using simulated data from our end-to-end simulation framework. We compare the performance of two distinct CNNbased algorithms for pose estimation along a nominal trajectory. In presence of non-Gaussian modeling uncertainties, the statedependent estimation error is characterized with a quadratic upper-bound. The quadratically-bounded error can be used by a robust controller to maneuver

Rahmani, Amir↗

Raven: An On-Orbit Relative Navigation Demonstration Using International Space Station Visiting Vehicles

Since the last Hubble Servicing Mission five years ago, the Satellite Servicing Capabilities Office (SSCO) at the NASA Goddard Space Flight Center (GSFC) has been focusing on maturing the technologies necessary to robotically service orbiting legacy assets-spacecraft not necessarily designed for in-flight service. Raven, SSCO's next orbital experiment to the International Space Station (ISS), is a real-time autonomous non-cooperative relative navigation system that will mature the estimation algorithms required for rendezvous and proximity operations for a satellite-servicing mission. Raven will fly as a hosted payload as part of the Space Test Program's STP-H5 mission, which will be mounted on an external ExPRESS Logistics Carrier (ELC) and will image the many visiting vehicles arriving and departing from the ISS as targets for observation. Raven will host multiple sensors: a visible camera with a variable field of view lens, a long-wave infrared camera, and a short-wave flash lidar. This sensor suite can be pointed via a two-axis gimbal to provide a wide field of regard to track the visiting vehicles as they make their approach. Various real-time vision processing algorithms will produce range, bearing, and six degree of freedom pose measurements that will be processed in a relative navigation filter to produce an optimal relative state estimate. In this overview paper, we will cover top-level requirements, experimental concept of operations, system design, and the status of Raven integration and test activities.

Rendezvous↗

Vehicle Lateral Offset Estimation Using Infrastructure Information for Reduced Compute Load

Accurate perception of the driving environment and a highly accurate position of the vehicle are paramount to safe Autonomous Vehicle (AV) operation. AVs gather data about the environment using various sensors. For a robust perception and localization system, incoming data from multiple sensors is usually fused together using advanced computational algorithms, which historically requires a high-compute load. To reduce AV compute load and its negative effects on vehicle energy efficiency, we propose a new infrastructure information source (IIS) to provide environmental data to the AV. The new energy–efficient IIS, chip–enabled raised pavement markers are mounted along road lane lines and are able to communicate a unique identifier and their global navigation satellite system position to the AV. This new IIS is incorporated into an energy efficient sensor fusion strategy that combines its information with that from traditional sensor. IIS reduce the need for camera imaging, image processing, and LIDAR use and point cloud processing. We show that IIS, when combined with traditional sensors, results in more accurate perception and localization outcomes and a reduced AV compute load.

Sharma, Sachin↗

Insect-Based Vision for Autonomous Vehicles: A Feasibility Study

The aims of the project were to use a high-speed digital video camera to pursue two questions: i) To explore the influence of temporal imaging constraints on the performance of vision systems for autonomous mobile robots; To study the fine structure of insect flight trajectories with in order to better understand the characteristics of flight control, orientation and navigation.

Srinivasan, Mandyam V.↗

Insect-Based Vision for Autonomous Vehicles: A Feasibility Study

The aims of the project were to use a high-speed digital video camera to pursue two questions: (1) To explore the influence of temporal imaging constraints on the performance of vision systems for autonomous mobile robots; (2) To study the fine structure of insect flight trajectories in order to better understand the characteristics of flight control, orientation and navigation.

Srinivasan, Mandyam V.↗

Real-time Enhanced Vision System

Flying in poor visibility conditions, such as rain, snow, fog or haze, is inherently dangerous. However these conditions can occur at nearly any location, so inevitably pilots must successfully navigate through them. At NASA Langley Research Center (LaRC), under support of the Aviation Safety and Security Program Office and the Systems Engineering Directorate, we are developing an Enhanced Vision System (EVS) that combines image enhancement and synthetic vision elements to assist pilots flying through adverse weather conditions. This system uses a combination of forward-looking infrared and visible sensors for data acquisition. A core function of the system is to enhance and fuse the sensor data in order to increase the information content and quality of the captured imagery. These operations must be performed in real-time for the pilot to use while flying. For image enhancement, we are using the LaRC patented Retinex algorithm since it performs exceptionally well for improving low-contrast range imagery typically seen during poor visibility conditions. In general, real-time operation of the Retinex requires specialized hardware. To date, we have successfully implemented a single-sensor real-time version of the Retinex on several different Digital Signal Processor (DSP) platforms. In this paper we give an overview of the EVS and its performance requirements for real-time enhancement and fusion and we discuss our current real-time Retinex implementations on DSPs.

Hines, Glenn D.↗

Assessing the Relationships Between Sensorimotor Biomarkers and Post-Landing Functional Task Performance

Spaceflight drives adaptive changes in healthy individuals appropriate for sensorimotor function in a microgravity environment. These changes are maladaptive for return to earth's gravity. The inter-individual variability of sensorimotor decrements is striking, although poorly understood. The goal of this study is to identify a set of behavioral, neuroimaging and genetic measures that can be used to predict early post-flight performance on a set of sensorimotor tasks. Astronauts are recruited who previously participated in sensorimotor field tests and/or posturography soon after long-duration spaceflight. Behavioral tests include assessments of sensory dependency and adaptability. Visual dependency involves treadmill walking while viewing a moving virtual visual scene. Vestibular perceptual thresholds are measured while seated during lateral translations. Proprioception dependency is measured during one-legged stance on a horizontal air-bearing surface. Ground assessment of adaptability is performed(1) during treadmill walking with a virtual linear hallway and a moving walking surface, and (2) during multiple trials of navigating an obstacle course while wearing reversing prisms(adaptive Functional Mobility Test, aFMT). The neuroimaging tests will characterize individual differences in regional brain volumes (using Structural MRI) and white matter microstructure(using Diffusion Tensor Imaging) to serve as potential predictors of adaptive capacity. The genetic tests will utilize saliva samples to examine variations in four genes chosen because of their ability to differentiate sensorimotor adaptation ability in a normative population, including Catechol-O-methyltransferase (COMT), Dopamine Receptor D2 (DRD2), Brain-derived neurotrophic factor (BDNF) and the α2-adrenergic receptor. Twenty-seven ISS crewmembers have been tested to date, including 6 from this past year. This cohort includes 10first-time fliers, 6F, and mission durations lasting 178.6 ± 30.5 days, mean ± std. We are utilizing a combination of three post-flight functional task outcomes: tandem walk, recovery from fall and dynamic posturography. There is considerable variability among the post-flight performance outcomes for the 27participants to date. Based on a partial sample using an ordinal scale survey, 70% indicated their ability to perform functional tasks were more impacted postflight relative to inflight with 50% indicating they needed to restrict movements for a longer period postflight relative to inflight. While there is a strong association within tests obtained at different R+0 timepoints, by R+24 hr performance on one post-flight test does not necessarily correlate with performance on other post-flight tests. There are apparent relationships between individual measures and specific post-flight outcome measures, e.g., the cumulative time to complete the aFMT is significantly correlated to pre-to-post-flight changes in tandem walk (rho= 0.64, p = 0.001). Preliminary statistical analysis indicates combining biomarkers will increase predictive power and this will be explored with future analyses. Our preliminary findings underscore the importance of a comprehensive post-flight test battery including different types of tasks with varying sensory feedback. We expect that understanding the relationships between these sensorimotor biomarkers and post-flight functional task performance will improve both our understanding of the individual variability and our strategy to optimize sensorimotor countermeasures

S J Wood↗