Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Navigation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Physics Discovery in Nanoplasmonic Systems via Autonomous Experiments in Scanning Transmission Electron Microscopy

Abstract Physics‐driven discovery in an autonomous experiment has emerged as a dream application of machine learning in physical sciences. Here, this work develops and experimentally implements a deep kernel learning (DKL) workflow combining the correlative prediction of the target functional response and its uncertainty from the structure, and physics‐based selection of acquisition function, which autonomously guides the navigation of the image space. Compared to classical Bayesian optimization (BO) methods, this approach allows to capture the complex spatial features present in the images of realistic materials, and dynamically learn structure–property relationships. In combination with the flexible scalarizer function that allows to ascribe the degree of physical interest to predicted spectra, this enables physical discovery in automated experiment. Here, this approach is illustrated for nanoplasmonic studies of nanoparticles and experimentally implemented in a truly autonomous fashion for bulk‐ and edge plasmon discovery in MnPS 3 , a lesser‐known beam‐sensitive layered 2D material. This approach is universal, can be directly used as‐is with any specimen, and is expected to be applicable to any probe‐based microscopic techniques including other STEM modalities, scanning probe microscopies, chemical, and optical imaging.

42 ENGINEERING↗

Constructing Self-Labeled Materials Imaging Datasets from Open Access Scientific Journals with EXSCLAIM!

Due to recent improvements in image resolution and acquisition speeds, materials microscopy is experiencing an explosion in imaging data. Yet, despite the volume of images generated, the overall accessibility landscape is highly fragmented, as researchers who do release images to the public, often only do so as snapshots of their larger private dataset in context of scientific journal publications. The effort to automatically consolidate images and descriptive information from web-based platforms has garnered broad attention from the computer vision, language technologies, and chemistry/materials informatics communities. However, these methods are problematic for scientific figures because over 30% of figures are compound in nature, and it is the individual images themselves, paired with relevant context, that are necessary for construction a proper labeled dataset. To this end, we outline in this paper the design of a software pipeline for the automatic EXtraction, Separation, and Caption-based natural Language Annotation of IMages from scientific figures (EXSCLAIM!). Successful consolidation of materials imaging across literature sources will enhance navigation and searchability of materials microscopy images for both novice and experienced researchers, as well as establish the framework necessary for users to search by images, text, or some combination of both.

36 MATERIALS SCIENCE↗

Diamond magnetometer enhanced by ferrite flux concentrators

Magnetometers based on nitrogen-vacancy (NV) centers in diamond are promising room-temperature, solid-state sensors. However, their reported sensitivity to magnetic fields at low frequencies (≲1 kHz) is presently ≳10 pTs 1/2 , precluding potential applications in medical imaging, geoscience, and navigation. Here we show that high-permeability magnetic flux concentrators, which collect magnetic flux from a larger area and concentrate it into the diamond sensor, can be used to improve the sensitivity of diamond magnetometers. By inserting an NV-doped diamond membrane between two ferrite cones in a bowtie configuration, we realize a ~ 250-fold increase of the magnetic field amplitude within the diamond. We demonstrate a sensitivity of ~ 0.9pTs 1/2 to magnetic fields in the frequency range between 10 and 1000 Hz. This is accomplished using a dual-resonance modulation technique to suppress the effect of thermal shifts of the NV spin levels. The magnetometer uses 200 mW of laser power and 20 mW of microwave power. This work introduces a new degree of freedom for the design of diamond sensors by using structured magnetic materials to manipulate magnetic fields.

47 OTHER INSTRUMENTATION↗

Operational Uncrewed Aircraft Systems Development for Meteorology and Atmospheric Physics Field Campaign Report

The overarching goal of the project is to develop integrated small, unmanned aircraft systems (SUAS) capabilities for enhanced atmospheric physics measurements. This team included atmospheric scientists, meteorologists, engineers, computer scientists, geographers, and chemists necessary to evaluate the needs and develop the advanced sensing and imaging, robust autonomous navigation, enhanced data communication, and data management capabilities required to use SUAS in atmospheric physics. The flight campaigns at the Southern Great Plains (SGP) U.S. Department of Energy Atmospheric Radiation Measurement (ARM) observatory were an integrated evaluation of the systems in coordinated field tests. This enabled sensor testing, and validation of SUAS technology and integration of unmanned aircraft into the airspace. The set of experiments enabled evaluation and progression of remote UAS deployment operations with observing atmospheric sensors. Each flight test endeavor was notable for the significant lessons learned during every deployment event. Team size and roles, equipment use, aircraft instruments, meteorological instruments, and deployment logistics, were all evaluated and improved at every flight-testing day. The details of these are further discussed in the Results section.

54 ENVIRONMENTAL SCIENCES↗

Computer vision for robots; Proceedings of the Meeting, Cannes, France, December 2-6, 1985

The conference presents papers on segmentation techniques, three-dimensional recognition and representation, processing image sequences, and navigation and mobility. Particular attention is given to determining the pose of an object, adaptive least squares correlation with geometrical constraints, and the reliable formation of feature vectors for two-dimensional shape representation. Other topics include the real-time tracking of a target moving on a natural textured background, computer vision for the guidance of roving robots, and integrating sensory data for object recognition tasks.

Faugeras, O. D.↗

Smart focal-plane technology for micro-instruments and micro-rovers

It is inevitable that micro-instruments and micro-rovers for space exploration will contain one or more focal-plane arrays for imaging, spectroscopy, or navigation. In this paper, we explore the state-of-the-art in focal-plane technology for visible sensors. Also discussed is present research activity in advanced focal-plane technology with particular emphasis on the development of smart sensors. The paper concludes with a discussion of possible future directions for the advancement of the technology.

Fossum, Eric R.↗

A Flight/Ground/Test Event Logging Facility

The onboard control software for spacecraft such as Mars Pathfinder and Cassini is composed of many subsystems including executive control, navigation, attitude control, imaging, data management, and telecommunications. The software in all of these subsystems needs to be instrumented for several purposes: to report required telemetry data, to report warning and error events, to verify internal behavior during system testing, and to provide ground operators with detailed data when investigating in-flight anomalies. Events can range in importance from purely informational events to major errors. It is desirable to provide a uniform mechanism for reporting such events and controlling their subsequent processing. Since radiation-hardened flight processors are several years behind the speed and memory of their commercial cousins, and since most subsystems require real-time control, and since downlink rates to earth can be very low from deep space, there are limits to how much of the data can be saved and transmitted. Some kinds of events are more important than others and should therefore be preferentially retained when memory is low. Some faults can cause an event to recur at a high rate, but this must not be allowed to consume the memory pool. Some event occurrences may be of low importance when reported but suddenly become more important when a subsequent error event gets reported. Some events may be so low-level that they need not be saved and reported unless specifically requested by ground operators.

Dvorak, Daniel↗

Smart Focal-Plane Technology for Micro-Instruments and Micro-Rovers

It is inevitable that micro-instruments and micro-rovers for space exploration will contain one or more focal-plane arrays for imaging spectroscopy or navigation. In this paper, we explore the state-if-the-art in focal-plane technology for visible sensors. Also discussed is present research activity in advanced focal-plane technology with particular emphasis on the development of smart sensors. The paper concludes with a discussion of possible future directions for the advancement of the technology.

Fossum, Eric R.↗

Astrometric Reduction of Phoebe Using a Digital Shape Model

The Cassini Imaging Science Subsystem (ISS) has provided the most spectacular images of the Saturnian system [1] and these observations constitute a fundamental dataset of high accuracy and exceptionally long-time span for the purpose of astrometry [2]. Several elaborate astrometric efforts using Cassini ISS data have demonstrated their use for the development and maintenance of the Saturnian satellite ephemerides and have been critical in improving our understanding of their secular orbital evolution and interior properties[3].Astrometric efforts using images with well-resolved bodies often employ limb-based methods for center finding; this is proven to be robust for satellites with a uniform ellipsoidal shape. However, systematic biases are of concern for bodies that deviate considerably from tri-axial ellipsoids(e.g., moons with irregular shapes and/or extensive features such as craters, ridges, slumps and grooves). To help understand such biases, we used the Goddard Image Analysis and Navigation Tool (GIANT) [4,5]to improve the astrometric reduction of these moons. Here we apply the method to Phoebe (Saturn IX).

V Viswanathan↗

The Inter-Calibration of the DSCOVR EPIC Imager 2 with Aqua-MODIS and NPP-VIIRS

The Deep Space Climate Observatory (DSCOVR) Earth Polychromatic Imaging Camera (EPIC) continuously observes the illuminated disk from the Lagrange-1 point. The EPIC sensor was designed to monitor the diurnal variation of ozone, clouds, aerosols, and vegetation, especially those features that benefit from observation near-backscatter conditions. The EPIC sensor does not contain any onboard calibration systems. This study describes the inter-calibration of EPIC channels 5 (0.44 μm), 6 (0.55 μm), 7 (0.68 μm), and 10 (0.78 μm) with respect to Aqua-MODIS and NPP-VIIRS. The calibration is transferred using coincident ray-matched reflectance pairs over all-sky tropical ocean (ATO) and deep convective cloud (DCC) targets. A robust and automated image-alignment technique based on feature matching was formulated to improve the navigation quality of the EPIC images. The EPIC V02 dataset exhibits improved navigation over V01. Because the visible channels display similar spatial features, a single visible channel can be used to co-register the remaining visible bands. The VIIRS-referenced EPIC ATO and DCC ray-matched calibration coefficients are within 0.3%. The EPIC four-year calibration trends based on VIIRS are within 0.15%/year. The MODIS-based EPIC calibration coefficients were compared against the Geogdzhayev and Marshak 2018 published calibration coefficients and are found to be within 1.6%.

DSCOVR↗

Navigating the Deployment and Downlink Tradespace for Earth Imaging Constellations

Distributed Spacecraft Missions (DSMs) are gaining momentum in their application to Earth Observation (EO) missions owing to their unique ability to increase observation sampling in spatial, spectral, angular and temporal dimensions simultaneously. DSM design includes a much larger number of variables than its monolithic counterpart, therefore, Model-Based Systems Engineering (MBSE) has been often used for preliminary mission concept designs, to understand the trade-offs and interdependencies among the variables. MBSE models are complex because the various objectives a DSM is expected to achieve are almost always conflicting, non-linear and rarely analytical. NASA Goddard Space Flight Center (GSFC) is developing a pre-Phase A tool called Tradespace Analysis Tool for Constellations (TAT-C) to initiate constellation mission design. The tool will allow users to explore the tradespace between various performance, cost and risk metrics (as a function of their science mission) and select Pareto optimal architectures that meet their requirements. This paper will describe the different types of constellations that TAT-C’s Tradespace Search Iterator is capable of enumerating (homogeneous Walker, heterogeneous Walker, precessing type, ad-hoc) and their impact on key performance metrics such as revisit statistics, time to global access and coverage. We will also discuss the ability to simulate phased deployment of the given constellations, as a function of launch availabilities and/or vehicle capability, and show the impact on performance. All performance metrics are calculated by the Data Reduction and Metric Computation module within TAT-C, which issues specific requests and processes results from the Orbit and Coverage module. Our TSI is also capable of generating tradespaces for downlinking imaging data from the constellation, based on permutations of available ground station networks - known (default) or customized (by the user). We will show the impact of changing ground station options for any given constellation, on data latency and required communication bandwidth, which in turn determines the responsiveness of the space system.

Nag, Sreeja↗

Autonomous Navigation, Guidance, and Control Software in a Low SWaP Box

Onboard autonomy is a necessity for responsive space operations. Autonomous navigation, guidance, and control (NGC) enables space missions to reduce their dependence on high demand ground assets and costly ground personnel. It also allows for in-situ decision making and higher return on mission data. A flight software and hardware system providing this capability, called “autoNGC,” is currently being developed at NASA Goddard Space Flight Center for infusion into multiple future missions. The autoNGC flight software is built on the plug-and-play architecture of the core Flight System (cFS) consisting of the standard cFS apps and newly developed autoNGC interface apps and libraries. The various apps cooperate through communication over the message-based software bus. With the plug-and-play architecture of autoNGC, cFS apps can easily be added and replaced to meet the needs of different missions, even after launch. The first flight software release of autoNGC is targeted for Summer 2024 to provide autonomous navigation at the Moon and beyond. It can perform sensor fusion of multiple measurement types including pseudo-range from a Global Navigation Satellite System (GNSS) receiver (including weak signal), 1-way and 2-way range and Doppler from ground stations (i.e., direct to Earth (DTE)), bearing and range from optical camera images, and accelerometer data. Accurate onboard navigation and timing is obtained through the Goddard Enhanced Onboard Navigation System (GEONS) software library which fuses different measurement types through an extended Kalman filter (EKF) framework. Optical measurements that are ingested in GEONS are first extracted from optical images by the cFS Goddard Image Analysis and Navigation Tool (cGIANT) app. If the imaged body is far enough away that it appears as a pixel or cluster of pixels, then bearing angles to the body centroid can be provided. If the body is close enough and the shape is known coarsely, then bearing angles and range to the body centroid can be derived from the limb. Bearing angles to individual surface features can also be extracted (i.e., terrain relative navigation (TRN)). Onboard guidance and control capabilities are being developed for a future release to perform autonomous station-keeping and trajectory correction maneuvers in multiple orbital regimes. Capabilities to enable distributed systems missions and constellations, such as crosslink measurements, and onboard time management are being developed as well. The first hardware implementation of autoNGC is a minimal size, weight, and power (SWaP) design allowing for inclusion into CubeSats and SmallSat-size buses. Advancements in miniaturized space processors, such as the SpaceCube 3.0 Mini and the SpaceCube Mini-Z are utilized for low SWaP while maintaining a high level of performance. The current enclosure design is 12 cm x 17 cm x 13.5 cm. The box mass is expected to be less than 2 kg, and the nominal power is 21 W. In order to accommodate a wide range of missions, the hardware interfaces are designed for flexibility with a variety of sensor inputs. Through comprehensive testing in the software-in-the-loop, processor-in-the-loop, and hardware-in-the-loop test beds that are concurrently being developed, autoNGC is expected to achieve TRL 6 by late 2024.

Sun Hur-Diaz↗

Autonomous GN and C for Spacecraft Exploration of Comets and Asteroids

A spacecraft guidance, navigation, and control (GN&C) system is needed to enable a spacecraft to descend to a surface, take a sample using a touch-and-go (TAG) sampling approach, and then safely ascend. At the time of this reporting, a flyable GN&C system that can accomplish these goals is beyond state of the art. This article describes AutoGNC, which is a GN&C system capable of addressing these goals, which has recently been developed and demonstrated to a maturity TRL-5-plus. The AutoGNC solution matures and integrates two previously existing JPL capabilities into a single unified GN&C system. The two capabilities are AutoNAV and GREX. AutoNAV is JPL s current flight navigation system, and is fairly mature with respect to flybys and rendezvous with small bodies, but is lacking capability for close surface proximity operations, sampling, and contact. G-REX is a suite of low-TRL algorithms and capabilities that enables spacecraft operations in close surface proximity and for performing sampling/contact. The development and integration of AutoNAV and G-REX components into AutoGNC provides a single, unified GN&C capability for addressing the autonomy, close-proximity, and sampling/contact aspects of small-body sample return missions. AutoGNC is an integrated capability comprising elements that were developed separately. The main algorithms and component capabilities that have been matured and integrated are autonomy for near-surface operations, terrain-relative navigation (TRN), real-time image-based feedback guidance and control, and six degrees of freedom (6DOF) control of the TAG sampling event. Autonomy is achieved based on an AutoGNC Executive written in Virtual Machine Language (VML) incorporating high-level control, data management, and fault protection. In descending to the surface, the AutoGNC system uses camera images to determine its position and velocity relative to the terrain. This capability for TRN leverages native capabilities of the original AutoNAV system, but required advancements that integrate the separate capabilities for shape modeling, state estimation, image rendering, defining a database of onboard maps, and performing real-time landmark recognition against the stored maps. The ability to use images to guide the spacecraft requires the capability for image-based feedback control. In Auto- GNC, navigation estimates are fed into an onboard guidance and control system that keeps the spacecraft guided along a desired path, as it descends towards its targeted landing or sampling site. Once near the site, AutoGNC achieves a prescribed guidance condition for TAG sampling (position/orientation, velocity), and a prescribed force profile on the sampling end-effector. A dedicated 6DOF TAG control then implements the ascent burn while recovering from sampling disturbances and induced attitude rates. The control also minimizes structural interactions with flexible solar panels and disallows any part of the spacecraft from making contact with the ground (other than the intended end-effector).

Carson, John M.↗

Methods of Optical Navigation

Optical navigation is the use of onboard imaging to aid in the determination of the spacecraft trajectory and of the targets' ephemerides. Opnav techniques provide a direct measurement of the direction from a spacecraft to target bodies. Opnav data thus complement both radiometric tracking data (for instance, Doppler and range) and the groundbased astrometry which is used to determine the a priori ephemeris of the targets. We present the geometry and camera models which form the mathematical basis for optical navigation and some of the image processing techniques by which one can extract the optical observables--that is, the sample and line coordinates of images--from pictures.

spacecraft navigation↗

Localization Using Visual Odometry and a Single Downward-Pointing Camera

Stereo imaging is a technique commonly employed for vision-based navigation. For such applications, two images are acquired from different vantage points and then compared using transformations to extract depth information. The technique is commonly used in robotics for obstacle avoidance or for Simultaneous Localization And Mapping, (SLAM). Yet, the process requires a number of image processing steps and therefore tends to be CPU-intensive, which limits the real-time data rate and use in power-limited applications. Evaluated here is a technique where a monocular camera is used for vision-based odometry. In this work, an optical flow technique with feature recognition is performed to generate odometry measurements. The visual odometry sensor measurements are intended to be used as control inputs or measurements in a sensor fusion algorithm using low-cost MEMS based inertial sensors to provide improved localization information. Presented here are visual odometry results which demonstrate the challenges associated with using ground-pointing cameras for visual odometry. The focus is for rover-based robotic applications for localization within GPS-denied environments.

Swank, Aaron J.↗

Altair Navigation During Trans-Lunar Cruise, Lunar Orbit, Descent and Landing

The Altair lunar lander navigation system is driven by a set of requirements that not only specify a need to land within 100 m of a designated spot on the Moon, but also be capable of a safe return to an orbiting Orion capsule in the event of loss of Earth ground support. These requirements lead to the need for a robust and capable on-board navigation system that works in conjunction with an Earth ground navigation system that uses primarily ground-based radiometric tracking. The resulting system relies heavily on combining a multiplicity of data types including navigation state updates from the ground based navigation system, passive optical imaging from a gimbaled camera, a stable inertial measurement unit, and a capable radar altimeter and velocimeter. The focus of this paper is on navigation performance during the trans-lunar cruise, lunar orbit, and descent/landing mission phases with the goal of characterizing knowledge and delivery errors to key mission events, bound the statistical delta V costs for executing the mission, as well as the determine the landing dispersions due to navigation. This study examines the nominal performance that can be obtained using the current best estimate of the vehicle, sensor, and environment models. Performance of the system under a variety sensor outages and parametric trades is also examined.

lunar lander↗