Search NASASearch

SEARCH · Search NASA

Results for “sensor fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Sensor fusion for synthetic vision

Display methodologies are explored for fusing images gathered by millimeter wave sensors with images rendered from an on-board terrain data base to facilitate visually guided flight and ground operations in low visibility conditions. An approach to fusion based on multiresolution image representation and processing is described which facilitates fusion of images differing in resolution within and between images. To investigate possible fusion methods, a workstation-based simulation environment is being developed.

Pavel, M.

Knowledge-based imaging-sensor fusion system

An imaging system which applies knowledge-based technology to supervise and control both sensor hardware and computation in the imaging system is described. It includes the development of an imaging system breadboard which brings together into one system work that we and others have pursued for LaRC for several years. The goal is to combine Digital Signal Processing (DSP) with Knowledge-Based Processing and also include Neural Net processing. The system is considered a smart camera. Imagine that there is a microgravity experiment on-board Space Station Freedom with a high frame rate, high resolution camera. All the data cannot possibly be acquired from a laboratory on Earth. In fact, only a small fraction of the data will be received. Again, imagine being responsible for some experiments on Mars with the Mars Rover: the data rate is a few kilobits per second for data from several sensors and instruments. Would it not be preferable to have a smart system which would have some human knowledge and yet follow some instructions and attempt to make the best use of the limited bandwidth for transmission. The system concept, current status of the breadboard system and some recent experiments at the Mars-like Amboy Lava Fields in California are discussed.

Westrom, George

Microwave and camera sensor fusion for the shape extraction of metallic 3D space objects

The vacuum of space presents special problems for optical image sensors. Metallic objects in this environment can produce intense specular reflections and deep shadows. By combining the polarized RCS with an incomplete camera image, it has become possible to better determine the shape of some simple three-dimensional objects. The radar data are used in an iterative procedure that generates successive approximations to the target shape by minimizing the error between computed scattering cross-sections and the observed radar returns. Favorable results have been obtained for simulations and experiments reconstructing plates, ellipsoids, and arbitrary surfaces.

Shaw, Scott W.

Distributed Sensor Fusion of Ground and Air Nodes Using Vision and Radar Modalities for Tracking Multirotor Small Uncrewed Air Systems and Birds

High-density airspace operations with multiple aircraft type and potentially noncooperative aircraft require distributed sensor detection and tracking systems to monitor airspace for safe, autonomous flight operations for advanced air mobility, urban air mobility, and high density small uncrewed air systems (SUAS) flight concepts. This work collected data using a distributed radar and camera sensor framework during the NASA Advanced Air Mobility High Density Vertiplex project SUAS flight operation. Node locations include on an onboard SUAS, affixed to the Landing and Impact Research Facility with approximate 200ft elevation, on a tripod on first-floor roof with an approximate elevation of 20 ft, and on a tripod on a concrete pad that is approximately 4 ft above sea level. Each node includes camera, radar, and GPS.

Beyond Visual Line of Sight

Neural network implementations of data association algorithms for sensor fusion

The paper is concerned with locating a time varying set of entities in a fixed field when the entities are sensed at discrete time instances. At a given time instant a collection of bivariate Gaussian sensor reports is produced, and these reports estimate the location of a subset of the entities present in the field. A database of reports is maintained, which ideally should contain one report for each entity sensed. Whenever a collection of sensor reports is received, the database must be updated to reflect the new information. This updating requires association processing between the database reports and the new sensor reports to determine which pairs of sensor and database reports correspond to the same entity. Algorithms for performing this association processing are presented. Neural network implementation of the algorithms, along with simulation results comparing the approaches are provided.

Brown, Donald E.

Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter

Current virtual environment and teleoperator applications are hampered by the need for an accurate, quick responding head-tracking system with a large working volume. Gyroscopic orientation sensors can overcome problems with jitter, latency, interference, line-of-sight obscurations, and limited range, but suffer from slow drift. Gravimetric inclinometers can detect attitude without drifting, but are slow and sensitive to transverse accelerations. This paper describes the design of a Kalman filter to integrate the data from these two types of sensors in order to achieve the excellent dynamic response of an inertial system without drift, and without the acceleration sensitivity of inclinometers.

Foxlin, Eric

Inertial Head-Tracker Sensor Fusion by a Complementary Separate-Bias Kalman Filter

Current virtual environment and teleoperator applications are hampered by the need for an accurate, quick-responding head-tracking system with a large working volume. Gyroscopic orientation sensors can overcome problems with jitter, latency, interference, line-of-sight obscurations, and limited range, but suffer from slow drift. Gravimetric inclinometers can detect attitude without drifting, but are slow and sensitive to transverse accelerations. This paper describes the design of a Kalman filter to integrate the data from these two types of sensors in order to achieve the excellent dynamic response of an inertial system without drift, and without the acceleration sensitivity of inclinometers.

Foxlin, Eric

A sensor fusion field experiment in forest ecosystem dynamics

The background of the Forest Ecosystem Dynamics field campaign is presented, a progress report on the analysis of the collected data and related modeling activities is provided, and plans for future experiments at different points in the phenological cycle are outlined. The ecological overview of the study site is presented, and attention is focused on forest stands, needles, and atmospheric measurements. Sensor deployment and thermal and microwave observations are discussed, along with two examples of the optical radiation measurements obtained during the experiment in support of radiative transfer modeling. Future activities pertaining to an archival system, synthetic aperture radar, carbon acquisition modeling, and upcoming field experiments are considered.

Smith, James A.

A Green’s Function Sensor Fusion Approach for Evaluating Spacecraft Entry Heating From on-Board Thermal Instrumentation

During atmospheric entry, distributed thermal measurements are critical to enable the evaluation of heat loads on spacecraft thermal protection systems (TPS). In recent space exploration missions, Schmidt-Boelter-type heat flux gauges have been integrated into the TPS alongside conventional temperature measurement instrumentation to measure total (convective and radiative) and radiative heat transfer rates1,2. While direct heat flux sensors (HFS) are able to provide valuable information detailing the thermal loads experienced by spacecraft, the interpretation of these measurements in unsteady, convective environments requires a correction factor to account for local heating augmentations at the cold wall HFS surface2,3. Current efforts to estimate cold wall correction factors, and thus recover the hot wall TPS heat flux, rely on time-marching computational fluid dynamics (CFD) simulations2. Simulation-based methods are susceptible to large uncertainties, however, as they require estimations of vehicle trajectory, gas kinetics, wall catalysis models, and other flight conditions as input parameters2,4. Furthermore, CFD simulations are computationally expensive and cannot efficiently survey all possible entry scenarios, exacerbating the uncertainty of reconstructed hot wall heat flux values. These drawbacks motivate the development of alternative hot wall heat flux reconstruction methods that are not reliant on CFD-based correction factors.

Kenneth McAfee

A Green’s Function Sensor Fusion Approach for Evaluating Spacecraft Entry Heating From on-Board Thermal Instrumentation

During atmospheric entry, distributed thermal measurements are critical to enable the evaluation of heat loads on spacecraft thermal protection systems (TPS). In recent space exploration missions, Schmidt-Boelter-type heat flux gauges have been integrated into the TPS alongside conventional temperature measurement instrumentation to measure total (convective and radiative) and radiative heat transfer rates1,2. While direct heat flux sensors (HFS) are able to provide valuable information detailing the thermal loads experienced by spacecraft, the interpretation of these measurements in unsteady, convective environments requires a correction factor to account for local heating augmentations at the cold wall HFS surface2,3. Current efforts to estimate cold wall correction factors, and thus recover the hot wall TPS heat flux, rely on time-marching computational fluid dynamics (CFD) simulations2. Simulation-based methods are susceptible to large uncertainties, however, as they require estimations of vehicle trajectory, gas kinetics, wall catalysis models, and other flight conditions as input parameters2,4. Furthermore, CFD simulations are computationally expensive and cannot efficiently survey all possible entry scenarios, exacerbating the uncertainty of reconstructed hot wall heat flux values. These drawbacks motivate the development of alternative hot wall heat flux reconstruction methods that are not reliant on CFD-based correction factors.

Kenneth McAfee

A Green’s Function Sensor Fusion Approach for Evaluating Spacecraft Entry Heating From on-Board Thermal Instrumentation

During atmospheric entry, distributed thermal measurements are critical to enable the evaluation of heat loads on spacecraft thermal protection systems (TPS). In recent space exploration missions, Schmidt-Boelter-type heat flux gauges have been integrated into the TPS alongside conventional temperature measurement instrumentation to measure total (convective and radiative) and radiative heat transfer rates1,2. While direct heat flux sensors (HFS) are able to provide valuable information detailing the thermal loads experienced by spacecraft, the interpretation of these measurements in unsteady, convective environments requires a correction factor to account for local heating augmentations at the cold wall HFS surface2,3. Current efforts to estimate cold wall correction factors, and thus recover the hot wall TPS heat flux, rely on time-marching computational fluid dynamics (CFD) simulations2. Simulation-based methods are susceptible to large uncertainties, however, as they require estimations of vehicle trajectory, gas kinetics, wall catalysis models, and other flight conditions as input parameters2,4. Furthermore, CFD simulations are computationally expensive and cannot efficiently survey all possible entry scenarios, exacerbating the uncertainty of reconstructed hot wall heat flux values. These drawbacks motivate the development of alternative hot wall heat flux reconstruction methods that are not reliant on CFD-based correction factors.

Kenneth McAfee

Sensor fusion for assured vision in space applications

By using emittance and reflectance radiation models, the effects of angle of observation, polarization, and spectral content are analyzed to characterize the geometrical and physical properties--reflectivity, emissivity, orientation, dielectric properties, and roughness--of a sensed surface. Based on this analysis, the use of microwave, infrared, and optical sensing is investigated to assure the perception of surfaces on a typical lunar outpost. Also, the concept of employing several sensors on a lunar outpost is explored. An approach for efficient hardware implementation of the fused sensor systems is discussed.

Collin, Marie-France

Wrap-Around Out-the-Window Sensor Fusion System

The Advanced Cockpit Evaluation System (ACES) includes communication, computing, and display subsystems, mounted in a van, that synthesize out-the-window views to approximate the views of the outside world as it would be seen from the cockpit of a crewed spacecraft, aircraft, or remote control of a ground vehicle or UAV (unmanned aerial vehicle). The system includes five flat-panel display units arranged approximately in a semicircle around an operator, like cockpit windows. The scene displayed on each panel represents the view through the corresponding cockpit window. Each display unit is driven by a personal computer equipped with a video-capture card that accepts live input from any of a variety of sensors (typically, visible and/or infrared video cameras). Software running in the computers blends the live video images with synthetic images that could be generated, for example, from heads-up-display outputs, waypoints, corridors, or from satellite photographs of the same geographic region. Data from a Global Positioning System receiver and an inertial navigation system aboard the remote vehicle are used by the ACES software to keep the synthetic and live views in registration. If the live image were to fail, the synthetic scenes could still be displayed to maintain situational awareness.

Fox, Jeffrey

Deliberate Motion Analytics Applied to CUAS Sensor Fusion

The Advanced Reactor Safeguards and Security (ARSS) program in the Department of Energy’s Office of Nuclear Energy (DOE-NE) seeks to identify new technology solutions for safeguards and security challenges associated with domestic deployment of advanced nuclear reactors. Research in the ARSS program is investigating alternative physical protection system (PPS) approaches that leverage new detection technologies. This report shows test results from a new form of artificial intelligence (AI) that is called deliberate motion analytics (DMA) when used to spatially and temporally fuse active radar and passive radio frequency (RF) detection that significantly improves detection of uncrewed aircraft systems (UASs). DMA is designed to filter out false positive alarms yet provide highly reliable intrusion detection at nuclear power plants (NPPs) and advanced small modular reactor (ASMR) perimeters. This form of AI is considered to be an enabling technology for security of the future and supports the ARSS investigation of alternative PPSs.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P

Sensor fusion of range and reflectance data for outdoor scene analysis

In recognizing objects in an outdoor scene, range and reflectance (or color) data provide complementary information. Results of experiments in recognizing outdoor scenes containing roads, trees, and cars are presented. The recognition program uses range and reflectance data obtained by a scanning laser range finder, as well as color data from a color TV camera. After segmentation of each image into primitive regions, models of objects are matched using various properties.

Kweon, In SO

Microwave and video sensor fusion for the shape extraction of 3D space objects

A new system for the fusion of optical image data and polarized radar scattering cross-sections is presented. By considering the scattering data in conjunction with image data, the problem of ambiguity can be reduced. Only a small part of the surface needs to be reconstructed from the radar cross-sections; the remaining portion is constrained by the optical image.

Shaw, Scott W.

Multi-Sensor Fusion and Enhancement for Object Detection

This was a quick &week effort to investigate the ability to detect changes along the flight path of an unmanned airborne vehicle (UAV) over time. Video was acquired by the UAV during several passes over the same terrain. Concurrently, GPS data and UAV attitude data were also acquired. The purpose of the research was to use information from all of these sources to detect if any change had occurred in the terrain encompassed by the flight path.

Rahman, Zia-Ur

GPS/INS Sensor Fusion Using GPS Wind up Model

A method of stabilizing an inertial navigation system (INS), includes the steps of: receiving data from an inertial navigation system; and receiving a finite number of carrier phase observables using at least one GPS receiver from a plurality of GPS satellites; calculating a phase wind up correction; correcting at least one of the finite number of carrier phase observables using the phase wind up correction; and calculating a corrected IMU attitude or velocity or position using the corrected at least one of the finite number of carrier phase observables; and performing a step selected from the steps consisting of recording, reporting, or providing the corrected IMU attitude or velocity or position to another process that uses the corrected IMU attitude or velocity or position. A GPS stabilized inertial navigation system apparatus is also described.

Williamson, Walton R.