Search NASA⌕ Search

SEARCH · Search NASA

Results for “sensor fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRS2024

PACE Technical Report Series, Volume 12: The PACE Level 1C data format

NASA's Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission will make global ocean color and atmospheric measurements to provide extended data records of ocean ecology and global biogeochemistry, along with polarimetric measurements for advanced observations of aerosols, clouds and the ocean. PACE will contain three instruments: the primary Ocean Color Instrument (OCI), and two multi-angle polarimeters (MAPs). The latter instruments are contributed under a ‘Do-No-Harm’ (to the rest of the PACE mission) principle, and the PACE Science Data Processing System (SDPS) is only required to produce Level-1b (geolocated radiances with calibration applied) data without performance requirements. However, there is a strong desire to produce data in a format that merges the disparate spatial resolutions, viewing geometry and sampling nature of the three instruments. Our terminology for this format is Level 1c (L1C). This format will be an input to Level 2 algorithms produced from standalone MAP instrument observations, or from algorithms employing multi-sensor fusion. Creating the L1C format has several components. This includes choice of projection method, the means by which multi-angle views are properly incorporated into that projection (‘aggregation’) the means to represent wavelength and light polarization state, the selection of data to be included within the L1C file, and the handling of ancillary data either required for L1C file generation or needed in that format for L2 processing.

PACE↗
NASA NTRSDate not supplied

Traffic Prediction for Uncommunicative Aircraft in Terminal Airspace: Development Framework and Performance Evaluations

This paper presents an air traffic prediction algorithm that takes observations of an aircraft and classifies aircraft type, estimates the aircraft's intent to and method of joining an airport traffic pattern, and predicts the aircaft's future trajectory. To develop algorithms that enable autonomous aircraft to safely insert into un-towered traffic patterns, several challenges need to be addressed. These challenges range from traffic detection to sensor fusion to own-ship trajectory replanning. Critical to a trajectory replanning algorithm is information regarding the future behavior of all traffic aircraft in the operational environment. The presented traffic prediction algorithm generates this information using regular measurements of traffic aircraft position and velocity to classify the aircraft by speed-class, estimate how the aircraft will approach the runway, and construct a predicted trajectory to the runway including future positions and velocities at specific times. The predictions of the presented algorithm are the necessary inputs for any downstream traffic pattern sequencing and own-ship trajectory planning routines. The presented algorithm is benchmarked using approximately 300 randomized traffic trajectories, spanning four vehicle weight classes and eight traffic entry types. While the algorithm can process multiple traffic vehicles in the terminal area, there is no prediction of traffic-on-traffic interaction. Each traffic vehicle is processed separately.

John D McMinn↗
NASA NTRS2025

Distributed Sensing Node Configuration

A vision and radar sensor integration strategy for surveillance of Advance Air Mobility Mission concept of airspace is contained in the CAD drawing in this publication developed as part of NASA's Transformational Tools and Technology project. High-density airspace operations with multiple aircraft type and potentially noncooperative aircraft require distributed sensor detection and tracking systems to monitor airspace for safe, autonomous flight operations for advanced air mobility, urban air mobility, and high density small uncrewed air systems (SUAS) flight concepts. Contained herein are drawings that are available in the stp and creo file formats of the distributed sensing nodes. Additional dovetail integration is included to enable rapid changing of embedded system. A day in the life node deployment is included in the 2023_last_flight_day.mp4. Please cite this publication if you use these drawings. This sensor configuration methodology is presented in detail in the publication reference below. Chester Dolph, Thomas Lombaerts, Corey A. Ippolito, Vahram Stepanyan, Evan Kawamura, Keerthana Kannan, George Szatkowski, Todd Ferante, Christopher Morris, Federica Vitiello, Flavia Causa, Roberto Opromolla and Giancarmine Fasano. "Distributed Sensor Fusion of Ground and Air Nodes using Vision and Radar Modalities for Tracking Multirotor Small Uncrewed Air Systems and Birds," AIAA 2024-1781. AIAA SCITECH 2024 Forum. January 2024.

Chester V Dolph↗
NASA NTRS1991

Sensor-knowledge-command fusion paradigm for man/machine systems

Sensing-knowledge-command (SKC) fusion is presented as a fundamental paradigm of implementing cooperative control for an advanced man-machine system. SKC fusion operates on the 'SKC fusion network,' which represents the connection between sensor data to commands through knowledge. Sensing, knowledge, and command of a human and a machine are tapped into the network to provide inputs, or stimuli, to the network. Such stimuli automatically invoke an SKC fusion process and generate a fused output for cooperative control. Once invoked by stimuli, the SKC fusion process forces the network to converge to a new equilibrium state through the network dynamics composed of data fusion, feature transformation, and constraint propagation. The SKC fusion process thus integrates redundant information, maintains network consistency, identifies faulty data and concepts, and specifies those concepts to be strengthened through sensor planning.

Lee, Sukhan↗
NASA NTRSDate not supplied

Adaptive Multi-Sensor Localization Information Fusion for Autonomous Urban Air Mobility Operations

An adaptive method is developed to iteratively fuse the information provided by multiple sensors to enable autonomous urban air mobility type operations. First, noisy and bias corrupted IMU readings are processed as soon as they arrive using kinematic equations represented in the vehicle's body frame. To correct the systems drift resulting from the integration, an information content measure is introduced to decide on the environment. For the cluttered environment the information provided by environmental sensors is counted as reliable and the drift correction as accurate. For the open space, the GPS data is counted as reliable, and the drift correction is done based on the GPS readings. The measurement noise effects are minimize using Iterated Extended Kalman Filter framework. The algorithm is implemented in the in-house developed FlightDeckz simulation environment using an IMU model, simulated video recorded from a camera mounted on the vehicle (for the purpose of this study, outside scenery was generated with XPlane), which flies in an urban environment, and GPS data generated from the environment's digital map.

Onboard Perception↗
NASA NTRS1989

Robotic Vision Would Combine Optics And Microwaves

Conceptual robot-vision system processes data from both microwave and visible-wavelength sensors. Concept, called "fusion of sensors," yields better information on shapes of some objects than obtained from one type of sensor alone. Proposed system fuses data from television images with polarized low-resolution radar-scattering cross sections. Using iterative procedure, generates successive approximations to shape of target by minimizing differences between observed radar returns and radar returns observed if object characterized by computed scattering transfer matrix.

Krishen, Kuma↗
NASA NTRS2024

Effective structural impact detection and localization using convolutional neural network and Bayesian information fusion with limited sensors

Due to their unpredictable nature, many impact events (e.g., overheight vehicles striking on bridges) go unnoticed or get reported many hours later. However, they can induce structural failures or hidden damage that accelerates the structure’s long-term degradation. Therefore, prompt impact detection and localization strategies are essential for early warning of impact events and rapid maintenance of structures. Most existing impact detection strategies are developed for aircraft composite panels utilizing high-rate synchronized measurement from densely deployed sensors. Limited efforts have been made for infrastructure or human habitats which generally require large-scale but low-rate measurement. In particular, due to harsh environments (e.g., deep space habitats under meteoroids), structural impact localization must be robust to limited sensors (e.g., sensor damage during impacts) and multi-source errors (e.g., measurement errors). In this study, an effective impact detection and localization strategy is proposed using a limited number of vibration measurements, especially in harsh environments (e.g. in deep space). Convolutional neural networks are trained for each sensor node and are fused using Bayesian theory to improve the accuracy of impact localization. Special considerations are paid to evaluate the effect of both measurement error and modeling error in the analysis. The proposed strategy is illustrated using 1D structure, and further validated in 3D geodesic dome structure numerically. The results demonstrate that it can detect and localize impact events accurately and robustly on structures.

Yuguang Fu↗
NASA NTRS2006

Real-time Enhancement, Registration, and Fusion for a Multi-Sensor Enhanced Vision System

Over the last few years NASA Langley Research Center (LaRC) has been developing an Enhanced Vision System (EVS) to aid pilots while flying in poor visibility conditions. The EVS captures imagery using two infrared video cameras. The cameras are placed in an enclosure that is mounted and flown forward-looking underneath the NASA LaRC ARIES 757 aircraft. The data streams from the cameras are processed in real-time and displayed on monitors on-board the aircraft. With proper processing the camera system can provide better-than- human-observed imagery particularly during poor visibility conditions. However, to obtain this goal requires several different stages of processing including enhancement, registration, and fusion, and specialized processing hardware for real-time performance. We are using a real-time implementation of the Retinex algorithm for image enhancement, affine transformations for registration, and weighted sums to perform fusion. All of the algorithms are executed on a single TI DM642 digital signal processor (DSP) clocked at 720 MHz. The image processing components were added to the EVS system, tested, and demonstrated during flight tests in August and September of 2005. In this paper we briefly discuss the EVS image processing hardware and algorithms. We then discuss implementation issues and show examples of the results obtained during flight tests. Keywords: enhanced vision system, image enhancement, retinex, digital signal processing, sensor fusion

Hines, Glenn D.↗
DOE OSTI2024

Sub-millisecond keyhole pore detection in laser powder bed fusion using sound and light sensors and machine learning

Laser powder bed fusion is a mainstream additive manufacturing technology widely used to manufacture complex parts in prominent sectors, including aerospace, biomedical, and automotive industries. However, during the printing process, the presence of an unstable vapor depression can lead to a type of defect called keyhole porosity, which is detrimental to the part quality. In this study, we developed an effective approach to locally detect the generation of keyhole pores during the printing process by leveraging machine learning and a suite of optical and acoustic sensors. Simultaneous synchrotron x-ray imaging allows the direct visualization of pore generation events inside the sample, offering high-fidelity ground truth. A neural network model adopting SqueezeNet architecture using single-sensor data was developed to evaluate the fidelity of each sensor for capturing keyhole pore generation events. Our comparative study shows that the near infrared images gave the highest prediction accuracy, followed by 100 kHz and 20 kHz microphones, and the photodiode sensitive to processing laser wavelength had the lowest accuracy. Using a single sensor, over 90% prediction accuracy can be achieved with a temporal resolution as short as 0.1 ms. A data fusion scheme was also developed with features extracted using SqueezeNet neural network architecture and classification using different machine learning algorithms. Our work demonstrates the correlation between the characteristic optical and acoustic emissions and the keyhole oscillation behavior, and thereby provides strong physics support for the machine learning approach.

36 MATERIALS SCIENCE↗
NASA NTRS1992

A data fusion algorithm for multi-sensor microburst hazard assessment

A recursive model-based data fusion algorithm for multi-sensor microburst hazard assessment is described. An analytical microburst model is used to approximate the actual windfield, and a set of 'best' model parameters are estimated from measured winds. The winds corresponding to the best parameter set can then be used to compute alerting factors such as microburst position, extent, and intensity. The estimation algorithm is based on an iterated extended Kalman filter which uses the microburst model parameters as state variables. Microburst state dynamic and process noise parameters are chosen based on measured microburst statistics. The estimation method is applied to data from a time-varying computational simulation of a historical microburst event to demonstrate its capabilities and limitations. Selection of filter parameters and initial conditions is discussed. Computational requirements and datalink bandwidth considerations are also addressed.

Wanke, Craig R.↗
NASA NTRS1994

A data fusion algorithm for multi-sensor microburst hazard assessment

A recursive model-based data fusion algorithm for multi-sensor microburst hazard assessment is described. An analytical microburst model is used to approximate the actual windfield, and a set of 'best' model parameters are estimated from measured winds. The winds corresponding to the best parameter set can then be used to compute alerting factors such as microburst position, extent, and intensity. The estimation algorithm is based on an iterated extended Kalman filter which uses the microburst model parameters as state variables. Microburst state dynamic and process noise parameters are chosen based on measured microburst statistics. The estimation method is applied to data from a time-varying computational simulation of a historical microburst event to demonstrate its capabilities and limitations. Selection of filter parameters and initial conditions is discussed. Computational requirements and datalink bandwidth considerations are also addressed.

Wanke, Craig R.↗
NASA NTRS1999

The Distribution of Titanium in Lunar Soils on the Basis of Sensor and In Situ Data Fusion

A variety of remote-sensing measurements have been used to map the distribution of elements on the Moon as a means of providing constraints on the processes from which its crust and major terranes originated. Discussed here is Ti, which is incorporated into refractory minerals such as ilmenite during the latter stages of differentiation, and is thus a most useful element for understanding mare basalt petrogenesis. One of the earliest Ti maps showed Ti variations in nearside maria on the basis of groundbased spectral reflectance measurements. A map of Ti derived from gamma-ray measurements on Apollo 15 and 16 was produced at about the same time, and was improved upon considerably by Davis and coworkers, who effectively removed sources of spurious variation from Fe and Al or REE (e.g., Th) interference, and calibrated Ti on the bases of landing-site soil averages. In recent years, spectral reflectance measurements from Clementine have been used by Lucey and coworkers to produce global Ti distribution maps as well. As we indicated previously, the Lucey and Davis maps agree to first order. Meanwhile, we are using the concept of sensor data fusion to combine measurements from the AGR (Apollo gamma-ray) and CSR (Clementine Spectral Reflectance) techniques with ground truth from lunar soils to utilize the differences between the two maps to understand the distribution of Ti within lunar soil components, as we have done with Fe. This technique should be verified and applied on Lunar Prospector gamma-ray measurements of Ti, as the calibrated data become available within the next couple of years. Lunar Ti is found principally in the mineral ilmenite, and is associated with certain components of lunar soil: crystalline Ilmenite mineral fragments and high Ti-bearing glass. All data indicate that Ti is associated with maria and mafic minerals. In AGR and CSR datasets, Ti is highest on the nearside and in the maria, particularly in southern Serenitatis/northern Tranquillitatis and northwestern Procellarum. Unlike CSR-derived values, AGR Ti values show modest increase (up to 0.7%) on the northern farside. Both techniques show a primarily unimodal distribution with a shoulder in the high Ti direction and a primary mode at approximately 0.2% (0.15% for CSR and 0.25% for AGR data), but the AGR Ti data have more structure in the shoulder, including an apparent minor mode at 1.2% Ti, representing non-highland areas. Recalibrating the two datasets on the basis of matching the peaks and range on the histograms would not account for this additional structure in the AGR data. Low Ti areas, which occur predominantly on the farside, are not represented well in the lunar sample collection, although several meteorites thought to be of lunar highland origin show Ti abundances averaging about 0.2%. (Error bars on AGR Ti values are about 0.5%.) Gamma-ray measurements reflect intrinsic Ti surface composition, regardless of the physical or chemical state of Ti. Lucey and coworkers have attempted to produce an equivalent bulk Ti map by normalizing the spectral feature at 415 nm to remove the effects of physical variations from soil to soil. The normalization is based on laboratory measurements of available samples, primarily nearside maria, and is undoubtedly optimized for the proportions in which Ti- components are found in these soils. In particular, mare soils tend to have a much higher proportion of opaque mineral grains, which appears to be well correlated with Ti abundance. The relationship between Ti abundance and proportion of Ti-bearing glass (weighted for Ti abundance) is not as direct. Also shows the relationship between landing site soil average, AGR, and CSR Ti abundances (with CSR filtered to match resolution and field of view of AGR data). AGR Ti values show the best agreement with Ti soil averages, CSR Ti values being somewhat higher in high-Ti soils, and lower in low-Ti soils. These results would tend to support the argument that the technique for deriving Ti from the CSR measurements is optimized for one of the primary Ti-bearing components, most likely opaque mineral grains, and is thus over-compensating and reporting higher Ti values in mare areas, and underreporting Ti in highland areas with much lower proportions of opaque mineral grains. More information is contained in original.

Clark, P. E.↗
NASA NTRS1993

Image fusion

The topics covered include the following: a system overview of the basic components of a system designed to improve the ability of a pilot to fly through low-visibility conditions such as fog; the role of visual sciences; fusion issues; sensor characterization; sources of information; image processing; and image fusion.

Pavel, M.↗
NASA NTRS1987

Orbital navigation, docking and obstacle avoidance as a form of three dimensional model-based image understanding

Range imagery from a laser scanner can be used to provide sufficient information for docking and obstacle avoidance procedures to be performed automatically. Three dimensional model-based computer vision algorithms in development can perform these tasks even with targets which may not be cooperative (that is, objects without special targets or markers to provide unambiguous location points). Roll, pitch and yaw of the vehicle can be taken into account as image scanning takes place, so that these can be corrected when the image is converted from egocentric to world coordinates. Other attributes of the sensor, such as the registered reflectence and texture channels, provide additional data sources for algorithm robustness. Temporal fusion of sensor immages can take place in the work coordinate domain, allowing for the building of complex maps in three dimensional space.

Beyer, J.↗