Search NASA⌕ Search

SEARCH · Search NASA

Results for “sensor fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
NASA NTRS2004

Registration and Fusion of Multiple Source Remotely Sensed Image Data

Earth and Space Science often involve the comparison, fusion, and integration of multiple types of remotely sensed data at various temporal, radiometric, and spatial resolutions. Results of this integration may be utilized for global change analysis, global coverage of an area at multiple resolutions, map updating or validation of new instruments, as well as integration of data provided by multiple instruments carried on multiple platforms, e.g. in spacecraft constellations or fleets of planetary rovers. Our focus is on developing methods to perform fast, accurate and automatic image registration and fusion. General methods for automatic image registration are being reviewed and evaluated. Various choices for feature extraction, feature matching and similarity measurements are being compared, including wavelet-based algorithms, mutual information and statistically robust techniques. Our work also involves studies related to image fusion and investigates dimension reduction and co-kriging for application-dependent fusion. All methods are being tested using several multi-sensor datasets, acquired at EOS Core Sites, and including multiple sensors such as IKONOS, Landsat-7/ETM+, EO1/ALI and Hyperion, MODIS, and SeaWIFS instruments. Issues related to the coregistration of data from the same platform (i.e., AIRS and MODIS from Aqua) or from several platforms of the A-train (i.e., MLS, HIRDLS, OMI from Aura with AIRS and MODIS from Terra and Aqua) will also be considered.

LeMoigne, Jacqueline↗
DOE OSTI2024

Infrastructure-Based Cooperative Perception at a Traffic Intersection: Overview and Challenges: Preprint

Recent advancement in autonomous driving vehicles and V2X communication has attracted increasing attention towards Intelligent Transportation Systems to build a safe and reliable traffic intersection. However, most of the systems are still at the initial stages and require significant progress to become a reality. This paper presents an overview of NREL Infrastructure Perception and Control (IPC) framework which is an open-source track-data fusion engine which takes input from infrastructure-based perception sensors and cooperatively shared messages from Connected Autonomous Vehicles (CAVs) and Connected Vehicle (CVs) and the challenges associated with deploying such cooperative perception framework at a four-way traffic intersection in the city of Colorado Springs, CO, USA. The sensor data is collected by deploying two radars and two LiDAR sensors on the IPC mobile lab and two radars on diagonally opposite traffic poles at the proposed intersection. The sensor output results imply the need for rapid sensor calibration to bring the collective perception to a common coordinate frame, the importance of time synchronization between the sensors in order to capture accurate spatial and temporal alignment of the objects, and the need for a health monitoring system with fail safe closed-loop detection model for real-time deployment.

camera↗
DOE OSTI2024

Conceptual Design of Neutron Sensor Qualification Device

The Advanced Sensors and Instrumentation Program at Idaho National Laboratory has been formulating strategies to qualify sensors for use in nuclear environments, particularly in irradiation experiments and advanced reactors. When qualifying neutron sensors for use in high-temperature environments, the wide range of neutron flux levels and representative energy spectra presents significant challenges. This paper discusses the development of the Neutron Sensor Qualification Device (NQD), which is designed to test neutron sensors in high temperature controlled environments with known neutron spectra, addressing the spatial and spectral complexities of neutron fluxes in reactor cores. The proposed NQD will be situated in the exposure room at the Armed Forces Radiobiology Research Institute, thus affording a unique capability to expose sensors to high neutron and gamma fluxes. To achieve thermal control, the device will utilize a radiation-hardened tube furnace, accommodating multiple sensors and neutron activation dosimetry wires. Titanium, iron, and cobalt dosimeter wires are chosen from the American Society for Testing and Materials and International Reactor Dosimetry and Fusion File libraries as references for providing energy-dependent fluence measurements. The design ensures precise sensor positioning to minimize mutual shielding and flux perturbation, which are evaluated via Monte Carlo N particle Transport Code (MCNP) simulations. These simulations have informed the development of guidelines on sensor placement within the NQD. The NQD is essential to the qualification of neutron sensors for advanced reactor technologies. It enables controlled testing of a statistically significant number of sensors, thereby supporting assessments of sensor performance across various neutron flux levels and temperatures. This paper highlights the detailed planning for the NQD prototype, along with its inaugural irradiation (scheduled for fiscal year [FY] 2025). The results from this initial testing will be fundamental in evaluating the device’s performance and establishing measurement uncertainty for in-pile neutron sensor measurements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Automatic Calibration and Health Monitoring of Infrastructure Sensors

Smart transportation infrastructure relies on networks of heterogeneous sensors - cameras, radars, and lidars - continuously monitoring traffic conditions. However, executing the initial spatial calibration of multiple sensors and the subsequent health monitoring presents significant operational challenges. Environmental factors, mechanical vibrations, and gradual drift cause spatial misalignment, degrading fusion performance and tracking accuracy. Traditional calibration approaches require manual intervention with specialized targets or survey equipment, resulting in service interruptions and high maintenance costs. This work presents an automated framework for initial calibration and continuous health monitoring without human intervention or service disruption. Our approach addresses two critical problems: (1) detecting when sensors become miscalibrated during operation, and (2) automatically re-establishing spatial alignment using only operational traffic data. The health monitoring component analyzes measurement innovations - differences between sensor observations and predicted object states - to detect systematic biases indicative of calibration drift. By computing bias magnitude, directional consistency, and rejection rates, the system identifies miscalibrations as small as 0.5 meters. Unlike traditional methods requiring known calibration targets, our diagnostic operates continuously on live traffic observations, enabling early detection before fusion quality degrades. The automatic recalibration algorithm leverages overlapping sensor fields-of-view and temporal correlation of vehicle observations. Using graph-based optimization, the system automatically discovers which sensor pairs observe common regions, estimates pairwise spatial transformations using RANSAC-based robust estimation, and jointly optimizes all sensor poses through bundle adjustment. The framework handles practical deployment challenges, including different sensor sampling rates (1-10 Hz), varying installation positions, unknown orientations, and limited overlap regions (>10%). When approximate sensor positions are available from installation surveys (+/-1m accuracy), the algorithm additionally estimates sensor orientations, refining both position and rotation to sub-meter and sub-degree accuracy. We validate the framework on multi-hour traffic datasets from six heterogeneous sensors with sampling rates ranging from 1 Hz to 10 Hz. Results demonstrate successful calibration even with sparse overlap (<20%) and automatic detection of miscalibrations exceeding 0.8 meters. This work enables a "deploy-and-forget" sensor infrastructure that maintains calibration autonomously, reducing maintenance costs while improving tracking accuracy. The techniques generalize beyond transportation to any multi-sensor monitoring application requiring robust spatial alignment, including smart cities, industrial monitoring, and surveillance systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Automated Label‐Free Assay for Viral Detection and Inhibitor Screening via Biomembrane‐Functionalized Microelectrode Arrays

Most virus infection assays have indirect readout such as virus number following entry (e.g., PCR, cell lysis). While effective, these technologies are labor‐intensive, require specialized environments (e.g., sterile or RNA‐free), and detect later‐stage viral events like lysis or cell death, lacking sensitivity to early fusion events. To address these limitations, we present biologically relevant 2D membrane materials, host‐cell‐derived supported lipid bilayers (hcd‐SLBs), integrated with organic microelectrode arrays (OMEAs) for detection of severe acute respiratory syndrome coronavirus 2 (SARS‐CoV‐2) fusion. By overexpressing angiotensin‐converting enzyme 2 (ACE2) receptors on the native membranes, the platform functions as a viral sensor capable of detecting virus pseudo particles (VPPs) through the late pathway. Additionally, hcd‐SLBs extracted from human lung epithelium expressing native ACE2 detect fusion events through the early pathway. The platform's utility as a drug‐screening tool is demonstrated by testing antibodies targeting either the ACE2 on the host membrane or the viral spike (S) proteins. To enhance the throughput, microfluidics are integrated for automation and OMEAs are incorporated within each channel, miniaturizing the testing units. This system supports high‐throughput data generation, automation, and scalability, providing an efficient platform for viral fusion detection that advances the study of pathogen‐host interactions and accelerates antiviral drug discovery.

Biology↗
NASA NTRS1991

Sensor data validation and reconstruction. Phase 1: System architecture study

The sensor validation and data reconstruction task reviewed relevant literature and selected applicable validation and reconstruction techniques for further study; analyzed the selected techniques and emphasized those which could be used for both validation and reconstruction; analyzed Space Shuttle Main Engine (SSME) hot fire test data to determine statistical and physical relationships between various parameters; developed statistical and empirical correlations between parameters to perform validation and reconstruction tasks, using a computer aided engineering (CAE) package; and conceptually designed an expert system based knowledge fusion tool, which allows the user to relate diverse types of information when validating sensor data. The host hardware for the system is intended to be a Sun SPARCstation, but could be any RISC workstation with a UNIX operating system and a windowing/graphics system such as Motif or Dataviews. The information fusion tool is intended to be developed using the NEXPERT Object expert system shell, and the C programming language.

Source record↗
DOE OSTI2025

Enhancing Automotive Intrusion Detection Through Multi-Modal Fusion: A CAN FD-LiDAR Approach

As vehicles become smarter and more autonomous, they increasingly depend on advanced sensors and communication technologies to operate securely. However, such growing dependence on technology—whether it’s CAN (Controller Area Network) for internal communication or LiDAR (Light Detection and Ranging) for sensing the world around them—also expands the attack surface for the types of cyber attacks. Traditional intrusion detection systems (IDS) typically monitor these systems in isolation, limiting their ability to detect sophisticated, crosssystem attacks. To address this, we propose a multi-modal fusion approach that combines real-world CAN FD signals (from the HCRL dataset) with LiDAR features (from the nuScenes dataset) to enhance attack detection. Our method employs a twostage ensemble approach. Calibrated XGBoost and LightGBM models initially process CAN FD (Fuzzing Data) and LiDAR data independently, detecting timing anomalies and space abnormalities. They are subsequently logarithmically combined with a logistic regression meta-model along with 17 engineered features capturing cross-modal behavior, prediction conflicts, and nonlinear interactions. This approach achieves an AUC of 0.87 and an F1-score of 0.82, surpassing single-modality baselines and early fusion methods, at merely 2 ms inference latency. Compared with deep learning competitors, it is 3 times more efficient, providing a lightweight, interpretable, and real time solution to automotive cybersecurity.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Distributed Visual Sensing and Fusion for Advanced Air Mobility

Surveillance solutions for Advanced and Urban Air Mobility frameworks are a key factor to enable safe operations of highly automated aircraft in the civil airspace. To design solutions suitable for all types of aircraft, non-cooperative sensors can be used, though many challenges arise when the small dimensions of the vehicles and their proximity to the ground during low-altitude missions are considered. A distributed sensing concept can be efficiently applied to address these challenges by exploiting multiple sensors within a surveillance network. This paper proposes a strategy to fuse the information collected by three ground-fixed cameras within a network of multiple distributed sensors and is tested with during experimental flight tests. The solution exploits standalone tracking estimates of each camera within a fusion center that performs triangulation and three-dimensional tracking. This approach is tested in a scenario involving two small UAVs flying at low altitude. The paper deals with the challenges of associating the two objects from independent and unrelated tracks to achieve robust triangulation, which produces meter-level mean errors with respect to GNSS-based ground truth.

Federica Vitiello↗
DOE OSTI2024

Digital Twinning and Predictive Modeling of Traffic for Safe, Efficient, and Reliable Intersections

Over the last decade, the advances in connected and autonomous vehicles (CAVs) have far surpassed the technological realm of transportation infrastructure. There is a growing need to have a technologically commensurate transportation infrastructure to enable safe and reliable movement of goods and people. The recent creation of Advanced Research Projects Agency - Infrastructure (ARPA-I) through the Infrastructure Investment and Jobs Act by the U.S. Department of Transportation (USDOT) has further amplified the need to revolutionize the transportation infrastructure system in the US. This need is perhaps felt most at traffic intersections, as more than 50 percent of the combined total of fatal and injury crashes occur at or near intersections. The proposed concept of Infrastructure Perception and Control (IPC) is aimed at bridging this technological gap by building a real-time digital twin of traffic by fusing detections from sensors installed at the intersection. This digital twin can then empower a wide variety of applications such as smart traffic signals or infrastructure-to-everything (I2X) communications. Smart signaling can help avoid crashes through early-prediction, while I2X can augment the CAV sensors under uncertain driving conditions and provide connected vehicles (CVs) with traffic information they can use to optimize their travel.

connected vehicles↗
NASA NTRS2014

Recent Advances in Registration, Integration and Fusion of Remotely Sensed Data: Redundant Representations and Frames

In recent years, sophisticated mathematical techniques have been successfully applied to the field of remote sensing to produce significant advances in applications such as registration, integration and fusion of remotely sensed data. Registration, integration and fusion of multiple source imagery are the most important issues when dealing with Earth Science remote sensing data where information from multiple sensors, exhibiting various resolutions, must be integrated. Issues ranging from different sensor geometries, different spectral responses, differing illumination conditions, different seasons, and various amounts of noise need to be dealt with when designing an image registration, integration or fusion method. This tutorial will first define the problems and challenges associated with these applications and then will review some mathematical techniques that have been successfully utilized to solve them. In particular, we will cover topics on geometric multiscale representations, redundant representations and fusion frames, graph operators, diffusion wavelets, as well as spatial-spectral and operator-based data fusion. All the algorithms will be illustrated using remotely sensed data, with an emphasis on current and operational instruments.

Fusion↗
NASA NTRS1997

A scale space feature based registration technique for fusion of satellite imagery

Feature based registration is one of the most reliable methods to register multi-sensor images (both active and passive imagery) since features are often more reliable than intensity or radiometric values. The only situation where a feature based approach will fail is when the scene is completely homogenous or densely textural in which case a combination of feature and intensity based methods may yield better results. In this paper, we present some preliminary results of testing our scale space feature based registration technique, a modified version of feature based method developed earlier for classification of multi-sensor imagery. The proposed approach removes the sensitivity in parameter selection experienced in the earlier version as explained later.

Raghavan, Srini↗
DOE OSTI2025

Open World Dempster-Shafer Theory/The Transferable Belief Model with Intervals: A Practitioner's Guide to DST and TBM

Dempster-Shafer theory (DST) is a mathematical framework that allows for uncertainty or ignorance to be quantified and included when making predictions from evidence. This is in contrast to Bayesian theory, which does not allow for any quantification of ignorance. The framework is described in great detail in [7]. DST is particularly useful for problems where the inclusion of additional evidence (for example, data from another sensor) could lead to a different conclusion. Thus, it is a useful data fusion method, especially in applications not suited to maximum likelihood or maximum a posteriori estimations due to limited samples or incomplete prior knowledge.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1989

Integration of active and passive sensors for obstacle avoidance

The automatic obstacle-avoidance guidance problem is studied under the operational constraints imposed by the rotorcraft nap-of-the-earth (NOE) environment. The problem is discussed for two different circumstances. The first assumes that a full range map is available, irrespective of the type of sensor being used. Two approaches are proposed to extend a two-dimensional obstacle-avoidance concept presented by Cheng (1988). The situation where only a sparse range map is available from a passive sensor is also treated. An integrated approach that augments the passive sensor with an active one is discussed, along with the problem of data fusion and how it is affected by the characteristics of NOE flight.

Cheng, Victor H. L.↗
DOE OSTI2025

Fiber-optic bolometers with high-temperature tolerance and reduced time constants for fusion plasma diagnostics

Fiber-optic bolometers (FOBs) designed for plasma radiation measurement in magnetically confined fusion environments have been previously developed and tested at the DIII-D tokamak. These FOBs utilize a silicon Fabry–Perot interferometer at the fiber tip for temperature measurement and a gold disk as a radiation absorber. This paper presents recent advancements in the development of FOBs with reduced cooling time constants and enhanced temperature tolerance. We also demonstrate high-temperature operation and report findings from irradiation tests. By incorporating a copper sensor holder as a thermal sink and integrating two closely packed sensor heads into a compact design, the cooling time constants were reduced to ∼100 ms in vacuum, while minimizing uncertainties caused by temperature gradients. The FOBs were subjected to heating at 400 °C for five hours, with no observed degradation in noise performance post-heating. High-temperature operation tests were conducted at ∼220 °C using a 404 nm square-wave modulated laser to simulate the plasma radiation. In addition, four FOBs constructed from copper-coated pure-silica fibers were fabricated and underwent irradiation testing, enduring a total γ-radiation dose of 15.2 MGy and a neutron fluence of 1.6 × 10 18 n/cm 2 . As a result, the FOBs maintained their physical integrity and the optical signal shows high visibility throughout the test.

42 ENGINEERING↗
NASA NTRS1993

Interactive and cooperative sensing and control for advanced teleoperation

This paper presents the paradigm of interactive and cooperative sensing and control as a fundamental mechanism of integrating and fusing the strengths of man and machine for advanced teleoperation. The interactive and cooperative sensing and control is considered as an extended and generalized form of traded and shared control. The emphasis of interactive and cooperative sensing and control is given to the distribution of mutually nonexclusive subtasks to man and machine, the interactive invocation of subtasks under the man/machine symbiotic relationship, and the fusion of information and decisionmaking between man and machine according to their confidence measures. The proposed interactive and cooperative sensing and control system is composed of such major functional blocks as the logical sensor system, the sensor-based local autonomy, the virtual environment formation, and the cooperative decision-making between man and machine. The Sensing-Knowledge-Command (SKC) fusion network is proposed as a fundamental architecture for implementing cooperative and interactive sensing and control. Simulation results are shown.

Lee, Sukhan↗
NASA NTRS1990

Evolution of an Intelligent Information Fusion System

Consideration is given to the hardware and software needed to manage the enormous amount and complexity of data that the next generation of space-borne sensors will provide. An anthology is presented illustrating the evolution of artificial intelligence, science data processing, and management from the 1960s to the near future. Problems and limitations of technologies, data structures, data standards, and conceptual thinking are addressed. The development of an end-to-end Intelligent Information Fusion System that embodies knowledge of the user's domain-specific goals is proposed.

Campbell, William J.↗
NASA NTRS2005

Design Methods and Practices for Fault Prevention and Management in Spacecraft

Integrated Systems Health Management (ISHM) is intended to become a critical capability for all space, lunar and planetary exploration vehicles and systems at NASA. Monitoring and managing the health state of diverse components, subsystems, and systems is a difficult task that will become more challenging when implemented for long-term, evolving deployments. A key technical challenge will be to ensure that the ISHM technologies are reliable, effective, and low cost, resulting in turn in safe, reliable, and affordable missions. To ensure safety and reliability, ISHM functionality, decisions and knowledge have to be incorporated into the product lifecycle as early as possible, and ISHM must be considered as an essential element of models developed and used in various stages during system design. During early stage design, many decisions and tasks are still open, including sensor and measurement point selection, modeling and model-checking, diagnosis, signature and data fusion schemes, presenting the best opportunity to catch and prevent potential failures and anomalies in a cost-effective way. Using appropriate formal methods during early design, the design teams can systematically explore risks without committing to design decisions too early. However, the nature of ISHM knowledge and data is detailed, relying on high-fidelity, detailed models, whereas the earlier stages of the product lifecycle utilize low-fidelity, high-level models of systems and their functionality. We currently lack the tools and processes necessary for integrating ISHM into the vehicle system/subsystem design. As a result, most existing ISHM-like technologies are retrofits that were done after the system design was completed. It is very expensive, and sometimes futile, to retrofit a system health management capability into existing systems. Last-minute retrofits result in unreliable systems, ineffective solutions, and excessive costs (e.g., Space Shuttle TPS monitoring which was considered only after 110 flights and the Columbia disaster). High false alarm or false negative rates due to substandard implementations hurt the credibility of the ISHM discipline. This paper presents an overview of the current state of ISHM design,and a review of formal design methods to make recommendations about possible approaches to enable the ISHM capabilities to be designed-in at the system-level, from the very beginning of the vehicle design process.

Tumer, Irem Y.↗
NASA NTRS2006

An Overview of Inter-comparison Methodologies for Terra and Aqua MODIS Calibration

With increasing efforts on data fusion and long-term climate data records (CDR) using observations made by multiple sensors, on the same or different platforms, their cross-calibration and validation work has become more and more important. The uncertainties of the climate models and data records depend not only on the calibration quality of individual sensors but also on their calibration consistency. This paper provides an overview of methodologies used by the MODIS Characterization Support Team (MCST) at NASA GSFC for the inter-comparison studies of Terra and Aqua MODIS on-orbit calibration. Each MODIS was built with a set of onboard calibrators (OBC) that include a blackbody (BB), a solar diffuser (SD), and a solar diffuser stability monitor (SDSM). The BB is primarily used for the thermal emissive bands (TEB) calibration and the SD/SDSM system for the reflective solar bands (RSB) calibration. Although the-instrument design and calibration approach are nearly identical for both Terra and Aqua MODIS and they all went through an extensive and similar pre-launch calibration and characterization process, still their on-orbit calibration consistency needs to be carefully examined and validated as many science products have been generated from observations made by both instruments. Methodologies discussed in this paper include inter-comparison studies using the Moon, a third sensor, and ground targets. Our results show that Terra and Aqua reflective solar bands and thermal emissive bands have been calibrated consistently with excellent long-term stabilities. For the 11 and 12 micrometers sea surface temperature (SST) bands, the calibration difference of Terra and Aqua MODIS is less than 0.2K.

Xiong, X.↗