Neural-Driven Multi-Sensor Data Fusion for Fracturing-Induced Seismicity Diagnostics: Electromagnetic, Distributed Fiber-Optic, and Tiltmeter
Explore the source record for details and available documents.
02 PETROLEUM↗
SEARCH · Search NASA
Results for “multi-sensor data fusion”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Fusing 4D coded thermoacoustic, electromagnetic, and acoustic/seismic wavefields for subsurface characterization and imaging of fluid flow in porous media
This research program aims to address critical challenges in subsurface exploration and monitoring of anthropogenic CO 2 storage by advancing quantitative dynamic sensing and imaging technologies. Two primary applications—petrophysical assessment of hydrocarbon reservoirs (C1) and CO 2 storage monitoring (C2)—require significant innovation to overcome three barriers (B1-B3). These barriers include the need for enhanced understanding of interactions between physical wave fields (thermoacoustic, electromagnetic, acoustic/seismic, and X-ray) with fluid-filled porous media, the development of multi-sensor data fusion for real-time imaging, and upscaling microscopic quantum effects for macroscopic observations. The project’s objective was to establish a unified 4D coded sensing and imaging approach, integrating EM, AC/S, and TA fields for multi-scale and multi-physics material characterization and subsurface imaging.
58 GEOSCIENCES↗
Multi-Source Multi-Domain Data Fusion for Cyberattack Detection in Power Systems
Not Available
24 POWER TRANSMISSION AND DISTRIBUTION↗
Studying drought-induced forest mortality using high spatiotemporal resolution evapotranspiration data from thermal satellite imaging
Drought can have pervasive and wide-spread impacts to forest health, as evidenced in several severe events occurring over the recent decades. Extensive forest die-off due to drought can impair the ecological functioning of forests, impacting habitat, water yield and quality from forested lands, and altering forest fire dynamics and intensity. Satellite remote sensing provides an effective means for detecting and monitoring spatial patterns of forest mortality over large areas, exploiting free and open long-term image archives available at a range in spatial and temporal resolutions. While remotely sensed surface reflectances and vegetation indices have been widely used to study optical response of forest canopies to drought events, retrievals of evapotranspiration (ET) derived from thermal satellite imagery – particularly at resolutions approaching crown scale - can provide insights into cumulative tree stresses that can incite disease and trigger mortality. In this study, we applied a multi-sensor satellite data fusion approach to estimate daily 30-m resolution ET and an associated Evaporative Stress Index (ESI) to study drought-induced mortality in a temperate forest at the Missouri Ozark AmeriFlux (MOFLUX) site, located in the central United States. The study covered the period from 2010 to 2014, including an exceptional drought year of 2012. Modeled ET agreed well with eddy flux measurements from the MOFLUX tower, with average monthly relative errors of 15%. Plot-scale ESI, describing temporal anomalies in the ratio of actual-to-reference ET, was used as an index of relative forest health to investigate relationships between forest mortality and drought severity. ESI showed good agreement with observed predawn leaf water potential, especially during the drought year. Furthermore, plot-scale ESI was also correlated with the subsequent year's tree mortality, suggesting the importance of considering the forest health condition prior to drought when studying drought-induced forest impacts. This study demonstrates the utility of multi-year ET remote sensing data at the stand or plot scale as an indicator of forest health and as a predictor of future mortality due to drought.
54 ENVIRONMENTAL SCIENCES↗
The Sensor Dilemma in Intelligent Transportation Systems
Intelligent Transportation Systems (ITS) are at the forefront in advancing the way we interact and perceive with the transportation network. This revolution is fueled by the significant advancement in sensor perception technologies such as Radar, LiDAR and Video Imaging which are the most popular modalities for ITS. Real-time perception data from these sensors allows intelligent infrastructure side decision making to improve the energy, efficiency and safety at traffic intersections. As traffic departments across the United States are transitioning from traditional loop detectors / emulators and embracing newer technologies, they are often left with a dilemma in choosing a sensor technology for infrastructure-based perception which is reliable, inexpensive, easy to setup and has robust performance in varying weather conditions. However, choosing a sensor which checks all boxes is not straightforward as every sensor type has unique benefits and drawbacks. Radar is excellent at detecting long range vehicles and weather resistance but lacks high resolution. LiDAR is expensive and weather-sensitive, while cameras provide rich visual data at a low cost but are constrained by lighting and visibility. This study examines Radar, LiDAR and camera sensors capabilities to ascertain whether any of these qualifies as the "best" sensor for ITS perception. Through this evaluation, we hope to draw attention to the necessity of National Renewable Energy Laboratory's (NREL) Infrastructure Perception and Control (IPC) framework which presents a multi-sensor track data fusion engine to assimilate multiple data streams in order to provide robust and reliable perception. While no single sensor can meet all the demands of ITS, a hybrid approach combining multiple sensor modalities like Radar, LiDAR and cameras, offers the most robust solution for enhancing the safety and efficiency in intelligent transportation systems.
33 ADVANCED PROPULSION SYSTEMS↗
Data Fusion via Neural Network Entropy Minimization for Target Detection and Multi-Sensor Event Classification
Broadly applicable solutions to multimodal and multisensory fusion problems across domains remain a challenge because effective solutions often require substantive domain knowledge and engineering. The chief questions that arise for data fusion are in when to share information from different data sources, and how to accomplish the integration of information. The solutions explored in this work remain agnostic to input representation and terminal decision fusion approaches by sharing information through the learning objective as a compound objective function. The objective function this work uses assumes a one-to-one learning paradigm within a one-to-many domain which allows the assumption that consistency can be enforced across the one-to-many dimension. The domains and tasks we explore in this work include multi-sensor fusion for seismic event location and multimodal hyperspectral target discrimination. We find that our domain- informed consistency objectives are challenging to implement in stable and successful learning because of intersections between inherent data complexity and practical parameter optimization. While multimodal hyperspectral target discrimination was not enhanced across a range of different experiments by the fusion strategies put forward in this work, seismic event location benefited substantially, but only for label-limited scenarios.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Skyfall: Signal Fusion from a Smartphone Falling from the Stratosphere
A smartphone plummeted from a stratospheric height of 36 km, providing a near-real-time record of its rapid descent and ground impact. An app recorded and streamed useful internal multi-sensor data at high sample rates. Signal fusion with external and internal sensor systems permitted a more detailed reconstruction of the Skyfall chronology, including its descent speed, rotation rate, and impact deceleration. Our results reinforce the potential of smartphones as an agile and versatile geophysical data collection system for environmental and disaster monitoring IoT applications. We discuss mobile environmental sensing capabilities and present a flexible data model to record and stream signals of interest. The Skyfall case study can be used as a guide to smartphone signal processing methods that are transportable to other hardware platforms and operating systems.
47 OTHER INSTRUMENTATION↗
Descriptor: Infrastructure Perception and Control: Multi-Sensor Object Tracking Dataset (IPC-MSOT)
Traffic intersections are crucial and challenging nodes in transportation networks where multiple lanes of vehicles and pedestrians converge. Traffic accidents often occur at traffic intersections, including a large proportion of traffic fatalities and about one-half of all traffic injuries in the United States. Object detection data were collected in 2024 across three intersections in Colorado Springs, CO, USA, over the course of multiple days and various times to induce a heterogeneous mix of traffic conditions and behaviors. The purpose of the data collection exercises was to learn various attributes about infrastructure sensors and to build a repository of high-resolution, object-level data that can be used for research and development (e.g., to develop multisensor data fusion algorithms). The Infrastructure Perception and Control:Multi-Sensor Object tracking (IPC-MSOT) dataset was collected as part of the U.S. Department of Transportation's Strengthening Mobility and Revolutionizing Transportation (SMART) project, where the city of Colorado Springs, Colorado, and the National Renewable Energy Laboratory collaborated to collect object-level trajectory data from road users using multiple types of infrastructure sensors deployed at different intersections. This dataset allows for testing of late-stage sensor fusion algorithms and their ability to ingest multimodal sensor data, and it can be utilized by traffic engineers to design and evaluate trajectory-based signal control strategies.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
IPC-Fusion (Infrastructure Perception and Control (IPC): Multisensor Data Fusion Software) [SWR-25-153]
As part of the National Laboratory of the Rockies' (NLR’s) Infrastructure Perception and Control Laboratory, the IPC-Fusion toolkit provides a probabilistic, scalable, multi-sensor fusion framework that integrates (late-stage fusion) heterogeneous object detection data from traffic sensors to enable robust, real-time tracking of roadway occupants. The algorithmic design of the toolkit is motivated by the need for creating a digital twin of traffic at the edge in a scalable and affordable manner. The software operates by combining object-level measurements (such as position and velocity) from a suite of sensors (such as radar, lidar, camera) using Kalman filtering and probabilistic data association techniques to overcome individual sensor limitations and achieve superior tracking performance in complex traffic zones. The framework addresses key challenges including heterogeneous measurement uncertainties, asynchronous data streams, varying spatiotemporal data resolutions, robust data association, and adaptive object lifecycle management. Validated on real-world traffic intersection data including vehicles and pedestrians, IPC-Fusion demonstrates enhanced tracking reliability across scenarios involving occlusions, sensor failures, and varying traffic densities, supporting the broader IPC initiative's goal of transforming transportation infrastructure through advanced perception capabilities for intelligent transportation systems, traffic safety applications, and autonomous vehicle support.
Sandhu, Rimple [National Laboratory of the Rockies↗
Feasibility of fusion plasma burn control via real-time, sub-divertor neutral gas isotopic and compositional analysis
The ability to provide fusion burn control without requiring physical access through the first wall and fuel breeding blankets, would be vital for any future, magnetically confined fusion power reactor. A multi-sensor, fusion fuel cycle exhaust, neutral gas analysis system on JET, capable of delivering real time data, and accessing only the sub-divertor region, provides an excellent example of such capability. Optimized for and operated during the deuterium–tritium experimental campaigns 2 and 3 (DTE2, DTE3), it is proving valuable for planning to explore fusion reactor burn control in ITER with a comparable diagnostic system called the Diagnostic Residual Gas Analyzer (DRGA). This paper aims to show feasibility of developing model-based controllers for ITER and next generation, reactor-relevant devices, by building both on the empirical experience in JET-DTE2, and on the already emerging experience on developing such models specifically for ITER. The paper begins with a specific use-case from JET-DTE2, pertaining to the observed sensitivity of the fusion neutron yield on the concentration of isotopic helium-3 ( 3 He), with data from one of the high-performance DT shots exhibited with emphasis on the 3 He measurement via the sub-divertor. Then, a first model is developed and then explored with simulations that aim to discover how well the controllers in the model react to either insufficient levels of 3 He or excessive levels of 3 He. The simulations then explore potential impact from a delay in the measurement (or the response) that would be comparable to the ∼1 s, conductance limited response for the ITER DRGA system, currently in its final design. The simulations show that control is feasible, and that its effectiveness is not significantly impacted by such delay.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Safe Operations at Roadway Junctions: Intelligent Roadway Infrastructure as Functional Interlocking
Automated vehicle (AV) technology is quickly maturing, and the corresponding infrastructure systems that evaluate traffic and communicate to vehicles requires sophisticated sensing and perception technologies, referred to as intelligent roadway infrastructure (IRI), to complement emerging AV capabilities. IRI provides signals to vehicles, indicating right-of-way for vehicles and communicating to approaching AVs that no other vehicle is failing to yield. This capability, denoted as safety-affirmative signaling, provides a green light or a green arrow as appropriate and affirms through communication links to connected vehicles when it is safe to proceed. About 36% of collisions occur at intersections, with most occurring upon left turns (22.2%) or crossing over (12.6%), and only a small percentage (1.2%) while turning right at an intersection. Of all intersection crashes about half (52.5%) of those vehicles were traveling through a signalized intersection 2. Safety-affirmative signaling would guarantee safety of AV fleet vehicles, by providing the interlocking principle, a term from automated train control that only allows progression through a railway intersection after affirming no opportunity for a crash exists. IRI through safety-affirmative signaling would bring performance and safety to complex roadway intersections where AV transit fleet service is most needed, as well as safety benefits to traditional, non-automated vehicles and vulnerable road users. The implementation of IRI has functional, programmatic, and technical challenges. Research work performed at the National Renewable Energy Laboratory (NREL) in an integrative approach encapsulating these themes, and termed infrastructure perception and control (IPC) is motivated by improved performance (travel time), improved safety (reduced collisions), and improved energy efficiency (less fuel burned and minimized production of greenhouse gases). IPC is intended not only for roadway and intersection applications but also in extension to inform complementary buildings and grid systems to enable better co-management, as vehicles and their charging needs become increasingly integrated into the built environment. The NREL IPC project presents an open-source framework, architecture, and supporting technology to implement IRI, addressing critical issues such as fusion of data, reliability, standardization of data interfaces, and confidence of detection. The framework is informed by previous experience in U.S. Department of Defense research technology, specifically in the use of radar to detect, identify, and track aerial threats. These principles combined with multi-sensor fusion provides for a complete digital twin with known and measurable confidence and accuracy from which safety-affirmative signaling can be developed and deployed.
ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗
Erratum to: Data Fusion to Support Integrated Nuclear Detonation Detection [Slides]
The original document (LA-UR-22-29547) contained minor equation errors that approximate correct equations that couple the multi-sensor, serial system detector thresholds for a seismic Rayleigh wave detector and an acoustic energy detector. Those errors appeared on slides 62-67. This erratum associates the following slides with the erroneous slides. The numbers of the erroneous slides are marked at the upper right in small text in orange. A result of those errors over-predict the performance of the two-sensor serial network, that is, the former document provides an optimistic estimate of system performance.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
Science Area 1: Standard Award: Model-Data Fusion to Examine Multiscale Dynamical Controls on Snow Cover and Critical Zone Moisture Inputs (Final Report)
In many mountain watersheds of the world, seasonal snowpacks play an important role as natural reservoirs of water. Seasonal snowpacks accumulate water during cold, wet winter months that subsequently melts. Downstream communities depend on water from melting seasonal snowpacks to support agricultural, industrial, and municipal water needs. Rapidly melting snowpacks can also present a flooding hazard, particularly if snowpacks melt at rates faster than anticipated and where adequate reservoir capacity is unavailable to buffer river flows associated with melt. The spatial and temporal dynamics of snow accumulation and melt also play an important role in supporting upland ecosystems in mountain landscapes. Snowmelt provides soil moisture that enable terrestrial ecosystem productivity and exert control on soil microorganisms that play important roles in global carbon cycles. Climate warming is gradually decreasing the amount of precipitation in mountain watersheds arriving as snow, presenting potentially profound disruptions to mountain ecosystems, as well as downstream delivery of water. The overarching goal of this project was to understand how interactions between the near-surface atmosphere and surface topography control the input, accumulation, retention, and release of water from mountain snowpacks. Over a 5-year period, this project pursued an approach combining high-resolution regional climate modeling, satellite and airborne remote sensing data, and ground-based observations to develop and analyze benchmark datasets to address overarching science questions and hypotheses. Key products include a continuous, long-term, high spatiotemporal resolution (1 km/1 hr) dataset characterizing key climate variables in the Upper Colorado River Basin. The dataset included historical estimates of precipitation, temperature, humidity, solar and longwave radiation, and wind speeds. Additionally, the project developed a 20+ year long, 30 m spatial, daily temporal multi-sensor dataset characterizing snow presence/absence in the East/Taylor River watersheds in the Central Rocky Mountains of Colorado. The project supported training of 1 postdoctoral scholar, 1 Ph.D. student, and 1 M.S. student.
54 ENVIRONMENTAL SCIENCES↗
Forest aboveground biomass estimation through integration of sentinel-2 and PALSAR-2 time series: assessing models trained on GEDI and field inventory benchmarks
Accurate and spatially explicit forest Aboveground Biomass (AGB) mapping through remote sensing is critical for quantifying terrestrial carbon stocks and informing effective forest management strategies. However, AGB estimation in dense forests with complex terrain remains challenging due to satellite sensor signal saturation problem (saturation issue occurs in high biomass forests), structural complexity, and limited ground truth for calibration. This study presents a novel framework that integrates multi-temporal Sentinel-2 optical imagery, ALOS PALSAR-2 Synthetic Aperture Radar (SAR) data, and topographic variables with explainable Machine Learning to map AGB across mountainous forests within subtropical and temperate oceanic climate zones of Mexico. We evaluate the effects of temporal granularity and sensor synergy by comparing multiple temporal inputs and sensor configurations (Sentinel-2, PALSAR-2, and their fusion), and assess model performance using two reference datasets: NASA GEDI LiDAR-derived biomass and Mexico’s National Forest and Soil Inventory (INFyS). Our results showed that models trained on INFyS consistently outperformed those trained on GEDI, highlighting limitations in GEDI’s reliability in biomass estimates within this study region. Furthermore, the integration of Sentinel-2 and PALSAR-2 provided improved predictions compared to single-sensor models, particularly when combined with temporally explicit yearly statistics. The best-performing model, which was trained on INFyS data, and considered both Sentinel-2 and PALSAR-2 yearly statistics, as well as topographic variables, achieved an R2 of 0.64, RMSE of 51.10 Mg/ha, and relative RMSE (rRMSE) of 58.69%. Explainable ML analysis identified Sentinel-2 spectral indices and topographic features as key predictors, while PALSAR-2 metrics provided complementary information, partially mitigating saturation effects in high-biomass areas. Specifically, integrating both sensors substantially improved AGB estimation in high biomass forest (≥200 Mg/ha), yielding 98% gains over optical-only model, with resulting estimates exceeding GEDI L4B by 29% and ESA-CCI-BIOMASS by 174%. Terrain-stratified analysis indicated close agreement with GEDI in low-slope areas, with increasing divergence as slope steepness increased, while estimates remained consistently higher than ESA-CCI-BIOMASS across all slope classes. The proposed approach advances multi-sensor fusion and temporal feature engineering for AGB mapping using open-access satellite datasets, providing a scalable and reproducible framework for annual biomass monitoring in topographically complex mountainous forests. The resulting 25 m resolution biomass product has the potential to provide spatially detailed information for forest monitoring and may support applications in carbon accounting and forest management.
54 ENVIRONMENTAL SCIENCES↗
Quantitative Non-Destructive Evaluation of Fatigue Damage Based on Multi-Sensor Fusion
Based on sensor fusion and machine learning, this project developed a novel non-destructive evaluation (NDE) methodology, which consists of a remaining useful life (RUL) prediction framework and regression models for predicting residual stress and full width at half maximum (FWHM). A series of fatigue testing experiments were conducted using 5052-H32 aluminum alloy specimens. All specimens were measured using linear ultrasonic (LU) and nonlinear ultrasonic (NLU) testing methods non-destructively. Machine learning models were developed to use LU and NLU measurements to predict loading condition, fatigue level, residual stress, and FWHM. It was demonstrated that the developed methodology could distinguish new and fatigue specimens with an accuracy of 97.53%. Also, the prediction errors for residual stress and FWHM were as low as 4.73% and 1.62%, respectively. An interactive database was created to publicly share the data generated from the project. It is envisioned that the developed NDE technology will equip manufacturers with a responsive screening system for incoming used metallic components, and potentially lead to a significant increase in using used metallic components for remanufacturing.
42 ENGINEERING↗
Automatic Calibration and Health Monitoring of Infrastructure Sensors
Smart transportation infrastructure relies on networks of heterogeneous sensors - cameras, radars, and lidars - continuously monitoring traffic conditions. However, executing the initial spatial calibration of multiple sensors and the subsequent health monitoring presents significant operational challenges. Environmental factors, mechanical vibrations, and gradual drift cause spatial misalignment, degrading fusion performance and tracking accuracy. Traditional calibration approaches require manual intervention with specialized targets or survey equipment, resulting in service interruptions and high maintenance costs. This work presents an automated framework for initial calibration and continuous health monitoring without human intervention or service disruption. Our approach addresses two critical problems: (1) detecting when sensors become miscalibrated during operation, and (2) automatically re-establishing spatial alignment using only operational traffic data. The health monitoring component analyzes measurement innovations - differences between sensor observations and predicted object states - to detect systematic biases indicative of calibration drift. By computing bias magnitude, directional consistency, and rejection rates, the system identifies miscalibrations as small as 0.5 meters. Unlike traditional methods requiring known calibration targets, our diagnostic operates continuously on live traffic observations, enabling early detection before fusion quality degrades. The automatic recalibration algorithm leverages overlapping sensor fields-of-view and temporal correlation of vehicle observations. Using graph-based optimization, the system automatically discovers which sensor pairs observe common regions, estimates pairwise spatial transformations using RANSAC-based robust estimation, and jointly optimizes all sensor poses through bundle adjustment. The framework handles practical deployment challenges, including different sensor sampling rates (1-10 Hz), varying installation positions, unknown orientations, and limited overlap regions (>10%). When approximate sensor positions are available from installation surveys (+/-1m accuracy), the algorithm additionally estimates sensor orientations, refining both position and rotation to sub-meter and sub-degree accuracy. We validate the framework on multi-hour traffic datasets from six heterogeneous sensors with sampling rates ranging from 1 Hz to 10 Hz. Results demonstrate successful calibration even with sparse overlap (<20%) and automatic detection of miscalibrations exceeding 0.8 meters. This work enables a "deploy-and-forget" sensor infrastructure that maintains calibration autonomously, reducing maintenance costs while improving tracking accuracy. The techniques generalize beyond transportation to any multi-sensor monitoring application requiring robust spatial alignment, including smart cities, industrial monitoring, and surveillance systems.
24 POWER TRANSMISSION AND DISTRIBUTION↗