Advanced Sensor Fusion Using Low-Cost Sensors for Dramatic Physical Security Cost Reduction
Explore the source record for details and available documents.
98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
SEARCH · Search NASA
Results for “Sensor fusion”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Trident Smyth: Near Real Time Sensor Fusion and Track Stitching Application
Sandia’s Sensor Data Fusion application is a NGA sponsored project that fuses tracks from different sensors to provide more accuracy than any single track. The application serves as the unclassified architecture for data ingestion, processing, and near real-time sensor fusion.
Sorroche, Joseph John [Sandia National Laboratorie↗
Deep Weighted Fusion Learning (DWFL)-based multi-sensor fusion model for accurate building occupancy detection
Not Available
Rafi, Md. Rumman↗
Multimodal sensor fusion for real-time standoff estimation in directed energy deposition
In Laser Powder-based Direct Energy Deposition (LP-DED) systems, achieving consistency, precision and quality of produced parts requires tight control over printing parameters. One of the critical parameters is the standoff distance. Maintaining an optimal standoff height is crucial for achieving correct laser power density and powder catchment efficiency, as both laser and powder streams are focused at this distance. Here, this study introduces a novel approach using multimodal sensor fusion to predict standoff height in real-time. The proposed system integrates two low-profile, cost-effective sensors: an RGB coaxial camera and a high frequency and high dynamic range microphone. By utilizing a simple fully connected neural network, trained on a limited dataset, data fusion of these sensors allowed for the real-time prediction of the standoff height. The results demonstrate high resolution and accuracy of the predictions across multiple geometries and a wide range of standoff heights. This approach offers a simple, and cost-effective solution for real-time standoff height monitoring and lays the groundwork for future integration into commercial LP-DED systems.
42 ENGINEERING↗
Advancing Industry 4.0: Multimodal Sensor Fusion for AI-Based Fault Detection in 3D Printing
Additive manufacturing, particularly fused deposition modeling, is transforming modern production by enabling rapid prototyping and complex part fabrication. However, its layer-by-layer process remains vulnerable to faults such as nozzle clogging, filament runout, and layer misalignment, which compromise print quality and reliability. Traditional inspection methods are costly, time-intensive, and often limited to post-process analysis, making them unsuitable for real-time intervention. In this current study, the authors developed a novel, low-cost, and portable faultdetection system that leverages multimodal sensor fusion and artificial intelligence for real-time monitoring in FDM-based 3D printing. The system integrates acoustic, vibration, and thermal sensing into a non-intrusive architecture, capturing complementary data streams that reflect both mechanical and process-related anomalies. Acoustic and thermal sensors operate in a fully contactless manner, while the vibration sensor requires minimal attachment such that it will not interfere with printer hardware, thereby preserving portability and ease of deployment. The multimodal signals are processed into spectrograms and time-frequency features, which are classified using convolutional neural networks for intelligent fault detection. The proposed system advances Industry 4.0 objectives by offering an affordable, scalable, and practical monitoring solution that improves faultdetection accuracy, reduces waste, and supports sustainable, adaptive manufacturing.
42 ENGINEERING↗
Comparing Sensor Fusion and Multimodal Chemometric Models for Monitoring U(VI) in Complex Environments Representative of Irradiated Nuclear Fuel
Optical sensors and chemometric models were leveraged for the quantification of uranium(VI) (0–100 μg mL –1 ), europium (0–150 μg mL –1 ), samarium (0–250 μg mL –1 ), praseodymium (0–350 μg mL –1 ), neodymium (0–1000 μg mL –1 ), and HNO 3 (2–4 M) with varying corrosion product (iron, nickel, and chromium) levels using laser fluorescence, Raman scattering, and ultraviolet–visible–near-infrared absorption spectra. In this paper, an efficient approach to developing and evaluating tens of thousands of partial least-squares regression (PLSR) models, built from fused optical spectra or multimodal acquisitions, is discussed. Each PLSR model was optimized with unique preprocessing combinations, and features were selected using genetic algorithm filters. The 7-factor D-optimal design training set contained just 55 samples to minimize the number of samples. The performance of PLSR models was evaluated by using an automated latent variable selection script. PLS1 regression models tailored to each species outperformed a global PLS2 model. PLS1 models built using fused spectra data and a multimodal (i.e., analyzed separately) approach yielded similar information, resulting in percent root-mean-square error of prediction values of 0.9–5.7% for the seven factors. Further, the optical techniques and data processing strategies established in this study allow for the direct analysis of numerous species without measuring luminescence lifetimes or relying on a standard addition approach, making it optimal for near-real-time, in situ measurements. Nuclear reactor modeling helped bound training set conditions and identified elemental ratios of lanthanide fission products to characterize the burnup of irradiated nuclear fuel. Leveraging fluorescence, spectrophotometry, experimental design, and chemometrics can enable the remote quantification and characterization of complex systems with numerous species, monitor system performance, help identify the source of materials, and enable rapid high-throughput experiments in a variety of industrial processes and fundamental studies.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Scalable in situ non-destructive evaluation of additively manufactured components using process monitoring, sensor fusion, and machine learning
Laser Powder Bed Fusion (L-PBF) Additive Manufacturing (AM) is among the metal 3D printing technologies most broadly adopted by the manufacturing industry. However, the current industry qualification paradigm for critical-application L-PBF parts relies heavily on expensive non-destructive inspection techniques, which significantly limits the use-cases of L-PBF. In situ monitoring of the process promises a less expensive alternative to ex situ testing, but existing sensor technologies and data analysis techniques struggle to detect sub-surface flaws (e.g., porosity and cracking) on production-scale L-PBF printers. In this work, an in situ NDE (INDE) system was engineered to detect subsurface flaws detected in X-Ray Computed Tomography (XCT) directly from process monitoring data. A multilayer, multimodal data input allowed the INDE system to detect numerous subsurface flaws in the size range of 200–1000µm using a novel human-in-the-loop annotation procedure. Furthermore, a framework was established for generating probability-of-detection (POD) and probability-of-false-alarm (PFA) curves compliant with NDE standards by systematically comparing instances of detected subsurface flaws to post-build XCT data. Here, we also introduce for the first time in the AM in situ sensing literature the a 90/95 – the flaw size corresponding to a 90% detection rate on the lower 95% confidence interval of the POD curve. The INDE system successfully demonstrated POD capabilities commensurate with traditional NDE methods. Traditional ML performance metrics were also shown to be inadequate for assessing the ability of the INDE system’s flaw detection performance. It is the hope of the authors that future studies will adopt the POD and PFA approach outlined here to provide better insight into the utility of process monitoring for AM.
36 MATERIALS SCIENCE↗
Machine Learning Enabled Sensor Fusion for In-Situ Defect Detection in Laser Powder Bed Fusion
Laser Powder Bed Fusion (L-PBF) Additive Manufacturing (AM) is among the metal 3D printing technologies most broadly adopted by the manufacturing industry. The current industry qualification paradigm for critical-application L-PBF parts relies heavily on expensive non-destructive inspection techniques such as X-Ray Computed Tomography (XCT), which significantly limits the use-cases of L-PBF. In situ monitoring of the process promises a less expensive alternative to ex situ testing, but existing sensor technologies and data analysis techniques struggle to detect sub-surface flaws (e.g., porosity and cracking) on production-scale L-PBF printers. RTX Technologies Research Center (RTRC) has licensed ORNL’s Peregrine software package – a printer- and camera-agnostic data analytics tool designed specifically for detecting process anomalies using in situ data collected during powder bed printing. The goal of this project was to feed temporally rich, multi-modal sensor data, including visible light, integrated near infrared (NIR), and spatially mapped co-axial melt pool thermal emission data into Peregrine to enable detection of subsurface flaws. XCT data was used as ground truth training data to allow Peregrine’s deep learning algorithms to recognize anomalies in these complex data streams in both test artifacts and industrially relevant geometries. Completion of this program has seen the successful implementation of multi-modal, multi-layer sensor data footprints for training of machine learning models in Peregrine. Flaws detected in XCT data have been successfully detected directly from this in situ data footprint, and initial analyses of the in situ probability-of-detection has been conducted, showing performance levels commensurate with traditional non-destructive evaluation (NDE) methods. The in situ monitoring methodology was then applied to an industrially relevant component that was using post-build NDE, highlighting the utility of the proposed method for hard-to-inspect AM components. As a direct result of this program, two journal manuscripts [1], [2] have been published in Additive Manufacturing, with additional manuscripts planned following program completion.
36 MATERIALS SCIENCE↗
Downhole Sensing and Event-Driven Sensor Fusion for Depth-of-Cut Based Autonomous Fault Response and Drilling Optimization
Achieving robust and efficient drilling is a critical part of reducing the cost of geothermal energy exploration and extraction. Drilling performance is often evaluated using one or more of three key metrics: depth of cut (DOC), rate of penetration (ROP), and mechanical specific energy (MSE). All three of these quantities are related to each other. DOC refers to the depth a bit penetrates into rock during drilling. This is an important quantity for estimating bit behavior. ROP is the simply the DOC multiplied by the rotational rate, and represents how quickly the drill bit is advancing through the ground. ROP is often the parameter used for drilling control and optimization. Finally, MSE provides insight into drilling efficiency and rock type. MSE calculations rely on ROP, drilling force, and drilling torque. Surface-based sensors at the top of the drill are often used to measure all these quantities. However, top-hole measurements can deviate substantially from the behavior at the bit due to lag, vibrations, and friction. Therefore, relying only on top-hole information can lead to suboptimal drilling control. In this work, we describe recent progress towards estimating ROP, DOC, and MSE using down-hole sensing. We assume down-hole measurements of torque, weight-on-bit (WOB). Our hypothesis is that these measurements can provide more rapid and accurate measures of drilling performance. We show how a multi-layer perceptron (MLP) machine learning algorithm can provide rapid and accurate performance when evaluated on experimental data taken from Sandia’s Hard Rock Drilling Facility. In addition, we implement our algorithms on an embedded system intended to emulate a bottom-hole-assembly for sensing and estimation. Our experimental results show that DOC can be estimated accurately and in real-time. These estimates when combined with measurements for rotary speed, torque, and force can provide improved estimates for ROP and MSE. These results have the potential to enable better drilling assessment, improved control, and extended component lifetimes.
15 GEOTHERMAL ENERGY↗
Deliberate Motion Analytics Applied to CUAS Sensor Fusion
The Advanced Reactor Safeguards and Security (ARSS) program in the Department of Energy’s Office of Nuclear Energy (DOE-NE) seeks to identify new technology solutions for safeguards and security challenges associated with domestic deployment of advanced nuclear reactors. Research in the ARSS program is investigating alternative physical protection system (PPS) approaches that leverage new detection technologies. This report shows test results from a new form of artificial intelligence (AI) that is called deliberate motion analytics (DMA) when used to spatially and temporally fuse active radar and passive radio frequency (RF) detection that significantly improves detection of uncrewed aircraft systems (UASs). DMA is designed to filter out false positive alarms yet provide highly reliable intrusion detection at nuclear power plants (NPPs) and advanced small modular reactor (ASMR) perimeters. This form of AI is considered to be an enabling technology for security of the future and supports the ARSS investigation of alternative PPSs.
98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
New frontiers in wind-wildlife monitoring systems
Effective minimization of negative effects of wind energy on wildlife is an iterative process whereby direct observations of wildlife effects inform and validate mitigation strategies. Yet, the full implementation of this adaptive management has been hindered by a lack of appropriate data. The accurate, high-resolution data required exceeds the capacity of most current monitoring approaches (human observers or monitoring technologies applied in isolation). Current applications of monitoring technologies struggle to harness their full potential by failing to capitalize on opportunities for integration with additional technologies and/or by having limited temporal and spatial resolution. At the emergence of this new frontier of wildlife monitoring, we review the elements of a robust wind-wildlife monitoring system and highlight sensor fusion principles that facilitate effective implementation and integration of multiple monitoring technologies. We also illustrate how sensor fusion solutions can generate high resolution data on collision and displacement effects on terrestrial wildlife across complex spatial and temporal scales.
17 WIND ENERGY↗
Neural-Driven Multi-Sensor Data Fusion for Fracturing-Induced Seismicity Diagnostics: Electromagnetic, Distributed Fiber-Optic, and Tiltmeter
Explore the source record for details and available documents.
02 PETROLEUM↗
IPC-Fusion (Infrastructure Perception and Control (IPC): Multisensor Data Fusion Software) [SWR-25-153]
As part of the National Laboratory of the Rockies' (NLR’s) Infrastructure Perception and Control Laboratory, the IPC-Fusion toolkit provides a probabilistic, scalable, multi-sensor fusion framework that integrates (late-stage fusion) heterogeneous object detection data from traffic sensors to enable robust, real-time tracking of roadway occupants. The algorithmic design of the toolkit is motivated by the need for creating a digital twin of traffic at the edge in a scalable and affordable manner. The software operates by combining object-level measurements (such as position and velocity) from a suite of sensors (such as radar, lidar, camera) using Kalman filtering and probabilistic data association techniques to overcome individual sensor limitations and achieve superior tracking performance in complex traffic zones. The framework addresses key challenges including heterogeneous measurement uncertainties, asynchronous data streams, varying spatiotemporal data resolutions, robust data association, and adaptive object lifecycle management. Validated on real-world traffic intersection data including vehicles and pedestrians, IPC-Fusion demonstrates enhanced tracking reliability across scenarios involving occlusions, sensor failures, and varying traffic densities, supporting the broader IPC initiative's goal of transforming transportation infrastructure through advanced perception capabilities for intelligent transportation systems, traffic safety applications, and autonomous vehicle support.
Sandhu, Rimple [National Laboratory of the Rockies↗
Feasibility of fusion plasma burn control via real-time, sub-divertor neutral gas isotopic and compositional analysis
The ability to provide fusion burn control without requiring physical access through the first wall and fuel breeding blankets, would be vital for any future, magnetically confined fusion power reactor. A multi-sensor, fusion fuel cycle exhaust, neutral gas analysis system on JET, capable of delivering real time data, and accessing only the sub-divertor region, provides an excellent example of such capability. Optimized for and operated during the deuterium–tritium experimental campaigns 2 and 3 (DTE2, DTE3), it is proving valuable for planning to explore fusion reactor burn control in ITER with a comparable diagnostic system called the Diagnostic Residual Gas Analyzer (DRGA). This paper aims to show feasibility of developing model-based controllers for ITER and next generation, reactor-relevant devices, by building both on the empirical experience in JET-DTE2, and on the already emerging experience on developing such models specifically for ITER. The paper begins with a specific use-case from JET-DTE2, pertaining to the observed sensitivity of the fusion neutron yield on the concentration of isotopic helium-3 ( 3 He), with data from one of the high-performance DT shots exhibited with emphasis on the 3 He measurement via the sub-divertor. Then, a first model is developed and then explored with simulations that aim to discover how well the controllers in the model react to either insufficient levels of 3 He or excessive levels of 3 He. The simulations then explore potential impact from a delay in the measurement (or the response) that would be comparable to the ∼1 s, conductance limited response for the ITER DRGA system, currently in its final design. The simulations show that control is feasible, and that its effectiveness is not significantly impacted by such delay.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
ClassNMSW- a real-time classification approach for non-recycled municipal solid waste using hyperspectral imaging
Real-time classification of non-recycled municipal solid waste (NMSW) is essential for efficient valorization. This study introduces ClassNMSW, a comprehensive framework for classifying 22 NMSW subclasses under industrial constraints by using hyperspectral imaging (HSI). A primary innovation of this work is the development of a variance-controlled spectral extraction algorithm. Unlike traditional methods that rely on simple averaging, this approach systematically investigates the extent of pixel extraction to minimize the loss of critical chemical information while maximizing data reduction thus ensuring high spectral fidelity with low computational cost. The approach developed in this work integrates automated, computer-vision-based background removal, eliminating the need for the manual thresholding common in current literature. To resolve ambiguities among chemically similar subclasses, a tiered classification and multi-camera fusion strategy (NIR17 and NIR22) is implemented. Results demonstrate that ClassNMSW achieves an object-wise weighted accuracy of 98.70% for single-sensor configurations and 100% under sensor fusion. A novel rolling-window strategy satisfies desired end-to-end latency of <2 s, satisfying the strict deterministic requirements of high-speed industrial sorting environments. The ClassNMSW framework provides a scalable foundation for advancing circularity and resource recovery in large-scale waste valorization operations.
99 - GENERAL AND MISCELLANEOUS↗
Digital Twin Enabling Technologies for Online Condition Monitoring of Nuclear Power Plant Components
Online condition monitoring is an area of active research that may enable improved scheduling, maintenance, and safety of nuclear power plant components, reducing unnecessary derate while simultaneously improving operational capacity. Digital twins are one avenue to conduct online condition monitoring and are currently being explored by national laboratories and universities alike. Digital twins for online condition monitoring are, in essence, state concurrent models that emulate a physical process which predicts a parameter and compares it against a measured value. However, digital twins may also provide additional insights by combining and interpreting various sources of information. These insights may be used for preventative maintenance scheduling optimization or early fault detection and are projected to be valuable for meeting requirements under 10 CFR 50.55a. However, digital twin technologies are still under significant development; quantifying model uncertainties, improving unique fault identification, and multimodal sensor fusion are some areas under investigation. Therefore, in this work, we discuss and review the various enabling technologies, in the form of advanced sensors, instrumentation, and modelling methods, that may be used to implement and enhance digital twins for online condition monitoring. A potential use case for pump-motors is presented to demonstrate how these various pieces of enabling digital twin technologies may integrated together for online condition monitoring. Challenges and opportunities associated with the pump-motor digital twin enabling technologies are also identified and discussed.
22 GENERAL STUDIES OF NUCLEAR REACTORS↗
Digital-Twin-Enabling Technologies for Online Condition Monitoring of Nuclear Power Plant Components
Online condition monitoring is an area of active research that may enable improved scheduling, maintenance, and safety of nuclear power plant components, reducing unnecessary derates while simultaneously improving operational capacity. Digital twins are one avenue to conduct online condition monitoring and are currently being explored by national laboratories and universities alike. Digital twins for online condition monitoring are, in essence, state concurrent models that emulate a physical process which predicts a parameter and compares it against a measured value. However, digital twins may also provide additional insights by combining and interpreting various sources of information. These insights may be used for preventative maintenance scheduling optimization or early fault detection and are projected to be valuable for meeting requirements under 10 CFR 50.55a. However, digital twin technologies are still under significant development; quantifying model uncertainties, improving unique fault identification, and multimodal sensor fusion are some areas under investigation. Therefore, in this work, we discuss and review the various enabling technologies, in the form of advanced sensors, instrumentation, and modelling methods, that may be used to implement and enhance digital twins for online condition monitoring. A potential use case for pump-motors is presented to demonstrate how these various pieces of enabling digital twin technologies may integrated together for online condition monitoring. Challenges and opportunities associated with the pump-motor digital twin enabling technologies are also identified and discussed.
22 - GENERAL STUDIES OF NUCLEAR REACTORS↗