Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Climate Nowcasting

The climate is changing so rapidly that climatologies based on historical statistics cannot reliably capture the current risk of extreme weather events hazardous to society. Decision relevant projections of weather extreme probability over the next 10–15 years are needed to enable adaptation and resilience in the face of this evolving risk. Current weather forecasts/predictions and long-term climate projections for decades into the future are inadequate for providing this information to stakeholders that need it, targeting forecast horizons either too short or too far into the future. We argue that a new approach is needed: climate nowcasting. Climate nowcasting would focus on user-inspired extreme metrics over the next 10–15 year time frame, targeting specific impacts and locations down to a local scale, by engaging with stakeholders to understand their needs and provide information in a format relevant for decision making. Importantly, climate nowcasting will not consist of a single approach or data set, involving rather data fusion from different sources of information: simulations, observations and data driven methods, likely through different weights depending on the metric of interest. Predictions must be accompanied by serious engagement with stakeholders facing climate risks, and clearly present uncertainties and limitations of any prediction. Such a vision is very different from how typical climate or weather forecasts are applied today.

Gettelman, Andrew↗

Materials data science using CRADLE: A distributed, data-centric approach

Abstract There is a paradigm shift towards data-centric AI, where model efficacy relies on quality, unified data. The common research analytics and data lifecycle environment (CRADLE™) is an infrastructure and framework that supports a data-centric paradigm and materials data science at scale through heterogeneous data management, elastic scaling, and accessible interfaces. We demonstrate CRADLE’s capabilities through five materials science studies: phase identification in X-ray diffraction, defect segmentation in X-ray computed tomography, polymer crystallization analysis in atomic force microscopy, feature extraction from additive manufacturing, and geospatial data fusion. CRADLE catalyzes scalable, reproducible insights to transform how data is captured, stored, and analyzed. Graphical abstract

97 MATHEMATICS AND COMPUTING↗

Introducing SpaceNet 9 - Cross-Modal Satellite Imagery Registration for Natural Disaster Responses

Computer vision algorithms are increasingly leveraged to accelerate geospatial analysis for disaster response and recovery. As the diversity of remote sensing imagery grows with optical, SAR, and other modalities, a perquisite for analytics is cross-modal image registration. There is a high potential to harness computer vision for this pre-processing requirement toward enabling downstream analytics such as heterogeneous change detection, automated feature extraction, and data fusion. Advancement in these areas has the potential to simplify data wrangling tasks and further accelerate disaster response timelines. The SpaceNet 9 challenge (launching in mid-2024) focuses on addressing the cross-modal image registration problem and demonstrating the utility of such modules on earthquake impacted scenarios. This paper describes the motivation for the SpaceNet 9 and provides a first overview of the dataset, the baseline algorithm, and implications for seeking cross-modal image registration in Earth observation. Code is available at https://github.com/SpaceNetChallenge/SpaceNet9.

Hansch, Ronny↗

A Discrete Hankel Transform Approach to Nuclear Data Processing for Fusion Applications

This study introduces advancements to the numerical solutions employed in the processing of nuclear data for fusion applications. It leverages the convolution theorem and Fourier transform techniques to enhance computational efficiency and broaden applicability. Building upon a previously reported discrete Hankel transform approach for Doppler broadening, this work refines the solution of convolution integrals central to these applications. The methodology provides a general and unified framework for evaluating any convolution operation, regardless of whether the underlying problem involves temperature effects in nuclear reactions. The applicability to the nuclear data processing for fusion is demonstrated by deriving the convolution integrals for some of the fusion-related quantities. As before, the convolution operation utilizes a Gaussian-based kernel; however, the discrete Hankel transform of order $𝛼$ = $\frac{1}{2}$ is now applied to the forward Fourier transform of the nonkernel argument, rather than the inverse Fourier transform. This modification eliminates the need for the integration of the nonkernel, cross section–based function, which is a step that posed challenges for certain pointwise cross-section representations. It also removes the requirement for cross-section linearization. Optimized for graphics processing unit architectures, the approach significantly improves computational performance. These advancements are currently under evaluation as the foundation for the next-generation thermonuclear data file processing codes being developed at Lawrence Livermore National Laboratory.

Nuclear science and engineering↗

Descriptor: Infrastructure Perception and Control: Multi-Sensor Object Tracking Dataset (IPC-MSOT)

Traffic intersections are crucial and challenging nodes in transportation networks where multiple lanes of vehicles and pedestrians converge. Traffic accidents often occur at traffic intersections, including a large proportion of traffic fatalities and about one-half of all traffic injuries in the United States. Object detection data were collected in 2024 across three intersections in Colorado Springs, CO, USA, over the course of multiple days and various times to induce a heterogeneous mix of traffic conditions and behaviors. The purpose of the data collection exercises was to learn various attributes about infrastructure sensors and to build a repository of high-resolution, object-level data that can be used for research and development (e.g., to develop multisensor data fusion algorithms). The Infrastructure Perception and Control:Multi-Sensor Object tracking (IPC-MSOT) dataset was collected as part of the U.S. Department of Transportation's Strengthening Mobility and Revolutionizing Transportation (SMART) project, where the city of Colorado Springs, Colorado, and the National Renewable Energy Laboratory collaborated to collect object-level trajectory data from road users using multiple types of infrastructure sensors deployed at different intersections. This dataset allows for testing of late-stage sensor fusion algorithms and their ability to ingest multimodal sensor data, and it can be utilized by traffic engineers to design and evaluate trajectory-based signal control strategies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Toward Intelligent Multimodal Holography for Real-Time Chemical Imaging of Dynamic Ion Separation

Molecular-level visualization of ion transport and separation dynamics in complex environments is crucial for advancing energy systems, water purification, and critical materials recovery. Achieving this requires imaging platforms that combine structural sensitivity, chemical specificity, and real-time operation. Digital off-axis holography (DOAH) provides high-throughput, label-free quantitative phase imaging but inherently lacks chemical selectivity. Integrating DOAH with complementary spectroscopic channels such as fluorescence or hyperspectral imaging introduces the needed molecular specificity, while also creating challenges in multimodal data fusion, synchronization, and computational throughput. Artificial intelligence offers a powerful route to address these limitations by uniting physics-based reconstruction with data-driven interpretation. In this Perspective, we outline a framework for intelligent multimodal holography and demonstrate its potential using a preliminary AI-driven test case. Raw DOAH holograms of lanthanide solutions subjected to magnetic field gradients were analyzed using multi-agent AI workflows that autonomously selected reconstruction tools, extracted NMF components, and generated scientific claims consistent with true paramagnetic and diamagnetic behavior. This demonstration shows how AI-enabled reasoning can deliver real-time chemical–structural interpretation directly from raw holograms. Together, these advances define a path toward adaptive, intelligent holography platforms capable of supporting in situ chemical separations, dynamic ion transport analysis, and next-generation interfacial science.

Ricchiuti, Giovanna↗

Multi-Scale Integrated Monitoring System for Enhancing Methane Emission Detection, Quantification & Prediction

This report details the progress and findings of a comprehensive study on reviewing existing solutions, identifying technology gaps, and formulating an “all-in-one” integrated strategy for developing the next-generation multiscale methane monitoring and modeling platform, conducted under grant number DE-FE0032292. Co-led by Dr. David Ebert, Dr. Binbin Weng, and Dr. Chenghao Wang at the University of Oklahoma, the project’s goal was to develop an integrated approach for building this engineering platform to detect, quantify, and mitigate methane emissions across various temporal scale, spatial scales, and sectors. The planning grant study began with an extensive review of various methane sensing and monitoring technologies and systems, surveying over 100 technology providers globally. This review revealed the prevalence of optical methods over chemical methods in commercially available sensors, with Non-Dispersive Infrared (NDIR), Tunable Diode Laser Absorption Spectroscopy (TDLAS), and Optical Gas Imaging (OGI) cameras being the most prevalent options. A trend towards more advanced optical techniques was observed, driven by increased regulatory focus and technological advancements. The technical evaluation of these sensing technologies provided crucial insights into their capabilities and limitations. The study examined emerging technologies such as Differential Absorption LiDAR (DIAL), which show promise for high-precision and long-range detection. The team then investigated the features and application bandwidth of various sensing platforms, including handheld, fixed/stationary, mobile, aerials, and spaceborne monitors. Pilot field studies were conducted to assess the capabilities of solutions for different emission scenarios. Field work with sensor deployments was conducted at three distinct site types: an oil & gas industry site, a cattle ranching operation, and a waste processing facility. The team also conducted a thorough review of methane flux inverse modeling approaches, focused on physically based methods. These approaches were categorized into simple, intermediate, and advanced methods. A realtime WRF-GHG (Weather Research and Forecasting-Greenhouse Gas) modeling system was developed and applied, incorporating multiple data sources to guide field experiments and inform methane plume detection. The project identified and analyzed numerous categories of methane data sources, including satellite measurements, ground-based sensors, and inventory databases. Key platforms examined include EDGAR, EPA GHGI, NASA TROPOMI, Carbon Mapper, and Climate TRACE, among others. The team proposed an architecture for a comprehensive methane monitoring platform. This system incorporates multi-source data acquisition, advanced data processing and assimilation, interactive visualization tools, and analytical capabilities for emissions forecasting and scenario analysis. The proposed platform aims to provide a user-friendly interface catering to various stakeholders, from researchers to policymakers. The architecture includes sophisticated data ingestion methods, a centralized data warehouse, and advanced analytical tools for data fusion and interpretation. To ensure the relevance and effectiveness of the proposed system, a comprehensive survey was conducted to gather stakeholder input on system requirements. Key findings include a strong need for integrating various data types and formats, a preference for real-time data updates and advanced visualization tools, and a demand for user-friendly interfaces catering to different expertise levels.

03 NATURAL GAS↗

Multimodal sensor fusion for real-time standoff estimation in directed energy deposition

In Laser Powder-based Direct Energy Deposition (LP-DED) systems, achieving consistency, precision and quality of produced parts requires tight control over printing parameters. One of the critical parameters is the standoff distance. Maintaining an optimal standoff height is crucial for achieving correct laser power density and powder catchment efficiency, as both laser and powder streams are focused at this distance. Here, this study introduces a novel approach using multimodal sensor fusion to predict standoff height in real-time. The proposed system integrates two low-profile, cost-effective sensors: an RGB coaxial camera and a high frequency and high dynamic range microphone. By utilizing a simple fully connected neural network, trained on a limited dataset, data fusion of these sensors allowed for the real-time prediction of the standoff height. The results demonstrate high resolution and accuracy of the predictions across multiple geometries and a wide range of standoff heights. This approach offers a simple, and cost-effective solution for real-time standoff height monitoring and lays the groundwork for future integration into commercial LP-DED systems.

42 ENGINEERING↗

Infrastructure-Based Cooperative Perception at a Traffic Intersection: Overview and Challenges: Preprint

Recent advancement in autonomous driving vehicles and V2X communication has attracted increasing attention towards Intelligent Transportation Systems to build a safe and reliable traffic intersection. However, most of the systems are still at the initial stages and require significant progress to become a reality. This paper presents an overview of NREL Infrastructure Perception and Control (IPC) framework which is an open-source track-data fusion engine which takes input from infrastructure-based perception sensors and cooperatively shared messages from Connected Autonomous Vehicles (CAVs) and Connected Vehicle (CVs) and the challenges associated with deploying such cooperative perception framework at a four-way traffic intersection in the city of Colorado Springs, CO, USA. The sensor data is collected by deploying two radars and two LiDAR sensors on the IPC mobile lab and two radars on diagonally opposite traffic poles at the proposed intersection. The sensor output results imply the need for rapid sensor calibration to bring the collective perception to a common coordinate frame, the importance of time synchronization between the sensors in order to capture accurate spatial and temporal alignment of the objects, and the need for a health monitoring system with fail safe closed-loop detection model for real-time deployment.

camera↗

Earth System Reanalysis in Support of Climate Model Improvements

Recent climate model developments, established through increased model resolution, have led to substantial improvements in model simulations of the time-evolving, coupled Earth system and its subcomponents. However, regardless of resolution, climate models will always produce climate features and variability that differ from the real world and will be prone to biases. This is due to many remaining uncertainties, such as in parametric and structural model uncertainty, in the initial conditions prescribed, and in the prescribed (scenario) forcing which varies on decadal to centennial timescales. Further model improvements are expected to arise specifically from improved representation of physical processes realized through model-data fusion. This will create an unprecedented opportunity to better exploit a large array of Earth observations, from in situ measurements to weather radars and satellite observations, as the resolved scales of the models approach those of the observations. For this, climate DA will be the central tool to bring models and observations into consistency, by improving initial conditions, inferring uncertain model parameters and structure, and quantifying uncertainty. Generally, there will be advantages and complementarities of adjoint-based smoother approaches, ensemble-based filter approaches, or new ML-inspired approaches. Yet, the ever-increasing model resolution will present growing challenges arising from computational cost, calling for new ways of performing data assimilation and model optimization. Using the complementarity in a hybrid approach, blending tools and concepts from variational, ensemble and ML methods might be what is required in the future. In this context ML could be important to handle non-linear responses, and to better approximate non-Gaussian distributions.

54 ENVIRONMENTAL SCIENCES↗

Sub-millisecond keyhole pore detection in laser powder bed fusion using sound and light sensors and machine learning

Laser powder bed fusion is a mainstream additive manufacturing technology widely used to manufacture complex parts in prominent sectors, including aerospace, biomedical, and automotive industries. However, during the printing process, the presence of an unstable vapor depression can lead to a type of defect called keyhole porosity, which is detrimental to the part quality. In this study, we developed an effective approach to locally detect the generation of keyhole pores during the printing process by leveraging machine learning and a suite of optical and acoustic sensors. Simultaneous synchrotron x-ray imaging allows the direct visualization of pore generation events inside the sample, offering high-fidelity ground truth. A neural network model adopting SqueezeNet architecture using single-sensor data was developed to evaluate the fidelity of each sensor for capturing keyhole pore generation events. Our comparative study shows that the near infrared images gave the highest prediction accuracy, followed by 100 kHz and 20 kHz microphones, and the photodiode sensitive to processing laser wavelength had the lowest accuracy. Using a single sensor, over 90% prediction accuracy can be achieved with a temporal resolution as short as 0.1 ms. A data fusion scheme was also developed with features extracted using SqueezeNet neural network architecture and classification using different machine learning algorithms. Our work demonstrates the correlation between the characteristic optical and acoustic emissions and the keyhole oscillation behavior, and thereby provides strong physics support for the machine learning approach.

36 MATERIALS SCIENCE↗

AI‐Driven Robot Enables Synthesis‐Property Relation Prediction for Metal Halide Perovskites in Humid Atmosphere

Materials Acceleration Platforms (MAPs) – also known as self-driving laboratories– present a new paradigm for materials science and promise an order of magnitude accelerated materials discovery compared to the traditional trial-and-error approach. Metal halide perovskites (MHPs) are an emerging class of materials for optoelectronic applications but are plagued by irreproducible optoelectronic quality, particularly for films fabricated in a humid atmosphere. Here, in this work, a machine learning (ML)-guided closed-loop platform is developed with a multimodal data fusion approach to predict synthesis–property relations for the optical quality of MHP thin films in relative humidities (RHs) ranging from 5–55%. The efficiency of this approach is confirmed by the fast-dropping learning rate to 2% after experimentally sampling less than 1% of the possible 5,000+ combinations. The prediction of synthesis–property relations is done by optical and imaging characterizations. In situ photoluminescence characterization revealed the origin of thin film quality variation at different RH. These insights provide an avenue for controlling the MHP crystallization by fine-tuning the synthesis parameters and RH for a given chemistry, thus lifting the need for stringent atmosphere control. The MAP enables an accelerated screening and understanding of the synthesis design space, facilitating rational synthesis recipe choice for a wide range of materials.

AI-driven robot↗

Robotics for HVAC applications: A critical review and future perspectives

Recent advances in artificial intelligence (AI), enhanced computational capabilities, and innovations in sensors and hardware have driven the increasing development and application of robots in heating, ventilation, and air conditioning (HVAC) systems. We selected and reviewed 101 studies published between 2005 and 2025, sourced from IEEE Xplore, Scopus, Web of Science, and the ACM Digital Library. To analyze these works, we developed a five-dimensional analytical framework (morphology, sensing, navigation, task execution, and system integration), inspired by the Springer Handbook of Robotics and tailored specifically for robotic applications in HVAC. Based on the reviewed studies, six distinct tasks spanning the entire HVAC lifecycle have been identified. Among the six tasks, inspection and maintenance dominate (59 %), followed by indoor monitoring and auditing (21 %), whereas leakage detection, comfort support, and installation/retrofit remain less explored. To address the identified gaps, this review proposes future research directions including investigating robot-aware HVAC design principles, developing multimodal HVAC sensing and data fusion techniques, enhancing robot training and hardware capabilities, and expanding robotic applications beyond Maintenance and Operations (M&O). The findings from this review inform future robotics research for HVAC applications and ultimately enhance system affordability, energy efficiency, resilience or reliability, and occupant environmental comfort. Moreover, it seeks to inspire researchers to explore the intersections of robotics, computer science, building science, and HVAC engineering fostering advancements in this multidisciplinary field.

AI↗

A U.S. scientific community review of carbon cycle science gaps and opportunities to better support earth system science and carbon management

Greenhouse gas (GHG) emissions continue to grow, while natural carbon reservoirs are becoming increasingly vulnerable to anthropogenic pressures, climate extremes, and disturbance. These changes are impacting humans, ecosystems, and natural resources worldwide. Tracking and mitigating GHG emissions require a pivot to operational monitoring of regional carbon flux and stock changes. The current GHG observing system is addressing needs at two distinct scales: 1) Local scale (< 1 km), related to anthropogenic point source emissions, and 2) global scales (> 1000 km), related to land and ocean carbon sinks. More focus on intermediate (10–1000 km) scales is needed to more effectively monitor progress in reducing carbon emissions, enhancing removals, and maintaining sinks. Representatives from carbon cycle biomass and flux communities across United States government agencies and academic institutions met in September 2024 to discuss the rationale and scientific context for more effectively implementing an operational system for GHG monitoring in support of urban and national carbon management needs. To guide development of this system, we propose a multi-tiered global spaceborne observing framework for carbon flux and stock, prioritizing: 1) frequent GHG partial columns for carbon emissions and removals; 2) continuous time series and data fusion of biomass from Lidar and Synthetic Aperture Radar (SAR) for carbon stocks, and 3) expanded coverage of tropical, high latitude, and oceanic regions to monitor carbon cycle tipping points and feedbacks. This system should be complemented by expanded surface and airborne networks for oceanic and terrestrial/aquatic ecosystems for calibration, ground truthing, and study of under-sampled regions.

54 ENVIRONMENTAL SCIENCES↗

Common Column Identification for Table Similarity Detection in Electrified Transportation Data Lakes

Electrified transportation often requires researchers and operators to interact with datasets from a wide range of sources and disciplines, such as transportation, power systems, public health, policies, and regulations. These datasets vary in quality and format, making it difficult to understand, preprocess, and identify key columns representing real-world entities or values for indexing and joining, which can negatively impact downstream analysis and operation. Existing solutions are limited, requiring extensive manual customization or data expertise to utilize. In this article, we propose a multi-layered approach to automatically identify key columns to expedite preprocessing and aid in analysis of electrified transportation data. Our method leverages a dynamic ontology to identify common fields and an information theory-based strategy for edge cases that are difficult to generalize. Evaluations on a number of datasets from data.gov and kaggle.com show improved performance of our methods over several baseline techniques, and our ablation analyses illustrate the efficacy of individual components of our method. Our case studies also demonstrate that our methods have the potential to improve analysis of electrified transportation data and aid in automatic integration of such datasets.

33 ADVANCED PROPULSION SYSTEMS↗

Radiation image reconstruction and uncertainty quantification using a Gaussian process prior

We propose a complete framework for Bayesian image reconstruction and uncertainty quantification based on a Gaussian process prior (GPP) to overcome limitations of maximum likelihood expectation maximization (ML-EM) image reconstruction algorithm. The prior distribution is constructed with a zero-mean Gaussian process (GP) with a choice of a covariance function, and a link function is used to map the Gaussian process to an image. Unlike many other maximum a posteriori approaches, our method offers highly interpretable hyperparamters that are selected automatically with the empirical Bayes method. Furthermore, the GP covariance function can be modified to incorporate a priori structural priors, enabling multi-modality imaging or contextual data fusion. Lastly, we illustrate that our approach lends itself to Bayesian uncertainty quantification techniques, such as the preconditioned Crank–Nicolson method and the Laplace approximation. The proposed framework is general and can be employed in most radiation image reconstruction problems, and we demonstrate it with simulated free-moving single detector radiation source imaging scenarios. We compare the reconstruction results from GPP and ML-EM, and show that the proposed method can significantly improve the image quality over ML-EM, all the while providing greater understanding of the source distribution via the uncertainty quantification capability. Furthermore, significant improvement of the image quality by incorporating a structural prior is illustrated.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Analysing a multi‐stage cyber threat and its impact on the power system

Abstract Electric power systems are composed of physical and cyber sub‐systems. The sub‐systems depend on each other. If the cyber sub‐system is compromised by a cyber threat, what is the impact on the physical system? This paper presents a case study that shows the steps of a multi‐stage cyber threat involving a database injection attack, and what happens to the power system if this threat is not detected in its early stages. The threat first affects one utility but it can spread to the balancing authority, which is responsible for keeping the voltage and frequency stable in the power grid. During the cyber threat, the authors also show defence tools, such as a cyber‐physical data fusion tool that displays and analyses power and cyber telemetry.

Al Homoud, Leen [Texas A&amp,M University College ↗

Curation and Dissemination of Complex Multi-Modal Datasets for Radiation Detection, Localization, and Tracking

The PANDAWN sensor network in Chicago, IL, is a state-of-the-art testbed for networked, multi-modal sensing. It integrates AI/data science methods into its operation, from data acquisition to automated data labeling and curation workflows. The curation and dissemination of diverse multi-modal datasets will enable the development of new radiological/nuclear (R/N) detection, localization, and tracking algorithms and methods relevant across the nonproliferation mission space. This article first introduces the PANDAWN sensor network and the features that make it stand out from previous multi-modal data acquisition efforts. We then review the various data streams acquired on the PANDAWN nodes and present the implementation of an automated data curation pipeline that includes the labeling of radiation and contextual data streams. Here, we finally provide a short overview of different studies that leveraged the curated datasets.

Data curation↗