Search NASA⌕ Search

SEARCH · Search NASA

Results for “data fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Study of Applications of Radiological Data Fusion for Nuclear Security and Non-proliferation Applications

This report describes the radiological Scene Data Fusion (SDF) technology and the potential to apply the SDF technology to a variety of problems related to nuclear non-proliferation, radiological security, and other missions related to the national nuclear security agency and the US government, more broadly. The application space was conceived by both the authors of this report and the many scientists and stakeholders they interviewed. In order to successfully apply the SDF technology to the various applications, further research and development is often necessary and those R&D steps are also outlined herein.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Spatial Statistical Data Fusion (SSDF)

As remote sensing for scientific purposes has transitioned from an experimental technology to an operational one, the selection of instruments has become more coordinated, so that the scientific community can exploit complementary measurements. However, tech nological and scientific heterogeneity across devices means that the statistical characteristics of the data they collect are different. The challenge addressed here is how to combine heterogeneous remote sensing data sets in a way that yields optimal statistical estimates of the underlying geophysical field, and provides rigorous uncertainty measures for those estimates. Different remote sensing data sets may have different spatial resolutions, different measurement error biases and variances, and other disparate characteristics. A state-of-the-art spatial statistical model was used to relate the true, but not directly observed, geophysical field to noisy, spatial aggregates observed by remote sensing instruments. The spatial covariances of the true field and the covariances of the true field with the observations were modeled. The observations are spatial averages of the true field values, over pixels, with different measurement noise superimposed. A kriging framework is used to infer optimal (minimum mean squared error and unbiased) estimates of the true field at point locations from pixel-level, noisy observations. A key feature of the spatial statistical model is the spatial mixed effects model that underlies it. The approach models the spatial covariance function of the underlying field using linear combinations of basis functions of fixed size. Approaches based on kriging require the inversion of very large spatial covariance matrices, and this is usually done by making simplifying assumptions about spatial covariance structure that simply do not hold for geophysical variables. In contrast, this method does not require these assumptions, and is also computationally much faster. This method is fundamentally different than other approaches to data fusion for remote sensing data because it is inferential rather than merely descriptive. All approaches combine data in a way that minimizes some specified loss function. Most of these are more or less ad hoc criteria based on what looks good to the eye, or some criteria that relate only to the data at hand.

Braverman, Amy J.↗

A Novel Framework for Multi-Path Data Fusion in Earth Observation and New Observing Strategies: Applications to Predicting Forest Canopy Height

Exponential growth of data from Earth Observation (EO) assets has necessitated the development of sophisticated methods for data interpretation and management. NASA’s New Observing Strategy (NOS) approach aims to coordinate operations among complex heterogenous systems of constellations, requiring advanced Artificial Intelligence and Machine Learning (AI/ML) techniques. Despite significant advancements in AI/ML across various domains, the EO and machine learning for satellite (SatML) fields remain fragmented, often relying on adapted techniques rather than domain-specific solutions. We present a novel end-to-end data fusion framework tailored specifically for EO and SatML, addressing this gap by facilitating rapid development of AI/ML applications. This framework, called, Multimodal Earth Observation Workflow for Machine Learning (MEOW-ML), sup- ports the entire AI/ML lifecycle, from dataset manipulation, to model training, evaluation, and logging, and is designed to expedite the development of next-generation NOS deployments and SOTA in EO. We apply our framework to predict canopy height model (CHM) derived from lidar data. We integrate multiple data modalities through a hierarchical, multi-path model architecture, effectively identifying and leveraging the unique strengths of each data source to enhance predictive accuracy. Our experiments demonstrate that the multi-path architecture outperforms traditional single-path models and provides significant advantages in both accuracy and computational efficiency.

Mark Moussa↗

Data Fusion via Neural Network Entropy Minimization for Target Detection and Multi-Sensor Event Classification

Broadly applicable solutions to multimodal and multisensory fusion problems across domains remain a challenge because effective solutions often require substantive domain knowledge and engineering. The chief questions that arise for data fusion are in when to share information from different data sources, and how to accomplish the integration of information. The solutions explored in this work remain agnostic to input representation and terminal decision fusion approaches by sharing information through the learning objective as a compound objective function. The objective function this work uses assumes a one-to-one learning paradigm within a one-to-many domain which allows the assumption that consistency can be enforced across the one-to-many dimension. The domains and tasks we explore in this work include multi-sensor fusion for seismic event location and multimodal hyperspectral target discrimination. We find that our domain- informed consistency objectives are challenging to implement in stable and successful learning because of intersections between inherent data complexity and practical parameter optimization. While multimodal hyperspectral target discrimination was not enhanced across a range of different experiments by the fusion strategies put forward in this work, seismic event location benefited substantially, but only for label-limited scenarios.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Aerodynamic Data Fusion Toward the Digital Twin Paradigm

This paper considers the fusion of two aerodynamic data sets originating from differing types of physical or computer experiments. This paper specifically addresses the fusion of 1) noisy and in-complete fields from wind-tunnel measurements and 2) deterministic but biased fields from numerical simulations. These two data sources are fused in order to estimate the true field that best matches measured quantities that serve as the ground truth. For example, two sources of pressure fields about an aircraft are fused based on measured forces and moments from a wind-tunnel experiment. A fundamental challenge in this problem is that the true field is unknown and cannot be estimated with 100% certainty. A Bayesian framework is employed to infer the true fields conditioned on measured quantities of interest; essentially a statistical correction to the data is performed. The fused data may then be used to construct more accurate surrogate models suitable for early stages of aerospace design. An extension of the proper orthogonal decomposition with constraints is also introduced to solve the same problem. In this work, both methods are demonstrated on fusing the pressure distributions for flow past the RAE2822 airfoil and the Common Research Model wing at transonic conditions. Comparison of both methods reveals that the Bayesian method is more robust when data are scarce and capable of also accounting for uncertainties in the data. Furthermore, given adequate data, the proper-orthogonal-decomposition-based and Bayesian approaches lead to surprisingly similar results.

42 ENGINEERING↗

Data Fusion to Enhance Quality Control and Analysis with Instruments at the Marine and Coastal Research Laboratory

Deploying environmental monitoring instruments in the marine environment can be challenging, facing challenges around device survivability, biofouling and corrosion, and consistent data collection. This project explores the use of data fusion – the process of integrating multiple data sources to produce more consistent, accurate, and useful information – to build a consistent long-term monitoring system at the Marine and Coastal Research Laboratory (MCRL) in Sequim, Washington. Unused instruments that had been acquired from past projects were inventoried and deployments planned on the MCRL pier and floating dock. A total of 8 instruments were deployed including a tide gauge, hydrophone, acoustic Doppler current profiler (ADCP), photosynthetically active radiation (PAR) sensors, meteorological station, and three water quality sensors. Deployments were planned to be well-protected around the pier structure and a maintenance schedule was created for cleaning and recalibration. An automated data pipeline was created to aggregate data on edge computers that push data to Amazon Web Services (AWS) cloud storage every 15 minutes, performing automated quality control and data transformations using the Time Series Data Analytical Toolkit (TSDAT). Continued efforts are underway to maintain this system into the future, take a data-driven approach to maintenance scheduling, improve the reliability of the system, and share the data with a variety of end-users.

54 ENVIRONMENTAL SCIENCES↗

A Data-Fusion Method using Bayesian Approach to Enhance Raw Data Accuracy of Position and Distance Measurements for Connected Vehicles

Accurate positioning of vehicles is a critical element of autonomous and connected vehicle systems. Most of other studies heavily focused on enhancing simultaneous localization and mapping (SLAM) methods, i.e., constructing or updating a map of an unknown environment and tracking an object within the map. This paper provides a method that can, in addition to existing SLAM or relevant methods, enhance the raw measurements of position and distance. The basic idea of this study is to identify and update the error distribution of each data source by combining all available information. A Bayesian approach was incorporated to estimate and update the error distribution of individual data sources or sensors. The proposed method can be conducted in real-time environments, and a self-learning scheme determines whether enough data has been collected to further improve the accuracy of such measurements. The simulated experiments show that the proposed model noticeably improves the accuracy of position and distance measurements. Especially, the estimated biases of position coordinates and distance measures are very close to the biases of true error distributions, with the R-squared over 0.98. A similar approach can also be utilized to enhance accuracy of other sensors or measurements in connected vehicle or relevant systems, where multi-data sources are available.

Lim, Hyeonsup↗

Resolving temperature limitation on spring productivity in an evergreen conifer forest using a model–data fusion framework

Abstract. The flow of carbon through terrestrial ecosystems and the response to climate are critical but highly uncertain processes in the global carbon cycle. However, with a rapidly expanding array of in situ and satellite data, there is an opportunity to improve our mechanistic understanding of the carbon (C) cycle's response to land use and climate change. Uncertainty in temperature limitation on productivity poses a significant challenge to predicting the response of ecosystem carbon fluxes to a changing climate. Here we diagnose and quantitatively resolve environmental limitations on the growing-season onset of gross primary production (GPP) using nearly 2 decades of meteorological and C flux data (2000–2018) at a subalpine evergreen forest in Colorado, USA. We implement the CARbon DAta-MOdel fraMework (CARDAMOM) model–data fusion network to resolve the temperature sensitivity of spring GPP. To capture a GPP temperature limitation – a critical component of the integrated sensitivity of GPP to temperature – we introduced a cold-temperature scaling function in CARDAMOM to regulate photosynthetic productivity. We found that GPP was gradually inhibited at temperatures below 6.0 ∘C (±2.6 ∘C) and completely inhibited below −7.1 ∘C (±1.1 ∘C). The addition of this scaling factor improved the model's ability to replicate spring GPP at interannual and decadal timescales (r=0.88), relative to the nominal CARDAMOM configuration (r=0.47), and improved spring GPP model predictability outside of the data assimilation training period (r=0.88). While cold-temperature limitation has an important influence on spring GPP, it does not have a significant impact on integrated growing-season GPP, revealing that other environmental controls, such as precipitation, play a more important role in annual productivity. This study highlights growing-season onset temperature as a key limiting factor for spring growth in winter-dormant evergreen forests, which is critical in understanding future responses to climate change.

54 ENVIRONMENTAL SCIENCES↗

Assessing the Use of SAR/Optical Data Fusion and TensorFlow for Improved Mangrove Mapping

Mangrove forests are found in intertidal zones of tropical regions around the world and provide important ecological and economic benefits – they are considered carbon sequesters, habitats for flora and fauna, and natural barriers to hurricanes and tsunamis. Wood from mangrove forests are used as fuel and building materials in surrounding coastal communities, therefore promoting local livelihoods. Despite the importance of these ecosystems, mangrove forests have historically been degraded in natural processes such as severe weather, and anthropogenic factors like conversion to agriculture and aquaculture. This study assesses change in mangrove forests in Nigeria and Mozambique from 2015 to 2018 using SAR and optical data fusion. Due to frequent cloud cover over the study area, SAR and optical data is fused to obtain gap-free imagery without clouds. Landsat-8 OLI and Sentinel-1 imagery is fused with TensorFlow, an open source platform used in developing machine learning models. The resulting images are classified to discriminate mangrove forest cover from other land cover types, and change is estimated using image differencing. Understanding the rates and magnitude of mangrove change across space and time can aid in identifying priority areas for forest regeneration, and can help construct sustainable management practices for the future.

Strattman, Katherine↗

Mapping Yearly Fine Resolution Global Surface Ozone through the Bayesian Maximum Entropy Data Fusion of Observations and Model Output for 1990–2017

Estimates of ground-level ozone concentrations are necessary to determine the human health burden of ozone. To support the Global Burden of Disease Study, we produce yearly fine resolution global surface ozone estimates from 1990 to 2017 through a data fusion of observations and models. As ozone observations are sparse in many populated regions, we use a novel combination of the M3Fusion and Bayesian Maximum Entropy (BME) methods. With M3Fusion, we create a multi-model composite by bias-correcting and weighting nine global atmospheric chemistry models based on their ability to predict observations (8,834 sites globally)in each region and year. BME is then used to integrate observations, such that estimates match observations at each monitoring site with the observational influence decreasing smoothly across space and time until the output matches the multi-model composite. After estimating at 0.5° resolution using BME, we add fine spatial detail from an additional model, yielding estimates at 0.1° resolution. Observed ozone is predicted more accurately (R2=0.81 at test point, 0.63 at 0.1°,0.62 at 0.5°) than the multi-model mean (R2=0.28 at 0.5°). Global ozone exposure is estimated to be increasing, driven by highly populated regions of Asia and Africa, despite decreases in the United States and Russia.

environmental modeling↗

O'Hare Airport roadway traffic prediction via data fusion and Gaussian process regression

This study proposes an approach of leveraging information gathered from multiple traffic data sources at different resolutions to obtain approximate inference on the traffic distribution of Chicago's O'Hare Airport area. Specifically, it proposes the ingestion of traffic datasets at different resolutions to build spatiotemporal models for predicting the distribution of traffic volume on the road network. Due to its good adaptability and flexibility for spatiotemporal data, the Gaussian process (GP) regression was employed to provide short-term forecasts using data collected by loop detectors (sensors) and supplemented by telematics data. The GP regression is used to make predictions of the distribution of the proportion of sensor data traffic volume represented by the telematics data for each location of the sensors. Consequently, the fitted GP model can be used to determine the approximate traffic distribution for a testing location outside of the training points. Policymakers in the transportation sector can find the results of this work helpful for making informed decisions relating to current and future transportation conditions in the area.

42 ENGINEERING↗

NASA Satellites and Data Fusion: A Case Study with Coral Reefs

As the world is experiencing a significant rise in both AI, Climate, and Space start-up companies, we are in a new wave of limitless innovation. NASA's statutory responsibility is to "provide for the widest practicable and appropriate dissemination of information concerning its activities and the results thereof." (51 U.S.C. § 20112) In particular, through machine learning, the public data drawn from NASA’s space assets can provide insights for addressing climate-related problems here on Earth. And many climate start-up companies can benefit from leveraging this data, either for proof of concepts or their own missions. In the Fall of 2021, several scientists from NASA and Coral Vita led a Practicum with the Georgia Institute of Technology Masters in Data Analytics program. The Practicum saw two teams of students develop and implement machine learning models to infer, from CALIPSO satellite imagery, vitality properties upon satellite pass. This kind of capability can lead to real-time mapping of coral health around the world, giving organization an understanding of where to prioritize reef reconstitution.. In this presentation, we will highlight this use case and discuss other concrete applications in which space data is used to solve problems here on Earth.

Earth Sciences↗

Multimodal Data Fusion via Entropy Minimization

The use of gradient-based data-driven models to solve a range of real-world remote sensing problems can in practice be limited by the uniformity of available data. Use of data from disparate sensor types, resolutions, and qualities typically requires compromises based on assumptions that are made prior to model training and may not necessarily be optimal given over-arching objectives. For example, while deep neural networks (NNs) are state-of-the-art in a variety of target detection problems, training them typically requires either limiting the training data to a subset over which uniformity can be enforced or training independent models which subsequently require additional score fusion. The method we introduce here seeks to leverage the benefits of both approaches by allowing correlated inputs from different data sources to co-influence preferred model solutions, while maintaining flexibility over missing and mismatching data. In this work we propose a new data fusion technique for gradient updated models based on entropy minimization and experimentally validate it on a hyperspectral target detection dataset. We demonstrate superior performance compared to currently available techniques using a range of realistic data scenarios, where available data has limited spacial overlap and resolution.

97 MATHEMATICS AND COMPUTING↗

Continuity of A Global, Satellite-Based Terrestrial Primary Productivity Dataset in the VIIRS Era Achieved With Model-Data Fusion

The NASA Terra and Aqua satellites have been successfully operating for over two decades and have far exceeded their original 5‐year design life. However, the era of NASA’s Earth Observing System (EOS) may be coming to a close as early as 2023. We conducted a comprehensive calibration and validation of the MODIS MOD17 product [1,2] and the potential for continuity of multi‐decadal ecosystem gross primary productivity (GPP) and annual net primary productivity (NPP), using data from the Visible Infrared Imaging Radiometer Suite (VIIRS) sensors aboard Suomi NPP and NOAA‐20. We combined an 18‐year record of eddy covariance flux tower measurements with hundreds of field measurements of NPP from the Oak Ridge National Laboratories Multi‐Biome collection to benchmark MODIS MOD17 Collection 6.1 (C61) and to develop the first terrestrial productivity estimates from VIIRS. Plant traits from the literature and the global TRY database [3,4] provide strong priors for identifying model parameters in a Bayesian model‐data fusion. As MODIS‐like observations are still needed for global environmental applications, the new VIIRS VNP17 product has the potential to extend these continuous estimates of global, terrestrial primary productivity beyond 2030.

K. Arthur Endsley↗

Air Quality Data Fusion with Sensors, Satellites, and Models

Poor air quality is a major global public health concern, which is only projected to get worse in coming years. A comprehensive understanding of current and potential future air quality and its key drivers spanning from local to global scales is needed to tackle this important problem. This presentation will outline the sources of information that we use to understand air quality, including ground-based measurements, satellites, and models. After giving an overview of these data sources and outlining their strengths and limitations, we will take a look at how they can be used together to give us a better picture of air quality locally and globally with data fusion techniques.

Carl Malings↗

The Distribution of Titanium in Lunar Soils on the Basis of Sensor and In Situ Data Fusion

A variety of remote-sensing measurements have been used to map the distribution of elements on the Moon as a means of providing constraints on the processes from which its crust and major terranes originated. Discussed here is Ti, which is incorporated into refractory minerals such as ilmenite during the latter stages of differentiation, and is thus a most useful element for understanding mare basalt petrogenesis. One of the earliest Ti maps showed Ti variations in nearside maria on the basis of groundbased spectral reflectance measurements. A map of Ti derived from gamma-ray measurements on Apollo 15 and 16 was produced at about the same time, and was improved upon considerably by Davis and coworkers, who effectively removed sources of spurious variation from Fe and Al or REE (e.g., Th) interference, and calibrated Ti on the bases of landing-site soil averages. In recent years, spectral reflectance measurements from Clementine have been used by Lucey and coworkers to produce global Ti distribution maps as well. As we indicated previously, the Lucey and Davis maps agree to first order. Meanwhile, we are using the concept of sensor data fusion to combine measurements from the AGR (Apollo gamma-ray) and CSR (Clementine Spectral Reflectance) techniques with ground truth from lunar soils to utilize the differences between the two maps to understand the distribution of Ti within lunar soil components, as we have done with Fe. This technique should be verified and applied on Lunar Prospector gamma-ray measurements of Ti, as the calibrated data become available within the next couple of years. Lunar Ti is found principally in the mineral ilmenite, and is associated with certain components of lunar soil: crystalline Ilmenite mineral fragments and high Ti-bearing glass. All data indicate that Ti is associated with maria and mafic minerals. In AGR and CSR datasets, Ti is highest on the nearside and in the maria, particularly in southern Serenitatis/northern Tranquillitatis and northwestern Procellarum. Unlike CSR-derived values, AGR Ti values show modest increase (up to 0.7%) on the northern farside. Both techniques show a primarily unimodal distribution with a shoulder in the high Ti direction and a primary mode at approximately 0.2% (0.15% for CSR and 0.25% for AGR data), but the AGR Ti data have more structure in the shoulder, including an apparent minor mode at 1.2% Ti, representing non-highland areas. Recalibrating the two datasets on the basis of matching the peaks and range on the histograms would not account for this additional structure in the AGR data. Low Ti areas, which occur predominantly on the farside, are not represented well in the lunar sample collection, although several meteorites thought to be of lunar highland origin show Ti abundances averaging about 0.2%. (Error bars on AGR Ti values are about 0.5%.) Gamma-ray measurements reflect intrinsic Ti surface composition, regardless of the physical or chemical state of Ti. Lucey and coworkers have attempted to produce an equivalent bulk Ti map by normalizing the spectral feature at 415 nm to remove the effects of physical variations from soil to soil. The normalization is based on laboratory measurements of available samples, primarily nearside maria, and is undoubtedly optimized for the proportions in which Ti- components are found in these soils. In particular, mare soils tend to have a much higher proportion of opaque mineral grains, which appears to be well correlated with Ti abundance. The relationship between Ti abundance and proportion of Ti-bearing glass (weighted for Ti abundance) is not as direct. Also shows the relationship between landing site soil average, AGR, and CSR Ti abundances (with CSR filtered to match resolution and field of view of AGR data). AGR Ti values show the best agreement with Ti soil averages, CSR Ti values being somewhat higher in high-Ti soils, and lower in low-Ti soils. These results would tend to support the argument that the technique for deriving Ti from the CSR measurements is optimized for one of the primary Ti-bearing components, most likely opaque mineral grains, and is thus over-compensating and reporting higher Ti values in mare areas, and underreporting Ti in highland areas with much lower proportions of opaque mineral grains. More information is contained in original.

Clark, P. E.↗

Data Fusion and Mining Techniques to Map Water Use and Drought across Spatial and Temporal Scales

As the world’s water resources come under increasing tension due to dual stressors of climate change and population growth, accurate knowledge of water consumption through evapotranspiration (ET) over a range in spatial scales will be critical in developing adaptation strategies. Remote sensing methods for monitoring consumptive water use (e.g, ET) are becoming increasingly important, especially in areas of significant water and food insecurity. One method to estimate ET from satellite-based methods, the Atmosphere Land Exchange Inverse (ALEXI) model uses the change in mid-morning land surface temperature to estimate the partitioning of sensible and latent heat fluxes which are then used to estimate daily ET. This presentation will outline several recent enhancements to the ALEXI modeling system, with a focus on global ET and drought monitoring. Until recently, ALEXI has been limited to areas with high resolution temporal sampling of geostationary sensors. The use of geostationary sensors makes global mapping a complicated process, especially for real-time applications, as data from as many as five different sensors are required to be ingested and harmonized to create a global mosaic. However, our research team has developed a new and novel method of using twice-daily observations from polar-orbiting sensors such as MODIS and VIIRS to estimate the mid-morning rise in LST that is used to drive the energy balance estimations within ALEXI. This allows the method to be applied globally using a single sensor (in this case, initially MODIS with a planned transition to VIIRS) rather than a global compositing of all available geostationary data. Other advantages of this new method include the higher spatial resolution provided by MODIS and VIIRS and the increased sampling at high latitudes where oblique view angles limit the utility of geostationary sensors. This presentation will focus on global applications for mapping water use and drought using data mining and data fusion across spatial scales extending from 5-km to 30-m “field-scale” estimates.

Christopher Hain↗