Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data Fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

Overview of the Smart Network Element Architecture and Recent Innovations

In industrial environments, system operators rely on the availability and accuracy of sensors to monitor processes and detect failures of components and/or processes. The sensors must be networked in such a way that their data is reported to a central human interface, where operators are tasked with making real-time decisions based on the state of the sensors and the components that are being monitored. Incorporating health management functions at this central location aids the operator by automating the decision-making process to suggest, and sometimes perform, the action required by current operating conditions. Integrated Systems Health Management (ISHM) aims to incorporate data from many sources, including real-time and historical data and user input, and extract information and knowledge from that data to diagnose failures and predict future failures of the system. By distributing health management processing to lower levels of the architecture, there is less bandwidth required for ISHM, enhanced data fusion, make systems and processes more robust, and improved resolution for the detection and isolation of failures in a system, subsystem, component, or process. The Smart Network Element (SNE) has been developed at NASA Kennedy Space Center to perform intelligent functions at sensors and actuators' level in support of ISHM.

Perotti, Jose M.↗
NASA NTRS2012

An Information NEXUS: The NASA Global Hawk Link Module

The Link Module described in this paper was first developed for the NASA Global Hawk Pacific Mission (GloPAC), four flights of 30 hour duration, supporting the Aura Validation Experiment (AVE). Its second use was during the Genesis and Rapid Intensification Processes (GRIP) experiment, a NASA Earth Science field experiment to better understand how tropical storms form and develop into major hurricanes. In these missions, the Link module negotiated all communication over the high bandwidth Ku satellite link, archived al the science data from onboard experiments in a spatially enable database, routed command and control of the instruments from the Global Hawk Operations Center, and retransmitted select data sets directly to experimenters control and analysis systems. The availability of aggregated information from collections of sensors, and remote control capabilities, in real-time, is revolutionizing the way Airborne Science is being conducted. Also described is the next generation Link Module now being designed and tested to support the NASA Earth Venture missions, the Hurricane and Severe Storm Sentinel (HS3) mission, and Airborne Tropical Tropopause Experiment (ATTREX) mission. Advanced data fusion technologies being developed will further advance the Scientific productivity, flexibility and robustness of these systems. Historically, the Link module evolved from the instrument and communication interface controller used by NASA's Pathfinder and Pathfinder plus solar powered UAS's in the late 1990's. It later was expanded for use in the AIRDAS four channel scanner flown on the NASA Altus UAS, and then again to a module in the AMS twelve channel multispectral scanner flying on the NASA (Predator-b) Ikhana UAS. The current system is the next step in the evolution, a multi board system packaged in a Curtiss Wright MIL-spec, flight qualified enclosure.

Remote Sensing↗
NASA NTRS2011

Sensor Web Technology Challenges and Advancements for the Earth Science Decadal Survey Era

This paper examines the Earth science decadal survey era and the role ESTO developed sensor web technologies can contribute to the scientific observations. This includes hardware and software technology advances for in-situ and in-space measurements. Also discussed are emerging areas of importance such as the potential of small satellites for sensor web based observations as well as advances in data fusion critical to the science and societal benefits of future missions, and the challenges ahead.

sensor web↗
NASA NTRS2015

The Role of the NASA Global Hawk Link Module as an Information Nexus For Atmospheric Mapping Missions

The Link Module described in this paper was developed for the NASA Uninhabited Aerial System (UAS) Global Hawk Pacific Mission (GloPAC) Airborne Science Campaign; four flights of 30 hour duration, supporting the Aura Validation Experiment (AVE). It was used again during the Genesis and Rapid Intensification Processes (GRIP) experiment, a NASA Earth Science field experiment to better understand how tropical storms form and develop into major hurricanes. In these missions, the Link Module negotiated all communication over the high bandwidth Ku satellite link, archived all the science data from onboard experiments in a spatially enabled database, routed command and control of the instruments from the Global Hawk Operations Center, and re-transmitted select data sets directly to experimenters control and analysis systems. The availability of aggregated information from collections of sensors, and remote control capabilities, in real-time, is revolutionizing the way Airborne Science is being conducted. The Link Module NG now being flown in support of the NASA Earth Venture missions, the Hurricane and Severe Storm Sentinel (HS3) mission, and Airborne Tropical Tropopause Experiment (A TTREX) mission, has advanced data fusion technologies that are further advancing the Scientific productivity, flexibility and robustness of these systems. On-the-fly traffic shaping has been developed to allow the high definition video, used for critical flight control segments, to dynamically allocate variable bandwidth on demand. Historically, the Link Module evolved from the instrument and communication interface controller used by NASA's Pathfinder and Pathfinder plus solar powered UAS's in the late 1990' s. It later was expanded for use in the AIRDAS four channel scanner flown on the NASA Altus UAS, and then again to a module in the AMS twelve channel multispectral scanner flying on the NASA (Predator-b) Ikhana UAS. The current system is the answer to the challenges imposed by extremely long duration UASs, with on-board multi-instrument (>= 12) Sensor Webs.

Hurricanes↗
NASA NTRS2016

Mapping Impact of Urbanization in the Continental U.S. from 2001-2020

Data fusion, from Landsat and MODIS, was used to characterize US buildup and to derive a plausible 2020 impervious surface area (ISA) projection based on observed rates of ISA change as a function of population from 2006 to 2011. The analysis shows that urbanization in the U.S. implicitly includes a cultural character whereby depending on the region, cities are either built horizontally with large ISA per capita or vertically with a minimal spatial footprint. This cultural character can also be forced by land availability, topography and inland water. In other regions, cities seem to have adapted to their population growth and adjusted their ISA use per capita.

ISA↗
NASA NTRS2018

Sensor Arrays for Aerospace Vehicles

Advances in highly scalable sensors, wireless networks, distributed computing and data fusion algorithms enable significant improvements in high-level information-centric state determination for adaptable and autonomous aerospace vehicles. The objective is to increase insight into structural response of space vehicles and insight into the aerodynamics of new aircraft.

Alena, Richard↗
NASA NTRS2019

Earth Science Technology Office (ESTO) New Observing Strategies (NOS) and NOS-Testbed (NOS-T)

With the advancement of space hardware technologies such as smaller spacecraft, component and instrument miniaturization and high performance space processors, and with the advancement of software technologies in artificial intelligence, big data analysis and autonomous decision making, Earth Science is looking at novel ways to observe phenomena that previously could not have been studied or would have been too expensive to study with traditional missions. In particular, the New Observing Strategies (NOS) component of the NASA Earth Science Technology Office (ESTO) Advanced Information Systems Technology (AIST) Program aims at leveraging these novel technologies as well as low cost and easy access to space to acquire multi-temporal or simultaneous multi-angular, multi-locations, multi-resolution and multi-spectral observations that will provide better multi-source measurements and will build a more dynamic and comprehensive picture of Earth Science phenomena that need to be studied and analyzed. For applications such as water resources management, air quality monitoring, biodiversity studies or disaster management, NOS will integrate the use of small instruments, small spacecraft, constellations of spacecraft and networks of sensors to design new missions that will provide the necessary measurements to improve future forecast and science modeling systems.Measurement acquisition will therefore be approached as a system of systems rather than on a mission basis, and a system of this complexity should not be expected to work without full integration and experimental characterization. Although most of the individual technologies enabling to link and coordinate multi-source observations are more or less mature, a few technologies need to be developed and all of them need to be integrated and tested as a system. In order for this validation to occur, the AIST Program is developing the NOS Testbed that includes 3 main goals:1.Validate novel NOS technologies, independently and as a system2.Demonstrate novel distributed operations concepts3.Socialize new Distributed Spacecraft Mission (DSM) and SensorWeb (SW) technologies and concepts to the science community by significantly retiring the risk of integrating these new technologies.The NOS Testbed will consist of multiple sensing nodes, simulated or actual, representing space, air and/or ground measurements, that are interconnected by a communications fabric (infrastructure that permits nodes to transmit and receive data between one another and interact with each other). Each node will be supported by hardware capabilities required to perform nodes monitoring and command & control, as well as intelligent "onboard" computing. The nodes will work together in a collaborative manner to demonstrate optimal science capabilities. The testbed will enable to validate technologies such as inter-node communication models, techniques and protocols; inter-node coordination; real-time data fusion and understanding; planning; sensor re-targeting; etc. Additionally, the testbed will have the capability to interact with various mission design tools, OSSEs and one or several forecast models. More details about the NOS Testbed will be presented at the confererence.

Earth Science missions; Advanced information Syste↗
NASA NTRS2019

The Evolution and Extratropical Transition of Tropical Cyclones from a GPM, ISS LIS and GLM Perspective

Not much is known about the evolution of lightning within extra-tropical cyclones traversing the mid-latitudes, especially its oceans. To facilitate such studies we combine a recently constructed precipitation features (PF) database obtained from the Global Precipitation Measurement (GPM) mission constellation of satellites with lightning observations from the Geostationary Lightning Mapper (GLM) onboard GOES-16 and the Lightning Imaging Sensor (LIS) onboard the International Space Station (ISS). The goal of this study is to provide a new observationally-based view of the tropical to extra-tropical transition and its impact on lightning production. Such data fusion approaches, as presented here, will also be important in future satellite studies of convective precipitation.

Gatlin, Patrick↗
NASA NTRS2004

The formation algorithms and simulation testbed

Formation flying for spacecraft is a rapidly developing field that will enable a new era of space science. For one of its missions, the Terrestrial Planet Finder (TPF) project has selected a formation flying interferometer design to detect earth-like planets orbiting distant stars. In order to advance technology needed for the TPF formation flying interferometer, the TPF project has been developing a distributed real-time testbed to demonstrate end-toend operation of formation flying with TPF-like functionality and precision. This is the Formation Algorithms and Simulation Testbed (FAST) . This FAST was conceived to bring out issues in timing, data fusion, inter-spacecraft communication, inter-spacecraft sensing and system-wide formation robustness. In this paper we describe the FAST and show results from a two-spacecraft formation scenario. The two-spacecraft simulation is the first time that precision end-to-end formation flying operation has been demonstrated in a distributed real-time simulation environment.

Benowitz, Edward↗
NASA NTRS2020

Evaluation of global terrestrial evapotranspiration using state-of-the-art approaches in remote sensing, machine learning and land surface modeling

Evapotranspiration (ET) is critical in linking global water, carbon and energy cycles. However, direct measurement of global terrestrial ET is not feasible. Here, we first reviewed the basic theory and state-of-the-art approaches for estimating global terrestrial ET, including remote-sensing-based physical models, machine-learning algorithms and land surface models (LSMs). We then utilized 4 remote-sensing-based physical models, 2 machine-learning algorithms and 14 LSMs to analyze the spatial and temporal variations in global terrestrial ET. The results showed that the ensemble means of annual global terrestrial ET estimated by these three categories of approaches agreed well, with values ranging from 589.6 mm/yr (6.56×10^4 cu.km/yr) to 617.1 mm/yr (6.87×10^4 cu.km/yr). For the period from 1982 to 2011, both the ensembles of remote-sensing-based physical models and machine-learning algorithms suggested increasing trends in global terrestrial ET (0.62 mm/sq.yr with a significance level of p<0.05 and 0.38 mm yr−2 with a significance level of p<0.05, respectively). In contrast, the ensemble mean of the LSMs showed no statistically significant change (0.23 mm/sq.yr, p>0.05), although many of the individual LSMs reproduced an increasing trend. Nevertheless, all 20 models used in this study showed that anthropogenic Earth greening had a positive role in increasing terrestrial ET. The concurrent small interannual variability, i.e., relative stability, found in all estimates of global terrestrial ET, suggests that a potential planetary boundary exists in regulating global terrestrial ET, with the value of this boundary being around 600 mm/yr. Uncertainties among approaches were identified in specific regions, particularly in the Amazon Basin and arid/semiarid regions. Improvements in parameterizing water stress and canopy dynamics, the utilization of new available satellite retrievals and deep-learning methods, and model–data fusion will advance our predictive understanding of global terrestrial ET.

surface modeling↗
NASA NTRS2023

Seasonal Forecasting Skill for the High Mountain Asia Region in the Goddard Earth Observing System

Seasonal variability of the global hydrologic cycle directly impacts human activities, including hazard assessment and mitigation, agricultural decisions, and water resources management. This is particularly true across the High Mountain Asia (HMA) region, where availability of water resources can change depending on local seasonality of the hydrologic cycle. Forecasting the atmospheric states and surface conditions, including hydrometeorological relevant variables, at subseasonal-to-seasonal (S2S) lead times of weeks-to-months is an area of active research and development. NASA’s 15 Goddard Earth Observing System (GEOS) S2S prediction system has been developed with this research goal in mind. Here, we benchmark the forecast skill of GEOS-S2S (version 2) hydrometeorological forecasts at 1-3 month lead times in the HMA region, including a portion of the Indian Subcontinent, during the retrospective forecast period, 1981-2016. To assess forecast skill, we evaluate 2-m air temperature, total precipitation, fractional snow cover, snow water equivalent, surface soil moisture, and terrestrial water storage forecasts against the Modern-Era Retrospective analysis for Research and 20 Applications, Version 2 (MERRA-2) and independent reanalysis data, satellite observations, and data fusion products. Anomaly correlation is highest when the forecasts are evaluated against MERRA-2 and particularly in variables with long memory in the climate system, likely due to similar initial conditions and model architecture used in GEOS-S2S and MERRA-2. When compared to MERRA-2, results for the 1-month forecast skill range from anomaly correlation of R anom =0.18 for precipitation to R anom =0.62 for soil moisture. Anomaly correlations are consistently lower when forecasts are 25 evaluated against independent observations; results for the 1-month forecast skill range from R anom =0.13 for snow water equivalent to R anom =0.24 for fractional snow cover. We find that, generally, hydrometeorological forecast skill is dependent on the forecast lead time, the memory of the variable within the physical system, and the validation dataset used. Overall, these results benchmark the GEOS-S2S system’s ability to forecast HMA hydrometeorology.

GEOS↗
NASA NTRS2022

NASA System-Wide Safety Wildland Firefighting Operations Workshop Report

On March 9-11, 2022, NASA’s System-Wide Safety Wildland Firefighting Operations Workshop engaged the broader wildland firefighting management ecosystem in a safety-oriented discussion via a virtual platform. This enabled a better understanding of how NASA and community expertise can be leveraged in the safe development of current and future firefighting systems and operations. The goals of the workshop were to: (1) identify and prioritize the top safety-oriented risks, gaps in capabilities, and emerging technologies to enhance wildland firefighting for both near-term and far-term concepts, with a specific focus on aviation operations and (2) engage the stakeholder community in defining emergent safety-oriented scope, roles, responsibilities, and procedures for agents undergoing increasingly complex wildland firefighting operations in information-rich, but uncertain environments. Workshop participants were solicited from wildland firefighting stakeholders across government, industry, and academia. All levels of government were engaged, as NASA sought attendees from federal, state, local, and tribal government agencies. Industry participants from traditional wildland firefighting domains such as data visualization and equipment manufacturers were invited, and corporate attendees from novel application domains such as aerial robotics and autonomous systems were present as well. The top three findings were as follows: (1) Enhancing situation awareness is a safety priority, especially in the use of aerial assets; (2) Timely access to information along with data fusion and integrated displays will enhance safety-critical decision-making both inside and outside aviation contexts; and (3) Tailorable standards and common operating pictures in the field will enhance inter-agency cooperation in the wildland firefighting lifecycle and enable the optimal use of limited resources such as aerial assets. The workshop helped inform NASA of the relevant safety-related wildland firefighting concerns and aided the broader ecosystem in understanding the potential safety-oriented role NASA might play in this community. Increased engagement with crucial governmental stakeholders (e.g., U.S. Forest Service, CAL FIRE, etc.) along with industry partners in cutting- edge information -centric domains is a fundamental next step. Additionally, the workshop findings will help define the first of a series of operationally challenging demonstrations, held in concert with strategic ecosystem partners, known as the Safety Demonstrator Series for NASA’s System-Wide Safety project. The first demonstration is set in the wildland firefighting application domain and will: (1) examine high risk operational scenarios to reduce their overall risk via services, functions or capabilities that act as risk mitigators (or transfer that risk to automated systems better able to tolerate it) and (2) explore novel tools and technologies that will enhance safety margins by enabling non-traditional or neoteric operational paradigms.

wildland firefighting↗
NASA NTRSDate not supplied

Space-Based Lidar Observations of the 3D Structure of the Earth System

Lidar provides precise measurements of the three-dimensional structure of the clouds, aerosols, ocean/land/snow/ice surfaces, as well as ocean subsurface. Lidar also provides unique information about physical propertiesof particulates in the atmosphere for both radiative transfer and air quality applications.In this talk, I will present an overview of our recent studies of aerosols, clouds, ocean and snow using space-based lidar measurements (e.g., LITE, CALIPSO and ICESat-2), such as classifications of aerosols and thermodynamics phase of clouds, cloud microphysical properties, snow depths and phytoplankton biomass. I will also introduce a new concept of 3D Earth system observations with data fusion though combined active/passive remote sensing and machine learning. The new concept aims to reveal vertical structure of the aerosols/clouds/surfaces/subsurface from passive sensors by taking advantage of lidar measurements to effectively resolve the vertical structureby unscrambling the highly convoluted multi-angle, spectral and polarization information from passive sensors and apply the knowledge to a large swath where lidar measurements are not available.

Ali Omar↗
NASA NTRSDate not supplied

Comparing Low-Cost Sensors with Ground-Based and Airborne In-Situ and Column Observations of NO2 and HCHO during the FRAPPE Field Campaign in Colorado, USA

Even in the presence of more reliable air quality tools, low-cost sensors have the benefit of recording data on highly localized spatial and temporal scales, allowing for multiple measurements within a single satellite pixel and on pixel boundaries. However, they are less accurate than their regulatory-grade counterparts, requiring regular co-locations with accepted instruments to ensure their validity. Thus, the addition of low-cost sensors to a field campaign – where reference-grade air quality instruments are abundant – not only provides ample opportunities for low-cost sensor co-location and calibration, but also allows the low-cost instruments to be used for sub-pixel validation, covering more surface area than the regulatory instruments alone with a network of sensors. During the summer of 2014, our low-cost sensor network was deployed during the Front Range Air Pollution and Photochemistry Experiment (FRAPPÉ) campaign conducted to sample the composition of air at and above ground level in northeastern Colorado, USA. The low-cost sensor platform included a suite of gas-phase sensors, notably NO2 and two generalized volatile organic compound (VOC) sensors, which were leveraged together to quantify speciated hydrocarbons such as formaldehyde. These key pollutants were chosen for their impacts on human health and climate change, as well as their inclusion on the TEMPO satellite launching this year. Airborne campaign measurements included slant column optical observations of formaldehyde (HCHO), nitrogen dioxide (NO2), and ozone (O3). Myriad additional in-situ instruments described chemical composition up to approximately 5 km above surface level. Ground-based instrumentation included both stationary and mobile regulatory-grade instruments, which were used for sensor calibration. Machine learning techniques such as artificial neural networks (ANNs) were used to match the low-cost signals to that of the reference-grade instruments. Here, we compare calibrated low-cost sensor data collected at ground level in a variety of locations along Colorado’s Front Range to various data sources from the FRAPPÉ campaign to better understand how well airborne and regulatory ground-based measurements can be extrapolated to other locations. Further, as the slant column measurements act as satellite simulators, we explore how low-cost instruments can be used for satellite validation purposes. Comparisons among these different data types also have important implications in data fusion.

Kristen Okorn↗
NASA NTRSDate not supplied

Advanced Capabilities for Emergency Response Operations (ACERO)

The Advanced Capabilities for Emergency Response Operations (ACERO) project is expected to develop, integrate, demonstrate, and transition to operations, evolving aviation technologies from NASA and industry to identify, monitor, and suppress wildland fires as a means to enhance safety, improve operational efficiency, and prevent economic loss. Some of the concepts ACERO explores are: wildfire airspace mangement to improve safety and resource utilization during a disaster, applying new aviation technologies to improve safety and demonstrate new mission-support capabilities, second-shift operations to enable progress towards 24/7 aerial response, and the integration of capabilities across NASA's Aeronautics Research, Science, and Space Technology mission directorates to enable expanded and scalable operations. Realizing this vision is expected to bring positive impact to such areas as: consistency of technology adoption through a unified concept of operations, airspace coordination and deconfliction that integrates portable solutions and enables diverse operations, remote sensing and data fusion for modeling and predictions that support in-time decision making, aircraft technologies for hazard avoidance and state management, and increased response capabilities through persistent communications and surveillance. ACERO continues the research begun under the Scalable Traffic Management for Emergency Response Operations (STEReO) activity, which brings together several technologies in Unmanned Aircraft Systems (UAS) Traffic Management (UTM), Autonomy, Communications, Human Factors, and Domain Expertise & Tools, aimed at providing scalability and flexibility, as well as operational resiliency to dynamic changes during a disaster event. Some of the concepts STEReO explores are: collaborative tools to ingest remote sensing information and distribute a common mission operating picture, apply ad-hoc communication networks to facilitate timely information sharing and communication of changes, vehicle-to-vehicle and onboard autonomy technologies ensure the safety and resiliency of operations, and apply NASA’s UAS traffic management system (UTM) as a public safety UAS Service Supplier (USS) to access and coordinate use of the airspace by both manned and unmanned operations. The potential benefits of STEReO include: standardized, cross-platform communication means increased interoperability and ease of cooperation/collaboration, increased situation awareness and common operating picture allow for earlier detection and decision making, and scalable to size and complexity of environment, operations, and mission objectives. This presentation gives an informational overview of the ACERO and STEReO projects to the Council of Western State Foresters (CWSF) Western State Fire Managers (WSFM) Committee.

emergency response operations↗
NASA NTRSDate not supplied

A14H-04 Analysis of Simulated and Observed Trends in Global Surface PM2.5 and Aerosol Optical Properties from 1958 to 2018 Using the NASA GEOSCCM

Modeling of long-term trends of aerosols and their properties is important for constraining aerosol-climate forcing, and for characterizing changes in particulate matter pollution speciation and exposure. Here we study global and regional long-term trends in surface fine particulate matter (PM ) and aerosol optical properties for 60 years from 1958 to 2018, using simulations performed with the NASA Goddard Earth Observing System Chemistry Climate Model (GEOSCCM), and evaluate the model hindcast with observations for the last three decades. Comparing the modeled aerosols with a diverse set of observations helps interpret observed and simulated trends, and serves as a benchmark for future GEOSCCM developments and input datasets improvements. We first characterize modeled global and regional temporal changes in surface PM and its components, aerosol optical depth (AOD) and single scattering albedo (SSA) and we interpret their link with emissions drivers. We then compare modeled surface PM with ground-based observations from monitoring networks and with global reconstructed PM datasets from observations-model data fusion. Total AOD is compared with long-term satellite measurements from the Moderate Resolution Imaging Spectroradiometer (MODIS) and measurements from the ground-based Aerosol Robotic Network (AERONET). Additional aerosol optical properties, such as absorption and scattering coefficients, are evaluated with ground-based observations from the Global Atmosphere Watch (GAW) records.

aerosols↗
NASA NTRSDate not supplied

NASA Earth Systems Digital Twins (ESDT)

"Similarly to artificial intelligence, which is now revolutionizing many aspects of our daily lives, Earth system digital twin technologies have the potential to revolutionize the way Earth Science research will be conducted in the future, and how results and knowledge from this research will provide information to support decision making and yield impactful societal benefits. An Earth System Digital Twin or ESDT is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system as accurately and timely as possible; second, allows for computing forecasts of future states under nominal assumptions and based on the current replica; and third, offers the capability to investigate many hypothetical scenarios under varying impact assumptions. In other words, an ESDT provides the integrated What-Now, What-Next, and What-If pictures of the Earth or Earth system, by continuously ingesting newly observed data and by leveraging multiple interconnected models, machine learning as well advanced computing and visualization capabilities. Digital twins have been developed in engineering since 2002, but the interest in digital twins for the Earth domain is more recent and stems from the convergence of several developments: - The huge amount of diverse data that has now been collected continuously for more than 50 years, and that is becoming more and more difficult to access, understand, and utilize. - At the same time, because of climate change and its impacts the information produced by all of this data is becoming of interest to many new non-traditional users for analyzing and predicting various phenomena. - Because of advances in computational and visualization capabilities and the parallel unprecedented development of machine learning (ML), extracting relevant information from these large amounts of data and running complex models faster has become possible. As a result, it is becoming necessary and possible to build intuitive and interactive frameworks that will enable users with various skill levels and/or organizational hierarchy levels to easily access large amounts of targeted information along with the relevant tools and models (Earth system and human activity models), to support them in analyzing and visualizing this information, to help them understand interactions among models, to visualize the potential outcomes of various impacts, and to support decision or policy making. The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. With all these interests at stake, the challenges of building optimal digital twins are many and complex. The first challenge is to determine if a Digital Twin should be global or local, and multi-domain or thematic. For example, some domains such as Climate or Weather will require a global Digital Twin or Digital Twin capabilities while science areas such as Biodiversity might be more local. We can also envision that multiple thematic ESDTs, e.g., Air Quality, Wildfires, Hydrology could be federated or provide input to other ESDTs, either on a regional level or to a more global ESDT. Overall, we can imagine a future “web” of Digital Twins co-existing in a hierarchy or in a network, and capable of being connected or federated depending on the needs. This last point brings up the very important challenge of interoperability, including standards and protocols that will need to be built into these systems from the beginning. Each individual digital twin would have full flexibility in internal construction but would need standards-based interfaces (input and output) or hooks to make it compatible with others. Another challenge when building digital twins will be to decide how to organize each digital replica. Based on the applications targeted by the DT under implementation, various amounts and types of raw data, Analysis Ready Data (ARD) and information will need to be incorporated. Depending on the required latencies and needs of the users, various solutions can be considered, including Data Cubes, Data Lakes, pointers, or computing information on demand. We envision that each ESDT will choose a solution adapted to its specific objectives. Another important challenge is the type(s) of visualization that will be used, as well as the level of interactivity and refresh rate that will be required. Again, this will depend on the objectives of the ESDT, but also on the various users’ needs. In most cases, several types of visualizations and human interfaces will need to be offered depending on the projected users of that system. In parallel to the challenges highlighted above, there are also many tools and technologies that will need to be developed or improved for all types of digital twins. Among those are improved machine learning technologies, for example providing explainability, but also ML techniques for causality and providing a better integration of physics models. Additionally, reliable uncertainty quantification methods will be needed for all ESDT components, from validating data fusion and assimilation to assessing the accuracy of ML models and weighing the values of decisions supported by those systems. This presentation introduces the ESDT concept, presents several ESDT use cases, and a proposed ESDT architecture framework, as well as various technologies being developed by the Advanced Information Systems Technology (AIST) Program."

Earth Science Remote Sensing; Information Systems↗