Search NASA⌕ Search

SEARCH · Search NASA

Results for “Weather forecast uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

122 records · Page 7

Evaluating the Global Water and Energy Cycles in Reanalyses Using Ensemble Spread

Reanalyses provide continuous observation based global data over weather and climate time scales through observational assimilation. Ensemble forecasts are a component of modern data assimilation systems, providing information to the analysis process. Storing this spread over the duration of a climate reanalysis will provide insight to the variations of the model that underlies the reanalysis data. Global water and energy cycles (WECs) are a critical aspect of both weather and climate, yet there are some large gaps in the observation of key components as well as their representation in models and reanalyses. NASA’s Water and Energy cycle Studies (NEWS) program is developing a corrected and balanced budget data set that is closed at monthly and regional scales during the 21st century, so far. In this paper, we will evaluate reanalysis WEC components against the initial NEWS collection of observation, but integrate the analysis spread from the reanalysis data assimilation as a new perspective on the evaluation. The initial evaluation will cover a few more recent years using ERA5 10 member spread. As the GMAO’s production of the Modern-Era Retrospective analysis for Research and Applications 21st Century (MERRA-21C) progresses, the effort will include the MERRA-21C 32 member spread. Ultimately, we will explore the potential of the ensemble spread as a measure of uncertainty in the reanalysis.

Michael Bosilovich↗

Influence of Mid-Latitude Cyclones on European Background Surface Ozone Investigated in Observations, MACC and MERRA-2 Reanalyses

The relationship between springtime mid-latitude cyclones and background ozone at two rural monitoring sites on the west coast of Europe -- Mace Head, Ireland and Monte Velho, Portugal -- is explored using a combination of observations and three reanalyses: 1) the European Centre for Medium-Range Weather Forecasts' (ECMWF) ERA-Interim reanalysis, 2) the Monitoring Atmospheric Composition and Climate (MACC) reanalysis and 3) NASA's Modern-Era Retrospective Analysis for Research and Applications Version-2 (MERRA-2) reanalysis. The ERA-Interim cyclone tracks are used here to establish the long-term relationship between cyclones and ozone observations (since 1988). The MACC reanalysis data set, which covers the period 2003-2012, is produced with the ECMWF integrated forecast system (IFS) model two-way coupled to a chemistry transport model (CTM). Since the MACC reanalysis uses a similar atmospheric model to ERA-Interim, MACC is used to explore the mechanisms within the case study cyclones that can influence surface ozone concentrations at Mace Head and Monte Velho. The MERRA-2 reanalysis also provides 3D distributions of ozone, although less ideal for analysis of surface ozone concentrations since MERRA-2 ozone under represents ozone variability outside the stratosphere as it does not have a detailed chemistry scheme or emission sources for the troposphere. The MERRA-2 reanalysis, which has the potential to identify more features within the cyclones as the resolution is higher than the MACC reanalysis, is used in conjunction with the MACC reanalysis to provide a measure of uncertainty to the case study analysis. We found the main source of high ozone to these two sites is from the stratosphere, which is well represented in both the MERRA-2 and the MACC reanalyses, either from direct injection into the cyclone or associated with aged airstreams from decaying downstream cyclones that can become entrained and descend toward the surface within new cyclones over the NA region.

MERRA-2↗

On-Orbit Calibration Assessment of NOAA-21 VIIRS Thermal Emissive Bands and Implications for JPSS-4 VIIRS

The Visible Infrared Imaging Radiometer Suite (VIIRS) instrument onboard the NOAA-21 (N21) satellite has been successfully operating for over three years collecting valuable scientific measurements. A large suite of weather forecasting models and scientific research applications are supported with the VIIRS measurements from N21 combined with those acquired from the VIIRS instrument onboard the S-NPP and NOAA-20 spacecraft. Among the 22 VIIRS spectral bands, there are seven thermal emissive bands (TEB) covering the 3.7 to 12.2 µm spectral range at two different spatial resolutions. The VIIRS TEB detectors are calibrated onboard using a blackbody at a controlled temperature and a space view for background signal measurement. In this paper, we discuss the on-orbit performance of the N21 VIIRS TEB using various parameters such as the detector gain, noise, and offset. This on-orbit assessment provides critical insights into instrument behavior and calibration performance that will inform pre-launch testing and post-launch validation strategies for the upcoming JPSS-4 VIIRS mission scheduled for launch in 2027. The methodologies and lessons learned from characterizing the N21 TEB performance will enable more efficient and comprehensive radiometric assessment of the next VIIRS instrument. Specific focus is placed on identifying performance trends and anomaly signatures observed during the N21 commissioning phase that can enhance the JPSS4 instrument checkout procedures and accelerate the transition to routine on-orbit operations. The established performance baselines and uncertainty estimates will serve as an acceptance criterion for the JPSS-4 commissioning activities, ensuring mission readiness and data continuity for operational users.

Amit Angal↗

Definition of a Technology Validation Mission for P-band Reflectometry using Signals of Opportunity

Root-Zone Soil Moisture (RZSM) (moisture profile in the top meter of soil) and Snow Water Equivalent (SWE) (total snow pack water content) are identified as priority target variables in the ESAS 2017 decadal survey [1] with critical roles in hydrology and water management. RZSM estimates are vital for understanding multiple Earth system processes and forecasting (for example, droughts [2]). Simultaneous knowledge of surface and RZSM could enable a breakthrough in estimating key unobserved hydrologic fluxes and reduce uncertainty in net ecosystem exchange (NEE), carbon balance [3] discharge estimates, and crop yield forecasts [4] .With the high albedo and insulating properties of snow, monitoring, SWE accumulation would provide a key constraint on the potential runoff during spring ablation while monitoring SWE disappearance rates would provide a key constraint on SWE partition into runoff vs. infiltration/recharge. [5] demonstrated that knowledge of early-spring SWE generally contributes most to streamflow forecast skill in the Western U.S. SWE is also a source of water storage that provides the water resources during spring snowmelt. Despite such potentially transformative contributions, accurate RZSM and SWE measurements are unattainable with current technology. While active/passive L-band methods (e.g. SMAP, SMOS) can reliably retrieve surface soil moisture in the top 5 cm of soil [6], [7]. RZSM estimates are only available through model assimilation of brightness temperatures with a radiative transfer and land surface models [8]. SWE estimation uses multi-frequency passive microwave techniques (e.g. [9]-[11]), which have significant problems with deeper snow and in forested and mountainous environments [12]. Signals of opportunity (SoOp) in P-band (200-400 MHz) is a new remote sensing technique with the capability of estimating both essential hydrologic variables, RZSM and SWE, circumventing many of the aforementioned limitations under all weather conditions day and night. SoOp is the re-utilization of existing powerful satellite transmissions within bands allocated for communications or navigation. P-band SoOp sensitivity to soil moisture has been demonstrated in an airborne experiment over Oklahoma in 2016 [13]. Recent theory [14] and experiments [15] have also confirmed that the reflection coefficient phase is proportional to SWE.

Garrison, J. L.↗

JPSS-2 VIIRS Pre-Launch Reflective Solar Band Testing and Performance

The Visible Infrared Imaging Radiometer Suite (VIIRS) instruments on-board the Suomi National Polar-orbiting Partnership (S-NPP) and Joint Polar Satellite System (JPSS) spacecrafts 1 and 2 provides calibrated sensor data record (SDR) reflectance, radiance, and brightness temperatures for use in environment data record (EDR) products. The SDRs and EDRs are used in weather forecasting models, weather imagery and climate applications such as ocean color, sea surface temperature and active fires. The VIIRS has 22 bands covering a spectral range 0.4–12.4 m with resolutions of 375 m and 750 m for imaging and moderate bands respectively on four focal planes. The bands are stratified into three different types based on the source of energy sensed by the bands. The reflective solar bands (RSBs) detect sunlight reflected from the Earth, thermal emissive bands (TEBs) sense emitted energy from the Earth and the day/night band (DNB) detects both solar and lunar reflected energy from the Earth. The SDR calibration uses a combination of pre-launch testing and the solar diffuser (SD), on-board calibrator blackbody (OBCBB) and space view (SV) on-orbit calibrator sources. The pre-launch testing transfers the National Institute of Standards and Technology (NIST) traceable calibration to the SD, for the RSB, and the OBCBB, for the TEB. Post-launch, the on-board calibrators track the changes in instrument response and adjust the SDR product as necessary to maintain the calibration. This paper will discuss the pre-launch radiometric calibration portion of the SDR calibration for the RSBs that includes the dynamic range, detector noise, calibration coefficients and radiometric uncertainties for JPSS-2 VIIRS.

JPSS↗

Forecasting the Arrival Time of Coronal Mass Ejections: Analysis of the CCMC CME Scoreboard

Accurate forecasting of the properties of coronal mass ejections (CMEs) as they approach Earth is now recognized as an important strategic objective for both NOAA and NASA. The time of arrival of such events is a key parameter, one that had been anticipated to be relatively straightforward to constrain. In this study, we analyze forecasts submitted to the Community Coordinated Modeling Center at NASA's Goddard Space Flight Center over the last 6 years to answer the following questions: (1) How well do these models forecast the arrival time of CME-driven shocks? (2) What are the uncertainties associated with these forecasts? (3) Which model(s) perform best? (4) Have the models become more accurate during the past 6 years? We analyze all forecasts made by 32 models from 2013 through mid-2018, and additionally focus on 28 events, all of which were forecasted by six models. We find that the models are generally able to predict CME-shock arrival times, in an average sense, to within ±10 hr, but with standard deviations often exceeding 20 hr. The best performers, on the other hand, maintained a mean error (bias) of 1 hr, a mean absolute error of 13 hr, and a precision (standard deviation) of 15 hr. Finally, there is no evidence that the forecasts have become more accurate during this interval. We discuss the intrinsic simplifications of thevarious models analyzed, the limitations of this investigation, and suggest possible paths to improve these forecasts in the future.

space weather↗

Impacts from Assimilating Large Volumes of GNSS Radio Occultation (RO) Observations during ROMEX in NASA’s Global Earth Observing System

The GNSS Radio Occultation (RO) Modeling Experiment (ROMEX) seeks to quantify the benefit of the increasing quantity of RO observations available for use in operational numerical weather prediction (NWP) systems and products. ROMEX includes participation from multiple operational NWP centers and NWP models, among them are NASA’s Global Earth Observing System (GEOS) model produced and run at the Global Modeling and Assimilation Office (GMAO). The design of the numerical experiments core to ROMEX include: 1) a control model run that includes all the RO observations currently used operationally with the sole exception of those from commercial sources and 2) a ROMEX model run that adds to the control over 25 thousand additional RO profiles per day from commercial RO providers, with both experiments run over the three-month period of September through November 2022. The ROMEX model run greatly augments the relatively small subset of the currently available commercial RO profiles which have been purchased for routine use in operational NWP by the various NWP centers. While this smaller subset of commercial RO profiles currently used in operations has been shown to have a positive impact on NWP forecasts, the additional impact from the ROMEX RO dataset has yet to be determined and is the focus of ROMEX. Results from GEOS are presented, including the impact on both analyses and forecasts over the study period and statistics using the forecast sensitivity-based observation impact (FSOI) method. The impact from varying the method of quality control and specifying the observation uncertainty for RO observations within the GEOS data assimilation system is also examined.

Michael J Murphy↗

Improving AIRS Radiance Spectra in High Contrast Scenes Using MODIS

The Atmospheric Infrared Sounder (AIRS) on the EOS Aqua Spacecraft was launched on May 4, 2002. AIRS acquires hyperspectral infrared radiances in 2378 channels ranging in wavelength from 3.7-15.4 microns with spectral resolution of better than 1200, and spatial resolution of 13.5 km with global daily coverage. The AIRS is designed to measure temperature and water vapor profiles for improvement in weather forecast accuracy and improved understanding of climate processes. As with most instruments, the AIRS Point Spread Functions (PSFs) are not the same for all detectors. When viewing a non-uniform scene, this causes a significant radiometric error in some channels that is scene dependent and cannot be removed without knowledge of the underlying scene. The magnitude of the error depends on the combination of non-uniformity of the AIRS spatial response for a given channel and the non-uniformity of the scene, but is typically only noticeable in about 1% of the scenes and about 10% of the channels. The current solution is to avoid those channels when performing geophysical retrievals. In this effort we use data from the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument to provide information on the scene uniformity that is used to correct the AIRS data. For the vast majority of channels and footprints the technique works extremely well when compared to a Principal Component (PC) reconstruction of the AIRS channels. In some cases where the scene has high inhomogeneity in an irregular pattern, and in some channels, the method can actually degrade the spectrum. Most of the degraded channels appear to be slightly affected by random noise introduced in the process, but those with larger degradation may be affected by alignment errors in the AIRS relative to MODIS or uncertainties in the PSF. Despite these errors, the methodology shows the ability to correct AIRS radiances in non-uniform scenes under some of the worst case conditions and improves the ability to match AIRS and MODIS radiances in non-uniform scenes.

spatial↗

Evaluation of long-term Northern Hemisphere snow water equivalent products

Nine gridded Northern Hemisphere snow water equivalent (SWE) products were evaluated as part of the European Space Agency (ESA) Satellite Snow Product Intercomparison and Evaluation Exercise (SnowPEx). Three categories of datasets were assessed: (1) those utilizing some form of reanalysis (the NASA Global Land Data Assimilation System version 2 – GLDAS-2; the European Centre for Medium-Range Weather Forecasts (ECMWF) interim land surface reanalysis – ERA-Interim/Land and ERA5; the NASA Modern-Era Retrospective Analysis for Research and Applications version 1 (MERRA) and version 2 (MERRA-2); the Crocus snow model driven by ERA-Interim meteorology – Crocus); (2) passive microwave remote sensing combined with daily surface snow depth observations (ESA GlobSnow v2.0); and (3) stand-alone passive microwave retrievals (NASA AMSR-E SWE versions 1.0 and 2.0) which do not utilize surface snow observations. Evaluation included validation against independent snow course measurements from Russia, Finland, and Canada and product intercomparison through the calculation of spatial and temporal correlations in SWE anomalies. The stand-alone passive microwave SWE products (AMSR-E v1.0 and v2.0 SWE) exhibit low spatial and temporal correlations to other products and RMSE nearly double the best performing product. Constraining passive microwave retrievals with surface observations (GlobSnow) provides performance comparable to the reanalysis-based products; RMSE over Finland and Russia for all but the AMSR-E products is ∼50 mm or less, with the exception of ERA-Interim/Land over Russia. Using a seven-dataset ensemble that excluded the stand-alone passive microwave products reduced the RMSE by 10 mm (20 %) and increased the correlation from 0.67 to 0.78 compared to any individual product. The overall performance of the best multiproduct combinations is still at the margins of acceptable uncertainty for scientific and operational requirements; only through combined and integrated improvements in remote sensing, modeling, and observations will real progress in SWE product development be achieved.

Northern Hemisphere snow water equivalent (SWE) pr↗

Communicating the Threat of a Tropical Cyclone to the Eastern Range

The 45th Weather Squadron (45 WS) has developed a tool to help visualize the Wind Speed Probability product from the National Hurricane Center (NHC) and to help communicate that information to space launch customers and decision makers at the 45th Space Wing (45 SW) and Kennedy Space Center (KSC) located in east central Florida. This paper reviews previous work and presents the new visualization tool, including initial feedback as well as the pros and cons. The NHC began issuing their Wind Speed Probability product for tropical cyclones publicly in 2006. The 45 WS uses this product to provide a threat assessment to 45 SW and KSC leadership for risk evaluations with an approaching tropical cyclone. Although the wind speed probabilities convey the uncertainty of a tropical cyclone well, communicating this information to customers is a challenge. The 45 WS continually strives to provide the wind speed probability information to customers in a context which clearly communicates the threat of a tropical cyclone. First, an intern from the Florida Institute of Technology (FIT) Atmospheric Sciences department, sponsored by Scitor Corporation, independently evaluated the NHC wind speed probability product. This work was later extended into a M.S. thesis at FIT, partially funded by Scitor Corporation and KSC. A second thesis at FIT further extended the evaluation partially funded by KSC. Using this analysis, the 45 WS categorized the probabilities into five probability interpretation categories: Very Low, Low, Moderate, High, and Very High. These probability interpretation categories convert the forecast probability and forecast interval into easily understood categories that are consistent across all ranges of probabilities and forecast intervals. As a follow-on project, KSC funded a summer intern to evaluate the human factors of the probability interpretation categories, which ultimately refined some of the thresholds. The 45 WS created a visualization tool to express the timing and risk for multiple locations in a single graphic. Preliminary results on an on-going project by FIT will be included in this paper. This project is developing a new method of assigning the probability interpretation categories and updating the evaluation of the performance of the NHC wind speed probability analysis.

Winters, Katherine A.↗

Use of Quality Controlled AIRS Temperature Soundings to Improve Forecast Skill

AIRS was launched on EOS Aqua on May 4, 2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. The primary products of AIRS/AMSU-A are twice daily global fields of atmospheric temperature-humidity profiles, ozone profiles, sea/land surface skin temperature, and cloud related parameters including OLR. Also included are the clear column radiances used to derive these products which are representative of the radiances AIRS would have seen if there were no clouds in the field of view. All products also have error estimates. The sounding goals of AIRS are to produce 1 km tropospheric layer mean temperatures with an rms error of 1K, and layer precipitable water with an rms error of 20 percent, in cases with up to 90 percent effective cloud cover. The products are designed for data assimilation purposes for the improvement of numerical weather prediction, as well as for the study of climate and meteorological processes. With regard to data assimilation, one can use either the products themselves or the clear column radiances from which the products were derived. The AIRS Version 5 retrieval algorithm is now being used operationally at the Goddard DISC in the routine generation of geophysical parameters derived from AIRS/AMSU data. A major innovation in Version 5 is the ability to generate case-by-case level-by-level error estimates for retrieved quantities and clear column radiances, and the use of these error estimates for Quality Control. The temperature profile error estimates are used to determine a case-by-case characteristic pressure pbest, down to which the profile is considered acceptable for data assimilation purposes. The characteristic pressure p(sub best) is determined by comparing the case dependent error estimate (delta)T(p) to the threshold values (Delta)T(p). The AIRS Version 5 data set provides error estimates of T(p) at all levels, and also profile dependent values of pbest based on use of a Standard profile dependent threshold (Delta)T(p). These Standard thresholds were designed as a compromise between optimal use for data assimilation purposes, which requires highest accuracy (tighter Quality Control), and climate purposes, which requires more spatial coverage (looser Quality Control). Subsequent research using Version 5 sounding and error estimates showed that tighter Quality Control performs better for data assimilation proposes, while looser Quality Control better spatial coverage) performs better for climate purposes. We conducted a number of data assimilation experiments using the NASA GEOS-5 Data Assimilation System as a step toward finding an optimum balance of spatial coverage and sounding accuracy with regard to improving forecast skill. The model was run at a horizontal resolution of 0.5 degree latitude x 0.67 degree longitude with 72 vertical levels. These experiments were run during four different seasons, each using a different year. The AIRS temperature profiles were presented to the GEOS-5 analysis as rawinsonde profiles, and the profile error estimates (delta)T(p) were used as the uncertainty for each measurement in the data assimilation process.

Susskind, Joel↗

The Effect of Agricultural Growing Season Change on Market Prices in Africa

Local agricultural production is a key element of food security in many agricultural countries in Africa. Climate change and variability is likely to adversely affect these countries, particularly as they affect the ability of smallholder farmers to raise enough food to feed themselves. Seasonality influences farmers' decisions about when to sow and harvest, and ultimately the success or failure of their crops. At a 2009 conference in the United Kingdom hosted by the Institute of Development Studies, Jennings and Magrath (2009) described farmer reports from East Asia, South Asia, Southern Africa, East Africa and Latin America. Farmers indicate significant changes in the timing of rainy seasons and the pattern of rains within seasons, including: More erratic rainfall, coming at unexpected times in and out of season; Extreme storms and unusually intense rainfall are punctuated by longer dry spells within the rainy season; Increasing uncertainty as to the start of rainy seasons in many areas; Short or transitional second rainy seasons are becoming stronger than normal or are disappearing altogether. These farmer perceptions of change are striking in that they are geographically widespread and are remarkably consistent across diverse regions (Jennings and Magrath, 2009). The impact of these changes on farmers with small plots and few resources is large. Farming is becoming riskier because of heat stress, lack of water, pests and diseases that interact with ongoing pressures on natural resources. Lack of predictability in the start and length of the growing season affects the ability of farmers to invest in appropriate fertilizer levels or improved, high yielding varieties. These changes occur at the same time as the demand for food is rising and is projected to continue to rise for the next fifty years (IAASTD, 2008). Long-term data records derived from satellite remote sensing can be used to verify these reports, providing necessary analysis and documentation required to plan effective adaptation strategies. Remote sensing data can also provide some understanding of the spatial extent of these changes and whether they are likely to continue. Given the agricultural nature of most economies on the African continent, agricultural production continues to be a critical determinant of both food security and economic growth (Funk and Brown, 2009). Crop phenological parameters, such as the start and end of the growing season, the total length of the growing season, and the rate of greening and senescence are important for planning crop management, crop diversification, and intensification. The World Food Summit of 1996 defined food security as: "when all people at all times have access to sufficient, safe, nutritious food to maintain a healthy and active life". Food security roughly depends on three factors: 1) availability of food; 2) access to food and 3) appropriate use of food, as well as adequate water and sanitation. The first factor is dependent on growing conditions and weather and climate. In a previous paper we have investigated this factor by evaluating the effect of large scale climate oscillation on land surface phenology (Brown et al., 2010). We found that all areas in Africa are significantly affected by at least one type of large scale climate oscillations and concluded that these somewhat predictable oscillations could perhaps be used to forecast agricultural production. In addition, we have evaluated changes in agricultural land surface phenology over time (Brown et al., 2012). We found that land surface phenology models, which link large-scale vegetation indices with accumulated humidity, could successfully predict agricultural productivity in several countries around the world. In this chapter we are interested in the effect of variability in peak timing of the growing season, or phenology, on the second factor of food security, food access. In this chapter we want to determine if there is a link between market prices and land surface phenology and to determine which markets are vulnerable to land surface phenology changes and variability and which market prices are not correlated.

Prices↗

A Single-column Model Ensemble Approach Applied to the TWP-ICE Experiment

Single-column models (SCM) are useful test beds for investigating the parameterization schemes of numerical weather prediction and climate models. The usefulness of SCM simulations are limited, however, by the accuracy of the best estimate large-scale observations prescribed. Errors estimating the observations will result in uncertainty in modeled simulations. One method to address the modeled uncertainty is to simulate an ensemble where the ensemble members span observational uncertainty. This study first derives an ensemble of large-scale data for the Tropical Warm Pool International Cloud Experiment (TWP-ICE) based on an estimate of a possible source of error in the best estimate product. These data are then used to carry out simulations with 11 SCM and two cloud-resolving models (CRM). Best estimate simulations are also performed. All models show that moisture-related variables are close to observations and there are limited differences between the best estimate and ensemble mean values. The models, however, show different sensitivities to changes in the forcing particularly when weakly forced. The ensemble simulations highlight important differences in the surface evaporation term of the moisture budget between the SCM and CRM. Differences are also apparent between the models in the ensemble mean vertical structure of cloud variables, while for each model, cloud properties are relatively insensitive to forcing. The ensemble is further used to investigate cloud variables and precipitation and identifies differences between CRM and SCM particularly for relationships involving ice. This study highlights the additional analysis that can be performed using ensemble simulations and hence enables a more complete model investigation compared to using the more traditional single best estimate simulation only.

numerical weather forecasting↗

NASA Earth Systems Digital Twins (ESDT)

"Similarly to artificial intelligence, which is now revolutionizing many aspects of our daily lives, Earth system digital twin technologies have the potential to revolutionize the way Earth Science research will be conducted in the future, and how results and knowledge from this research will provide information to support decision making and yield impactful societal benefits. An Earth System Digital Twin or ESDT is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system as accurately and timely as possible; second, allows for computing forecasts of future states under nominal assumptions and based on the current replica; and third, offers the capability to investigate many hypothetical scenarios under varying impact assumptions. In other words, an ESDT provides the integrated What-Now, What-Next, and What-If pictures of the Earth or Earth system, by continuously ingesting newly observed data and by leveraging multiple interconnected models, machine learning as well advanced computing and visualization capabilities. Digital twins have been developed in engineering since 2002, but the interest in digital twins for the Earth domain is more recent and stems from the convergence of several developments: - The huge amount of diverse data that has now been collected continuously for more than 50 years, and that is becoming more and more difficult to access, understand, and utilize. - At the same time, because of climate change and its impacts the information produced by all of this data is becoming of interest to many new non-traditional users for analyzing and predicting various phenomena. - Because of advances in computational and visualization capabilities and the parallel unprecedented development of machine learning (ML), extracting relevant information from these large amounts of data and running complex models faster has become possible. As a result, it is becoming necessary and possible to build intuitive and interactive frameworks that will enable users with various skill levels and/or organizational hierarchy levels to easily access large amounts of targeted information along with the relevant tools and models (Earth system and human activity models), to support them in analyzing and visualizing this information, to help them understand interactions among models, to visualize the potential outcomes of various impacts, and to support decision or policy making. The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. With all these interests at stake, the challenges of building optimal digital twins are many and complex. The first challenge is to determine if a Digital Twin should be global or local, and multi-domain or thematic. For example, some domains such as Climate or Weather will require a global Digital Twin or Digital Twin capabilities while science areas such as Biodiversity might be more local. We can also envision that multiple thematic ESDTs, e.g., Air Quality, Wildfires, Hydrology could be federated or provide input to other ESDTs, either on a regional level or to a more global ESDT. Overall, we can imagine a future “web” of Digital Twins co-existing in a hierarchy or in a network, and capable of being connected or federated depending on the needs. This last point brings up the very important challenge of interoperability, including standards and protocols that will need to be built into these systems from the beginning. Each individual digital twin would have full flexibility in internal construction but would need standards-based interfaces (input and output) or hooks to make it compatible with others. Another challenge when building digital twins will be to decide how to organize each digital replica. Based on the applications targeted by the DT under implementation, various amounts and types of raw data, Analysis Ready Data (ARD) and information will need to be incorporated. Depending on the required latencies and needs of the users, various solutions can be considered, including Data Cubes, Data Lakes, pointers, or computing information on demand. We envision that each ESDT will choose a solution adapted to its specific objectives. Another important challenge is the type(s) of visualization that will be used, as well as the level of interactivity and refresh rate that will be required. Again, this will depend on the objectives of the ESDT, but also on the various users’ needs. In most cases, several types of visualizations and human interfaces will need to be offered depending on the projected users of that system. In parallel to the challenges highlighted above, there are also many tools and technologies that will need to be developed or improved for all types of digital twins. Among those are improved machine learning technologies, for example providing explainability, but also ML techniques for causality and providing a better integration of physics models. Additionally, reliable uncertainty quantification methods will be needed for all ESDT components, from validating data fusion and assimilation to assessing the accuracy of ML models and weighing the values of decisions supported by those systems. This presentation introduces the ESDT concept, presents several ESDT use cases, and a proposed ESDT architecture framework, as well as various technologies being developed by the Advanced Information Systems Technology (AIST) Program."

Earth Science Remote Sensing; Information Systems↗