Search NASA⌕ Search

SEARCH · Search NASA

Results for “earth observation data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

deadtrees.earth — An open-access and interactive database for centimeter-scale aerial imagery to uncover global tree mortality dynamics

Excessive tree mortality is a global concern and remains poorly understood as it is a complex phenomenon. We lack global and temporally continuous coverage on tree mortality data. Ground-based observations on tree mortality, e.g., derived from national inventories, are very sparse, and may not be standardized or spatially explicit. Earth observation data, combined with supervised machine learning, offer a promising approach to map overstory tree mortality in a consistent manner over space and time. However, global-scale machine learning requires broad training data covering a wide range of environmental settings and forest types. Low altitude observation platforms (e.g., drones or airplanes) provide a cost-effective source of training data by capturing high-resolution orthophotos of overstory tree mortality events at centimeter-scale resolution. Here, we introduce deadtrees.earth, an open-access platform hosting more than two thousand centimeter-resolution orthophotos, covering more than 1,000,000 ha, of which more than 58,000 ha are manually annotated with live/dead tree classifications. This community-sourced and rigorously curated dataset can serve as a comprehensive reference dataset to uncover tree mortality patterns from local to global scales using space-based Earth observation data and machine learning models. This will provide the basis to attribute tree mortality patterns to environmental changes or project tree mortality dynamics to the future. The open nature of deadtrees.earth, together with its curation of high-quality, spatially representative, and ecologically diverse data will continuously increase our capacity to uncover and understand tree mortality dynamics.

Citizen science↗
DOE OSTI2020

Earth as an Exoplanet. I. Time Variable Thermal Emission Using Spatially Resolved Moderate Imaging Spectroradiometer Data

Among the more than 4000 exoplanets known today, some terrestrial planets have been detected in the so-called habitable zone of their host stars and their number is expected to increase in the near future, energizing a drive to understand and interpret the eagerly awaited wealth of data to identify signs of life beyond our solar system. So far, Earth remains the best and only example of a habitable (and inhabited) world. Although, it seems extremely unlikely that any other exoplanets will be true Earth twins, it is important to explore and understand the full range of spectral signatures and variability of Earth in order to inform the design of future instruments and missions, and understand their diagnostic power as well as potential limitations. In this work we use Earth observation data collected by the MODIS instrument aboard the Aqua satellite. The complete data set comprises 15 years of thermal emission observations in the 3.66–14.40 μm range for five different locations on Earth (Amazon Rainforest, Antarctica, Arctic, Indian Ocean, and the Sahara Desert). We then determine flux levels and variations as a function of wavelength and surface type (i.e., climate zone and surface thermal properties) and investigate whether periodic signals indicating Earth’s tilted rotation axis can be detected. Our findings suggest that (1) viewing geometry plays an important role when thermal emission data is analyzed as Earth’s spectrum varies by a factor of three and more depending on the dominant surface type underneath; (2) typically strong absorption bands from CO 2 (15 μm) and O 3 (9.65 μm) are significantly less pronounced and partially absent in data from the polar regions implying that estimating correct abundance levels for these molecules might be challenging in these cases; and (3) the time-resolved thermal emission spectrum encodes information about seasons/planetary obliquity, but the significance depends on the viewing geometry and spectral band considered.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

The Trillion Pixel GeoAI Challenge Workshop

Rapid innovations in satellite and airborne remote sensing capabilities holds the promise of collecting high-resolution imagery with daily, even hourly cadence across the entire planet. Availability of such earth observation data streams at varying spatial and temporal scales, coupled with astonishing progress in AI and transformational advances in high performance computing bring into view the possibility of mapping and interpreting the surface of our planet at unprecedented detail. The implications of such capability for science, technology, policy, and security are far reaching. Moreover, even at a modest 5m resolution, 100 trillion pixels will describe the surface of the Earth every day. Consequently, monitoring the pulse of our planet will entail collecting, refining, analyzing, and curating those 100 trillion pixels within a 24-hour period. That is a challenge with unknown solutions as of today’s advances and therefore serves as a key motivation for this workshop. The GEOINT and AI communities have a unique opportunity to enable detailed monitoring the pulse of our planet and obtain new insights into how humans occupy, interact with, and alter the surface of the Earth over time. From a science and technology standpoint, this is a modern-day moonshot that presents numerous challenges particularly related to scaling the analysis to every pixel covering the planet. The challenge of making sense of all these pixels in a timely fashion include image processing at scale, selective analysis of only the pixels that matter, generalizing AI models across heterogeneous locations, computing on hardware that is memory constrained, and deploying automated feature extraction on edge devices. The designing of capable GeoAI workflows and data pipelines will require interdisciplinary efforts and partnerships. The Trillion Pixel Challenge for GeoAI workshop was is promoted as a first community effort to discuss priority research and development directions and to establish the partnerships and collaborations needed to make progress on critical scientific and operational applications from local to regional to planet scale.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Scaling carbon fluxes from eddy covariance sites to globe: synthesis and evaluation of the FLUXCOM approach

FLUXNET comprises globally distributed eddy-covariance-based estimates of carbon fluxes between the biosphere and the atmosphere. Since eddy covariance flux towers have a relatively small footprint and are distributed unevenly across the world, upscaling the observations is necessary to obtain global-scale estimates of biosphere–atmosphere exchange. Based on cross-consistency checks with atmospheric inversions, sun-induced fluorescence (SIF) and dynamic global vegetation models (DGVMs), here we provide a systematic assessment of the latest upscaling efforts for gross primary production (GPP) and net ecosystem exchange (NEE) of the FLUXCOM initiative, where different machine learning methods, forcing data sets and sets of predictor variables were employed. Spatial patterns of mean GPP are consistent across FLUXCOM and DGVM ensembles (R 2 >0.94 at 1° spatial resolution) while the majority of DGVMs show, for 70 % of the land surface, values outside the FLUXCOM range. Global mean GPP magnitudes for 2008–2010 from FLUXCOM members vary within 106 and 130 PgC yr -1 with the largest uncertainty in the tropics. Seasonal variations in independent SIF estimates agree better with FLUXCOM GPP (mean global pixel-wise R 2 ~0.75) than with GPP from DGVMs (mean global pixel-wise R 2 ~0.6). Seasonal variations in FLUXCOM NEE show good consistency with atmospheric inversion-based net land carbon fluxes, particularly for temperate and boreal regions (R 2 >0.92). Interannual variability of global NEE in FLUXCOM is underestimated compared to inversions and DGVMs. The FLUXCOM version which also uses meteorological inputs shows a strong co-variation in interannual patterns with inversions (R 2 =0.87 for 2001–2010). Mean regional NEE from FLUXCOM shows larger uptake than inversion and DGVM-based estimates, particularly in the tropics with discrepancies of up to several hundred grammes of carbon per square metre per year. These discrepancies can only partly be reconciled by carbon loss pathways that are implicit in inversions but not captured by the flux tower measurements such as carbon emissions from fires and water bodies. We hypothesize that a combination of systematic biases in the underlying eddy covariance data, in particular in tall tropical forests, and a lack of site history effects on NEE in FLUXCOM are likely responsible for the too strong tropical carbon sink estimated by FLUXCOM. Furthermore, as FLUXCOM does not account for CO 2 fertilization effects, carbon flux trends are not realistic. Overall, current FLUXCOM estimates of mean annual and seasonal cycles of GPP as well as seasonal NEE variations provide useful constraints of global carbon cycling, while interannual variability patterns from FLUXCOM are valuable but require cautious interpretation. Exploring the diversity of Earth observation data and of machine learning concepts along with improved quality and quantity of flux tower measurements will facilitate further improvements of the FLUXCOM approach overall.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Integrated Model of Models for Global Flood Alerting

A dramatic increase in frequency of minor to major flooding since 2000 has caused significant economic losses across the world. To mitigate and recover from these losses, actions have been taken to build resilient communities and infrastructures, specifically, by providing situational awareness in near real-time about flood impacts to enhance response and recovery efforts. Several hydrologic and hydraulic flood models are available at various spatial and temporal resolutions to forecast flood events at regional to global scale. Given the global coverage of two operational flood models – GloFAS (Global Flood Awareness System) and GFMS (Global Flood Monitoring System), the purpose of this project is to implement a Model of Models (MoM) approach to integrate the outputs from these two models to classify flood severity at watershed level worldwide, and send alerts based on severity similar to the USGS PAGER (used for severity alerting and impact analysis for earthquakes) to flood impacted communities. The alerts containing flood impacts and severity information will be disseminated through the DisasterAWARE platform, operated by the Pacific Disaster Center (PDC), that provides global multi-hazard alerting and Situational Awareness information to the emergency management community and public. The current version of the MoM approach was implemented for a case study flood event that occurred during January and February of 2020 in South and Central Africa. The findings of the case study event reveal that the approach is effective in identifying potential flood impact areas and the spatio-temporal variation of flood severity, flood depth and extent at watershed level, which will be used to assess infrastructure and societal impacts using earth-observation data and for alerting.

Kar, Bandana↗
DOE OSTI2020

DisasterAWARE – A Global Alerting Platform for Flood Events

The rising number of flooding events combined with increased urbanization is contributing to significant economic losses due to damages to structures and infrastructures. From a risk reduction and resilience perspective, it is not only essential to forecast flood risk and potential impacts, but also to disseminate the information to stakeholders on the ground for rapid implementation of mitigation and response measures. This paper provides (i) an introduction to DisasterAWARE®, a global alerting system, that is used to disseminate flood risk information to stakeholders across the globe, and (ii) a discussion of the models implemented using earth observation data (Synthetic Aperture Radar and optical imagery) for near real-time assessment of flood severity and potential flood impacts to infrastructures. While the models are still in their nascent stage, a case study implementation of the models for the 2020 flooding event in Africa is presented to showcase the model integration with DisasterAWARE®.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

MOSAIC-CONUS: A Multimodal, Multi-Temporally Paired Dataset for Earth Sciences

Earth embeddings—vector representations of geographic locations indexed in space and time—are emerging as a unifying interface for geospatial AI. However, their quality depends not only on model design, but on how multimodal Earth observation (EO) data are spatially indexed, temporally aligned, and cross-modally associated during pretraining. We introduce MOSAIC-CONUS (Multimodal Observations with Spatially Aligned Imagery, Urban Points of Interest, In-Situ Measurements and Text Captions), a large-scale EO dataset over the contiguous United States, organized around 250,000 stratified point indices that serve as stable spatial keys across seven modalities: active radar, passive optical imagery, lidar-derived elevation, land cover, functional context, hydrometeorological measurements, and textual summaries. Unlike existing EO datasets, MOSAIC-CONUS introduces four contributions not jointly addressed in prior work: 1. an open-source, large-scale multimodal EO corpus structured around point-indexed data designed to support Earth embedding learning; 2. explicit radar-optical pairing tables spanning twelve temporal alignment regimes, formalizing cross-sensor alignment as a controllable variable for analyzing how temporal mismatch across modalities influences learned embeddings quality; 3. a benchmark suite spanning cross-modal retrieval, annual nightlights regression, and basin-held-out streamflow prediction, positioning MOSAIC-CONUS as a benchmark-ready resource for multimodal AI systems; and 4. a language-based embedding layer through co-registered textual summaries, enabling Earth embeddings to function as a queryable interface for agentic AI systems. The dataset and pairing protocols are publicly released.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Utilizing Earth Observations of Soil Freeze/Thaw Data and Atmospheric Concentrations to Estimate Cold Season Methane Emissions in the Northern High Latitudes

The northern wetland methane emission estimates have large uncertainties. Inversion models are a qualified method to estimate the methane fluxes and emissions in northern latitudes but when atmospheric observations are sparse, the models are only as good as their a priori estimates. Thus, improving a priori estimates is a competent way to reduce uncertainties and enhance emission estimates in the sparsely sampled regions. Here, we use a novel way to integrate remote sensing soil freeze/thaw (F/T) status from SMOS satellite to better capture the seasonality of methane emissions in the northern high latitude. The SMOS F/T data provide daily information of soil freezing state in the northern latitudes, and in this study, the data is used to define the cold season in the high latitudes and, thus, improve our knowledge of the seasonal cycle of biospheric methane fluxes. The SMOS F/T data is implemented to LPX-Bern DYPTOP model estimates and the modified fluxes are used as a biospheric a priori in the inversion model CarbonTracker Europe-CH 4 . The implementation of the SMOS F/T soil state is shown to be beneficial in improving the inversion model’s cold season biospheric flux estimates. Our results show that cold season biospheric CH4 emissions in northern high latitudes are approximately 0.60 Tg lower than previously estimated, which corresponds to 17% reduction in the cold season biospheric emissions. This reduction is partly compensated by increased anthropogenic emissions in the same area (0.23 Tg), and the results also indicates that the anthropogenic emissions could have even larger contribution in cold season than estimated here.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Scaling Automatic Vector Data Alignment to Satellite Imagery

Given the tremendous volume of accessible Earth Observation (EO) data, there is a need to develop scalable Geospatial Artificial Intelligence (GeoAI) solutions for time-sensitive applications. Scalability in this context refers to rapidly processing large-scale EO data using high performance computing resources. Accurate mapping of the built environment from remote sensing (RS) imagery has been one of the crucial components in GeoAI workflows for a wide spectrum of humanitarian applications. Derived vector data of built environment is often leveraged for disaster preparedness and response activities. However, factors such as differences in ortho-rectification, atmospheric conditions and human error, results in spatial misalignment between vector data and the timely available RS imagery. Model training for downstream tasks such as object detection, change analysis, etc., is negatively impacted due to such spatial misalignment. Although there has been progress towards automatic alignment of vector data, the lack of scalability remains an open research challenge. This paper proposes to leverage parallel computing to optimize an automatic vector data alignment workflow. It further employs CPU-level multi-core parallelism for improving the performance of the workflow for scalable built environment mapping. We report observations and discuss findings from the preliminary experiments performed on the Summit Supercomputer.

Potnis, Abhishek↗
DOE OSTI2023

An Agenda for Multimodal Foundation Models for Earth Observation

Archives of remote sensing (RS) data are increasing swiftly as new sensing modalities with enhanced spatiotemporal resolution become operational. While promising new breakthroughs, the sheer volume of RS archives stretches the limits of human analysts and existing AI tools, as most models are: i) limited to single data modalities; ii) task-specific; iii) heavily reliant on labeled data. The emerging Foundation Models (FMs) have the potential to address these limitations. Trained on vast unlabeled datasets through self-supervised learning, FMs enable generic feature extraction that facilitate specialization to a wide variety of downstream tasks. This paper describes a vision towards an FM for multimodal Earth Observation data (FM4EO), discussing key building blocks and open challenges. We put particular emphasis on multimodal reasoning, a topic underexplored in EO. Our ultimate goal is a practical path toward FM4EO with capacity to unlock breakthroughs in few-shot learning scenarios, multimodal geographic knowledge integration, synthesis, and hypothesis generation.

Ambrozio Dias, Philipe↗
DOE OSTI2025

Where to cool off: a geospatial framework for placement of cooling centers

Indoor cooling is essential to reduce heat stress and increase passive survivability during heatwaves. Although air conditioning (AC) is recommended for maintaining indoor thermal comfort, low- and medium-income households in the U.S. often do not own an AC and/or limit AC usage to reduce energy consumption and associated costs, thereby risking their health and safety. With the frequency and intensity of heatwaves increasing, cooling centers are considered an appropriate alternative to indoor cooling and a possible mitigation strategy to prevent adverse health impacts of heat exposure. However, these centers are limited in numbers and not always accessible. This requires (i) developing a geospatial framework using physical and social factors for optimal siting of cooling centers to meet future needs and (ii) ranking of existing and potential cooling centers (schools, libraries, religious institutions) based on their accessibility among vulnerable populations and proximity to healthcare facilities. We developed and deployed a geospatial framework based on the Multi-criteria Decision Analysis approach in five U.S. cities (Los Angeles (LA), Phoenix, Austin, Atlanta, Miami) to evaluate the effectiveness of the framework in ranking cooling centers based on accessibility and population coverage. The results revealed that (i) access to cooling centers varies across cities and 32.2–50.7% of centers are within walking distance of the most vulnerable populations, (ii) vulnerable populations exposed to Urban Heat Island (UHI) effects are more likely to experience energy burden, and (iii) about 21.2–49.4% of population with high energy burden have access to these centers. Considering that more cooling centers are needed to assist energy burdened households alleviate heat exposure impacts, the framework developed herein could be adapted to incorporate other factors (e.g. health impacts, policies) to assess site suitability of existing shelters, identify potential sites for new cooling centers, and geo-target communities where energy efficient emerging technologies could be deployed to reduce heat stress.

58 GEOSCIENCES↗
DOE OSTI2022

Comparison of scattering ratio profiles retrieved from ALADIN/Aeolus and CALIOP/CALIPSO observations and preliminary estimates of cloud fraction profiles

The space-borne active sounders have been contributing invaluable vertically resolved information of atmospheric optical properties since the launch of Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) in 2006. To build long-term records from space-borne lidars useful for climate studies, one has to understand the differences between successive space lidars operating at different wavelengths, flying on different orbits, and using different viewing geometries, receiving paths, and detectors. In this article, we compare the results of Atmospheric Laser Doppler INstrument (ALADIN) and Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) lidars for the period from 28 June to 31 December 2019. First, we build a dataset of ALADIN–CALIOP collocated profiles (Δdist<1°; Δtime<6 h). Then we convert ALADIN's 355 nm particulate backscatter and extinction profiles into the scattering ratio vertical profiles SR(z) at 532 nm using molecular density profiles from Goddard Earth Observing System Data Assimilation System, version 5 (GEOS-5 DAS). And finally, we build the CALIOP and ALADIN globally gridded cloud fraction profiles CF(z) by applying the same cloud detection threshold to the SR(z) profiles of both lidars at the same spatial resolution. Before comparing the SR(z) and CF(z) profiles retrieved from the two analyzed lidar missions, we performed a numerical experiment to estimate the best achievable cloud detection agreement CDA norm (z) considering the differences between the instruments. We define CDA norm (z) in each latitude–altitude bin as the occurrence frequency of cloud layers detected by both lidars, divided by a cloud fraction value for the same latitude–altitude bin. We simulated the SR(z) and CF(z) profiles that would be observed by these two lidars if they were flying over the same atmosphere predicted by a global model. By analyzing these simulations, we show that the theoretical limit for CDA$_{norm}^{theor}$(z) for a combination of ALADIN and CALIOP instruments is equal to 0.81±0.07 at all altitudes. In other words, 19 % of the clouds cannot be detected simultaneously by two instruments due to said differences. The analyses of the actual observed CALIOP–ALADIN collocated dataset containing ~78 000 pairs of nighttime SR(z) profiles revealed the following points: (a) the values of SR(z) agree well up to ~3 km height. (b) The CF(z) profiles show agreement below ~3 km, where ~80 % of the clouds detected by CALIOP are detected by ALADIN as expected from the numerical experiment. (c) Above this height, the CDA$_{norm}^{obs}$(z) reduces to ~50 %. (d) On average, better sensitivity to lower clouds skews ALADIN's cloud peak height in pairs of ALADIN–CALIOP profiles by ~0.5±0.6 km downwards, but this effect does not alter the heights of polar stratospheric clouds and high tropical clouds thanks to their strong backscatter signals. (e) The temporal evolution of the observed CDA$_{norm}^{obs}$(z) does not reveal any statistically significant change during the considered period. This indicates that the instrument-related issues in ALADIN L0/L1 have been mitigated, at least down to the uncertainties of the following CDA$_{norm}^{obs}$(z) values: 68±12 %, 55±14 %, 34±14 %, 39±13 %, and 42±14 % estimated at 0.75, 2.25, 6.75, 8.75, and 10.25 km, respectively.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

NCAR-RAL Surface Hydrometeorological Observation Network Data for LASSO-CACTI Overview Paper

This data set contains the 15 minute resolution surface meteorology and soils data from the 15 NCAR/RAL weather stations that were operated around central Argentina during the RELAMPAGO (Remote sensing of Electrification, Lightning, And Meso-scale/micro-scale Processes with Adaptive Ground Observations) Extended Observing Period (EOP). Data providence, citation, and acknowledgement This ARM data set is a copy of v1.0 of the NCAR data set obtained in June 2024 from https://doi.org/10.26023/KW8Z-F2WX-H0Y. The citation for the original data source is: Gochis, D., et al. 2019. NCAR-RAL Surface Hydrometeorological Observation Network Data. Version 1.0. UCAR/NCAR - Earth Observing Laboratory. https://doi.org/10.26023/KW8Z-F2WX-H0Y Accessed June 2024. In addition to the citation reference and any other acknowledgements, please acknowledge NCAR/EOL in your publications with text such as: “Data provided by NCAR/EOL under the sponsorship of the National Science Foundation. https://data.eol.ucar.edu/”

air temperature↗
DOE OSTI2022

Correction and calibration of atmospheric impact observations in GOES GLM data

The Earth's atmosphere is impacted daily by both meteoroids and artificial objects. Calibrated observations of the emitted light at sufficiently high sampling rates can enable or improve the estimation of impactor attributes such as size, cohesion, trajectory, and composition, but are difficult to obtain owing to the unpredictability, brevity, and high dynamic (brightness) range of impacts. Ground-based camera systems have successfully monitored small regions of the atmosphere at video frame rates and with limited radiometric capabilities, but most impacts occur over the 70% of the Earth's surface covered by water and are therefore missed by these networks. The Geostationary Lightning Mapper (GLM) instruments aboard Geostationary Operational Environmental Satellites 16 and 17 provide near-hemispherical coverage at 500 frames per second. These data have been shown to contain the signatures of many independently confirmed impacts, often from both viewing angles simultaneously, and constitute an observational resource that is currently unparalleled in the public domain. NASA's Asteroid Threat Assessment Project has implemented an automated impact detection pipeline that processes data from GLM daily. Given a detected impact, the GLM data contain a wealth of information for use in quantitative follow-up analyses. However, impact events differ from lightning in ways that violate key assumptions built into GLM's design. The result is that GLM's onboard processing introduces errors into pixel observations of impact events and the calibrated energies near the periphery of the detector may be substantially overestimated. We present methods for mitigating these and other issues to produce a data product more suitable for impact analyses than the existing GLM lightning product.

58 GEOSCIENCES↗
DOE OSTI2023

CERESMIP: a climate modeling protocol to investigate recent trends in the Earth's Energy Imbalance

The Clouds and the Earth's Radiant Energy System (CERES) project has now produced over two decades of observed data on the Earth's Energy Imbalance (EEI) and has revealed substantive trends in both the reflected shortwave and outgoing longwave top-of-atmosphere radiation components. Available climate model simulations suggest that these trends are incompatible with purely internal variability, but that the full magnitude and breakdown of the trends are outside of the model ranges. Unfortunately, the Coupled Model Intercomparison Project (Phase 6) (CMIP6) protocol only uses observed forcings to 2014 (and Shared Socioeconomic Pathways (SSP) projections thereafter), and furthermore, many of the ‘observed' drivers have been updated substantially since the CMIP6 inputs were defined. Most notably, the sea surface temperature (SST) estimates have been revised and now show up to 50% greater trends since 1979, particularly in the southern hemisphere. Additionally, estimates of short-lived aerosol and gas-phase emissions have been substantially updated. These revisions will likely have material impacts on the model-simulated EEI. We therefore propose a new, relatively low-cost, model intercomparison, CERESMIP, that would target the CERES period (2000-present), with updated forcings to at least the end of 2021. The focus will be on atmosphere-only simulations, using updated SST, forcings and emissions from 1990 to 2021. The key metrics of interest will be the EEI and atmospheric feedbacks, and so the analysis will benefit from output from satellite cloud observation simulators. The Tier 1 request would consist only of an ensemble of AMIP-style simulations, while the Tier 2 request would encompass uncertainties in the applied forcing, atmospheric composition, single and all-but-one forcing responses. We present some preliminary results and invite participation from a wide group of models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Accounting for Training Data Error in Machine Learning Applied to Earth Observations

Remote sensing, or Earth Observation (EO), is increasingly used to understand Earth system dynamics and create continuous and categorical maps of biophysical properties and land cover, especially based on recent advances in machine learning (ML). ML models typically require large, spatially explicit training datasets to make accurate predictions. Training data (TD) are typically generated by digitizing polygons on high spatial-resolution imagery, by collecting in situ data, or by using pre-existing datasets. TD are often assumed to accurately represent the truth, but in practice almost always have error, stemming from (1) sample design, and (2) sample collection errors. The latter is particularly relevant for image-interpreted TD, an increasingly commonly used method due to its practicality and the increasing training sample size requirements of modern ML algorithms. TD errors can cause substantial errors in the maps created using ML algorithms, which may impact map use and interpretation. Despite these potential errors and their real-world consequences for map-based decisions, TD error is often not accounted for or reported in EO research. Here we review the current practices for collecting and handling TD. We identify the sources of TD error, and illustrate their impacts using several case studies representing different EO applications (infrastructure mapping, global surface flux estimates, and agricultural monitoring), and provide guidelines for minimizing and accounting for TD errors. To harmonize terminology, we distinguish TD from three other classes of data that should be used to create and assess ML models: training reference data, used to assess the quality of TD during data generation; validation data, used to iteratively improve models; and map reference data, used only for final accuracy assessment. We focus primarily on TD, but our advice is generally applicable to all four classes, and we ground our review in established best practices for map accuracy assessment literature. EO researchers should start by determining the tolerable levels of map error and appropriate error metrics. Next, TD error should be minimized during sample design by choosing a representative spatio-temporal collection strategy, by using spatially and temporally relevant imagery and ancillary data sources during TD creation, and by selecting a set of legend definitions supported by the data. Furthermore, TD error can be minimized during the collection of individual samples by using consensus-based collection strategies, by directly comparing interpreted training observations against expert-generated training reference data to derive TD error metrics, and by providing image interpreters with thorough application-specific training. We strongly advise that TD error is incorporated in model outputs, either directly in bias and variance estimates or, at a minimum, by documenting the sources and implications of error. TD should be fully documented and made available via an open TD repository, allowing others to replicate and assess its use. To guide researchers in this process, we propose three tiers of TD error accounting standards. Finally, we advise researchers to clearly communicate the magnitude and impacts of TD error on map outputs, with specific consideration given to the likely map audience.

58 GEOSCIENCES↗
DOE OSTI2020

Arctic Tipping Points Triggering Global Change (LDRD Final Report)

The Arctic is warming and feedbacks in the coupled Earth system may be driving the Arctic to tipping events that could have critical downstream impacts for the rest of the globe. In this project we have focused on analyzing sea ice variability and loss in the coupled Earth system Summer sea ice loss is happening rapidly and although the loss may be smooth and reversible, it has significant consequences for other Arctic systems as well as geopolitical and economic implications. Accurate seasonal predictions of sea ice minimum extent and long-term estimates of timing for a seasonally ice-free Arctic depend on a better understanding of the factors influencing sea ice dynamics and variation in this strongly coupled system. Under this project we have investigated the most influential factors in accurate predictions of September Arctic sea ice extent using machine learning models trained separately on observational data and on simulation data from five E3SM historical ensembles. Monthly averaged data from June, July, and August for a selection of ice, ocean, and atmosphere variables were used to train a random forest regression model. Gini importance measures were computed for each input feature with the testing data. We found that sea ice volume is most important earlier in the season (June) and sea ice extent became a more important predictor closer to September. Results from this study provide insight into how feature importance changes with forecast length and illustrates differences between observational data and simulated Earth system data. We have additionally performed a global sensitivity analysis (GSA) using a fully coupled ultra- low resolution configuration E3SM. To our knowledge, this is the first global sensitivity analysis involving the fully-coupled E3SM Earth system model. We have found that parameter variations show significant impact on the Arctic climate state and atmospheric parameters related to cloud parameterizations are the most significant. We also find significant interactions between parameters from different components of E3SM. The results of this study provide invaluable insight into the relative importance of various parameters from the sea ice, atmosphere and ocean components of the E3SM (including cross-component parameter interactions) on various Arctic-focused quantities of interest (QOIs).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Explainable deep learning for insights in El Niño and river flows

The El Niño Southern Oscillation (ENSO) is a semi-periodic fluctuation in sea surface temperature (SST) over the tropical central and eastern Pacific Ocean that influences interannual variability in regional hydrology across the world through long-range dependence or teleconnections. Recent research has demonstrated the value of Deep Learning (DL) methods for improving ENSO prediction as well as Complex Networks (CN) for understanding teleconnections. However, gaps in predictive understanding of ENSO-driven river flows include the black box nature of DL, the use of simple ENSO indices to describe a complex phenomenon and translating DL-based ENSO predictions to river flow predictions. Here we show that eXplainable DL (XDL) methods, based on saliency maps, can extract interpretable predictive information contained in global SST and discover SST information regions and dependence structures relevant for river flows which, in tandem with climate network constructions, enable improved predictive understanding. Our results reveal additional information content in global SST beyond ENSO indices, develop understanding of how SSTs influence river flows, and generate improved river flow prediction, including uncertainty estimation. Observations, reanalysis data, and earth system model simulations are used to demonstrate the value of the XDL-CN based methods for future interannual and decadal scale climate projections.

54 ENVIRONMENTAL SCIENCES↗