Search NASA⌕ Search

SEARCH · Search NASA

Results for “latent representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Automatic Detection and Classification of Aurora in THEMIS All‐Sky Images

We report a novel machine-learning algorithm for automatically detecting and classifying aurora in all–sky images (ASI) that is largely trained without requiring ground–truth labels. By including a small number of labeled images, we are able to automatically label all of the approximately 700 million images in the Time History of Events and Macroscale Interactions during Substorms (THEMIS) ASI data set from 2008 to 2022. We use a two–stage approach. In the first stage, we adapt the Simple framework for Contrastive Learning of Representations (SimCLR) algorithm to learn latent representations of THEMIS all–sky images. We then finetune a classifier network on the latent representations our model learns of the manually labeled Oslo aurora THEMIS (OATH) data set. We demonstrate that this two–stage approach achieves excellent classification results on data for which there is no current ML classification benchmark. The outcome of this work will facilitate efficient information retrieval for researchers interested in specific categories of aurora and will enable large scale statistical studies and machine learning analyses of THEMIS all–sky images that have not previously been possible. To demonstrate possible ways to utilize this database, we performed a statistical analysis of the occurrence rates of auroral labels with respect to solar wind parameters, interplanetary magnetic field vector, and geomagnetic indices. We further investigate the occurrence rates of auroral phenomena in the annotated data set and their geoeffectiveness by utilizing the co–located THEMIS ground magnetometer data set.

Jeremiah W Johnson↗

Quantum-Assisted Variational Segmentation for Image-to-Image Wildfire Detection Using Satellite Data

The quantum computing community has been searching for suitable applications to demonstrate the potential of near-term quantum devices. Quantum machine learning is a potential candidate, particularly using models that cannot be efficiently simulated with classical computers [1, 2]. This work focuses on a transition phase of quantum computers where the quantum machine learning model is still simulable classically but projected not to be simulable as the size of the model grows. Ultimately quantum computers may have advantages for high-dimensional real-world problems. Due to the limited number of qubits in current noisy intermediate-scale quantum (NISQ) devices, the direct application of quantum computers in high dimensional data is not feasible. To remedy this problem, an encoder-decoder architecture can be utilized. The encoder model would transform the high-dimensional data into a compact representation, to a level that small quantum computers can be used today (or in the near future), and the decoder would take the quantum processed outputs back to the high-dimensional space. Addressing the two challenges of quantum machine learning, this work investigates a hybrid supervised generative model with a quantum Ising Born machine embedded as the latent distribution. The model contains four main parts (Figure 1.a.): (1) a U-NET architecture responsible for learning segmentation flow, (2) a Prior network responsible for learning an encoded latent distribution of the input data, (3) a Born machine which represents the latent distribution, and (4) a Posterior network in charge of learning the joint encoded latent distribution of inputs and target data. The initial model, proposed by [3], is optimized by (1) maximizing the overlap of the prior and posterior latent distributions, and (2) minimizing the segmentation loss. The proposed model is designed to be investigated in a simulation environment applied to the real-world application of wildfire segmentation. Specifically, the model is designed to solve the patchy wildfire segmentations of Moderate Resolution Imaging Spectroradiometer (MODIS) by taking the MODIS observations and using Visible Infrared Imaging Radiometer Suite’s (VIIRS) consistent wildfire product as the target. The model solves patchy wildfire segmentations and provides insight into the epistemic errors sourced from model variation. The model utilizes the Born machine as a QUBO solver to represent the latent space as a Bernoulli distribution. The proposed configuration allows the variational segmentation model to leverage the true quantum probabilistic nature and derive a more expressive latent configuration, increasing the model performance in describing wildfire segmentations. The quantum probabilistic information of the Born machine is directly incorporated in the Kullback-Leibler divergence loss in the prior and posterior distributions, forcing the Bernoulli latent distribution to maximize the overlap of input and joint input-target distributions. The proposed model is then trained and compared with a baseline only consisting of direct Bernoulli latent distribution with no Born machine representing the latent space. The models are evaluated based on the segmentation metrics, such as precision, recall, intersect of union, with uncertainty boundaries accounting for the stochastic nature of the model. Our findings show that even in low latent-dimensional space (due to the limit in computational power of the classical quantum simulator), we are able to effectively capture the latent representation and hence the model performs better than the baseline. The findings are a projection for scaling the model into higher dimensional latent space with the Born machine surpassing the baseline performance. Figure 1. Sub-figure (a) demonstrates the architecture for the training phase. The model consists of a Prior and Posterior network that encode inputs and joint input-target data into compact representations, respectively. The Born machine represents the latent distribution, and the U-NET branch learns the segmentation patterns of the data. The stochasticity is introduced to the U-NET through its last layer to create meaningful but stochastic segmentations. Sub-figure (b) represents the inference phase where the model takes the stochastic behavior from the prior network and injects that into the U-NET. Each attempt of inference will generate different but similar segmentations from the same distribution of the wildfire event. REFERENCES [1] Coyle, B., Mills, D., Danos, V., & Kashefi, E. (2020). The Born supremacy: quantum advantage and training of an Ising Born machine. npj Quantum Information, 6(1), 1-11. [2] Liu, J. G., & Wang, L. (2018). Differentiable learning of quantum circuit born machines. Physical Review A, 98(6), 062324. [3] Kohl, S., Romera-Paredes, B., Meyer, C., De Fauw, J., Ledsam, J. R., Maier-Hein, K., ... & Ronneberger, O. (2018). A probabilistic u-net for segmentation of ambiguous images. Advances in neural information processing systems, 31.

quantum machine learning↗

Two-Layer Variable Infiltration Capacity Land Surface Representation for General Circulation Models

A simple two-layer variable infiltration capacity (VIC-2L) land surface model suitable for incorporation in general circulation models (GCMs) is described. The model consists of a two-layer characterization of the soil within a GCM grid cell, and uses an aerodynamic representation of latent and sensible heat fluxes at the land surface. The effects of GCM spatial subgrid variability of soil moisture and a hydrologically realistic runoff mechanism are represented in the soil layers. The model was tested using long-term hydrologic and climatalogical data for Kings Creek, Kansas to estimate and validate the hydrological parameters. Surface flux data from three First International Satellite Land Surface Climatology Project Field Experiments (FIFE) intensive field compaigns in the summer and fall of 1987 in central Kansas, and from the Anglo-Brazilian Amazonian Climate Observation Study (ABRACOS) in Brazil were used to validate the mode-simulated surface energy fluxes and surface temperature.

GENERAL CIRCULATION MODELS↗

High dimensional similarity search with quantum assisted variational autoencoder

Recent progress in quantum algorithms and hardware is indicator of the potential importance of quantum computing in the next future. However, finding suitable application areas remains an active area of research. Quantum machine learning [1] is touted as a potential approach to demonstrate quantum advantage within both the gate-model [2,3] and the adiabatic [4,5] schemes. For instance, the Quantum-assisted Variational Autoencoder (QVAE) [6] has been proposed as a quantum enhancement to the discrete VAE [7]. We extend on previous work and study the real-world applicability of a QVAE, specifically, for similarity search in large-scale high dimensional datasets. While similarity search algorithms are available for low dimensional datasets, scaling to billion-scale datasets with thousands of dimensions is non-trivial. We show how the latent-space representation of a QVAE can be used to construct a space-efficient search index. We back up our claims by experimental results which show a correlation between the Hamming distance in the embedded space and the Euclidean distance in the original space on the Moderate Resolution Imaging Spectroradiometer (MODIS) dataset. Further, we show real-world speedups compared to linear search and demonstrate memory efficient scaling to large-scale datasets.

Nicholas D Gao↗

High-Dimensional Similarity Search with Quantum-Assisted Variational Autoencoder

Recent progress in quantum algorithms and hardware indicates the potential importance of quantum computing in the near future. However, finding suitable application areas remains an active area of research. Quantum machine learning is touted as a potential approach to demonstrate quantum advantage within both the gate-model and the adiabatic schemes. For instance, the QVAE has been proposed as a quantum enhancement to the discrete VAE. We extend on previous work and study the real-world applicability of a QVAE by presenting a proof-of-concept for similarity search in large-scale high-dimensional datasets. While exact and fast similarity search algorithms are available for low dimensional datasets, scaling to high-dimensional data is non-trivial. We show how to construct a space-efficient search index based on the latent space representation of a QVAE. Our experiments show a correlation between the Hamming distance in the embedded space and the Euclidean distance in the original space on the MODIS dataset. Further, we find real-world speedups compared to linear search and demonstrate memory-efficient scaling to half a billion data points.

Data mining, similarity search, quantum machine le↗

A simple hydrologically based model of land surface water and energy fluxes for general circulation models

A generalization of the single soil layer variable infiltration capacity (VIC) land surface hydrological model previously implemented in the Geophysical Fluid Dynamics Laboratory (GFDL) general circulation model (GCM) is described. The new model is comprised of a two-layer characterization of the soil column, and uses an aerodynamic representation of the latent and sensible heat fluxes at the land surface. The infiltration algorithm for the upper layer is essentially the same as for the single layer VIC model, while the lower layer drainage formulation is of the form previously implemented in the Max-Planck-Institut GCM. The model partitions the area of interest (e.g., grid cell) into multiple land surface cover types; for each land cover type the fraction of roots in the upper and lower zone is specified. Evapotranspiration consists of three components: canopy evaporation, evaporation from bare soils, and transpiration, which is represented using a canopy and architectural resistance formulation. Once the latent heat flux has been computed, the surface energy balance is iterated to solve for the land surface temperature at each time step. The model was tested using long-term hydrologic and climatological data for Kings Creek, Kansas to estimate and validate the hydrological parameters, and surface flux data from three First International Satellite Land Surface Climatology Project Field Experiment (FIFE) intensive field campaigns in the summer-fall of 1987 to validate the surface energy fluxes.

Liang, XU↗

Analysis of Air-Sea Interactions in the NASA MERRA Product

Interactions between the ocean and atmosphere influence the global energy and water balance through the exchange of heat, moisture and momentum. These interactions occur over a wide range of space and time scales and need to be properly represented in climate and reanalysis simulations. This study focuses on the representation of the turbulent latent and sensible heat fluxes in the newly developed NASA Modern Era Retrospective-Analysis for Research and Applications (MERRA). It is shown that MERRA achieves realistic estimates of the turbulent fluxes for many space and time scales although some deficiencies are noted. Comparisons are made at high resolution temporal scales with measurements from several research vessels while long term comparisons are made with moored buoys. These results are contrasted with those from several other currently available reanalysis and satellite based products. The representation of feedbacks between the atmosphere and ocean area also examined through the use of simultaneous and lagged correlation analyses with particular focus on precipitation and sea surface temperature relationships. Together, these results demonstrate the consistency of the NASA MERRA product and its applicability for process studies across wide ranging scales of variability.

Roberts, J. Brent↗

Wildfire Segmentation From Remotely Sensed Data Using Quantum-Compatible Conditional Vector Quantized-Variational Autoencoders

Wildfires represent a critical environmental hazard with multifaceted implications for ecosystems, communities, and public health [1]. The escalating frequency and intensity of wildfires globally have intensified the urgency for robust segmentation methodologies to facilitate effective mitigation, response, and recovery strategies [2]. Accurate wildfire segmentation is pivotal for delineating fire boundaries, assessing progression patterns, and prioritizing resource allocation during emergency scenarios. Furthermore, precise segmentation enables stakeholders, including policymakers, environmental scientists, and emergency responders, to formulate evidence-based strategies, thereby minimizing socio-economic disruptions and ecological degradation. Consequently, advancing wildfire segmentation techniques through innovative technological interventions remains a paramount research imperative. Although foundational in wildfire segmentation, traditional deterministic models exhibit inherent limitations that compromise their efficacy in dynamic and uncertain environments. These models often operate on rigid algorithms prioritizing deterministic classifications, thereby overlooking the inherent complexities and uncertainties associated with wildfire behavior and satellite data variability. Such deterministic frameworks tend to produce oversimplified representations that fail to capture the intricate nuances of evolving fire dynamics, spatial heterogeneity, and environmental interactions [1]. Consequently, the deterministic approach’s propensity for uncertainty collapsing [1, 3] hampers the accuracy, reliability, and applicability of segmentation outcomes in real-world scenarios. Contrastingly, stochastic models offer a more nuanced and adaptable framework for wildfire segmentation. By integrating probabilistic elements into the modeling paradigm, stochastic approaches, particularly probabilistic approaches such as variational auto encoders (VAEs) [4], facilitate comprehensive uncertainty assessment, enabling researchers to quantify and incorporate uncertainties into segmentation outcomes effectively. This probabilistic nature empowers stochastic models to encapsulate variability, account for data inconsistencies, and adapt to evolving environmental conditions, enhancing segmentation accuracy, reliability, and robustness. Embracing stochastic methodologies thus catalyzes advancements in wildfire science by fostering a more holistic, adaptive, and resilient segmentation framework. Despite VAEs demonstrating significant promise in various applications, they come with inherent limitations that have garnered attention within the machine learning community. One of the primary drawbacks lies in their reliance on static priors, which essentially assume a fixed distribution for latent variables, thereby limiting the model’s flexibility to capture complex data structures effectively [5]. This static nature leads to suboptimal representations, especially when dealing with complex and high-dimensional data. Additionally, VAEs often struggle with generating sharp and realistic samples, a phenomenon commonly referred to as mode collapse [5, 7, 6]. Furthermore, the optimization process in VAEs, which involves balancing the reconstruction loss and the regularization term, can sometimes be challenging to fine-tune [7]. In recent efforts to address these shortcomings, alternative approaches like Vector Quantized Variational Auto encoders(VQ-VAEs) [7], address the challenges by incorporating discrete latent variables and leveraging techniques that enhance the quality and diversity of generated samples while maintaining efficient training dynamics. VQ-VAEs propose a dynamic prior distribution generation mechanism that diverges from the static priors commonly associated with traditional VAEs. This dynamic approach allows for more adaptive and context-aware latent variable representations, thereby potentially capturing complex data structures more effectively. Unlike autoregressive prior models such as PixelCNN, which, despite their ability to model dependencies across data dimensions, suffer from significant computational inefficiencies and lack flexibility in handling diverse datasets. In our work, we propose to use a generative quantum-compatible approach to help alleviate the shortcomings of autoregressive prior model in VQ-VAEs. Restricted Boltzmann Machines (RBMs) are a viable alternative prior model that can learn prior distributions in a faster and more flexible manner. In this research endeavor, we meticulously curate a state-of-the-art dataset leveraging satellite MODIS data in conjunction with VIIRS fire masks, derived from Fire Radiative Power (FRP), thereby encapsulating diverse wildfire scenarios and environmental contexts. We developed a conditional VQ-VAE architecture with the RBM prior model that is trained in a supervised manner for segmenting wildfire masks. This innovative approach synergistically harnesses deep learning capabilities, enabling the generation of segmentation maps characterized by heightened precision, granularity, and contextual relevance. Furthermore, replacing the autoregressive prior learning method proposed by the original VQ-VAE with a prior density approximation via quantum-compatible RBM facilitates expedited inference processes, augments flexibility in prior sampling, optimizes computational efficiency and establishes a groundbreaking benchmark in wildfire segmentation methodologies.

quantum machine learning↗

Effects of dynamic heat fluxes on model climate sensitivity Meridional sensible and latent heat fluxes

The high- and low-latitude radiative-dynamic (HLRD) climatic model of Wang et al. (1984) was used to study the effect of meridional heat (MH) fluxes on climate changes caused by increases of CO2 abundance and solar constant variations. However, the empirical MH parameterization of the HLRD model was replaced by physically based parameterization, which gives separate meridional sensible and latent heat fluxes and provides a complete representation of the dependence of the flux on the mean temperature field. Both parameterization methods yielded about the same changes in global mean surface temperature and ice line, and both produced only small changes in meridional temperature gradient, although the latter were even smaller with the physically based parameterizations. At any latitude, the hemispheric mean surface temperature, rather than MH fluxes, dominates the surface temperature changes.

Gutowski, W. J., Jr.↗

Assimilation of SMAP Observations Over Land Improves the Simulation and Prediction of Tropical Cyclone Idai

This work is focused on the role of soil moisture in the prediction of tropical cyclones (TCs) approaching land and after landfall. Soil moisture conditions can impact the circulation and structure of an existing tropical cyclone (TC) when part or all of the circulation is over land. For example, dry land surface conditions may lead to faster dissipation of a TC over land (often associated with changes in precipitation structure), whereas very wet conditions may help sustain or in rare cases re-intensify a TC. Moreover, the presence of strong soil moisture gradients may affect the symmetry and development of the TC circulation leading to changes in its over-land track. While the link between soil moisture conditions and TC evolution in proximity to land is relatively well understood in theory, applications of these findings in the context of numerical weather prediction (NWP) have been limited. Here we present a case study that explores the potential of improving TC predictions through an improved soil moisture initialization in an NWP framework. Specifically, we examine the impact of assimilating observations from the NASA Soil Moisture Active Passive (SMAP) mission into the NASA Goddard Earth Observing System (GEOS) global weather model on the prediction of South-West Indian Ocean TC Idai (2019). SMAP provides accurate L-band (1.4 GHz) brightness temperatures (Tb) observations that are sensitive to soil moisture globally and at high revisit times of 2-3 days. It has previously been shown that the assimilation of SMAP Tb observations significantly improves modeled land surface states. Thus, it is expected that SMAP can be used to constrain land surface initial conditions and potentially benefit TC forecasts. Here we present two sets of retrospective forecasts of TC Idai that are compared in an Observing System Experiment framework at ¼ degree resolution: (i) forecasts initialized from an analysis that is comparable to the GEOS operational analysis (without SMAP Tb assimilation) and (ii) forecasts initialized from an analysis that additionally assimilates SMAP brightness temperature observations over land using a weakly-coupled land analysis. We find that the assimilation of SMAP meaningfully improves the representation of TC Idai’s structure as well as the prediction of its intensity and track. The analyzed TC size, as measured by the wind speed radius, is improved by up to 18% in the analysis with SMAP assimilation relative to the control run. The forecast intensity error, measured against the observed intensity, is reduced by up to 23%. At the 1/4-degree resolution used here, GEOS unavoidably under-estimates TC intensity and over-estimates TC size. The SMAP assimilation therefore corrects the model in the right direction, leading to a storm that is more energetic and more compact. Furthermore, we find that the along-track forecast error is reduced by up to 34%, indicating a more accurate propagation speed, which is consistent with the fact that TC speed over land is strongly affected by surface processes. The impact of SMAP assimilation on the forecast cross-track error is neutral. Across the TC forecast skill metrics used here, the improvements from SMAP DA are largest at lead times of 36 to 72 hours, suggesting that the predictability of forecasts at shorter lead times may be dominated by short-term convective processes, while the land and its longer memory gains in importance as a source of predictability on a 2-3 day timescale. We further investigated the underlying mechanisms leading to the skill improvements from SMAP data assimilation by isolating the land areas that directly influence TC Idai using a back trajectory analysis. We find that the assimilation of SMAP leads to wetter soil moisture conditions that cause an increased latent heat flux, which ultimately results in TC analyzed representation that has higher column-integrated total moisture content and total energy compared to the analysis in the control run without SMAP assimilation. Overall, the results highlight that the assimilation of SMAP observations into a global numerical weather prediction model can lead to pronounced improvements of TC predictions. This is a crucial step towards a better mitigation of the socio-economic impact of landfalling TCs and thus safeguarding human lives. Finally, our study presents an event-based approach that assesses the impact of land data assimilation for a particular weather event rather than by globally averaging differences in skill. We argue that global skill assessments – while necessary – can mute the impact of land data assimilation, because the land’s influence on the atmosphere is constrained to certain locations and certain times. Instead, the event-based approach better highlights the true potential of land data assimilation in the context of NWP, especially for extreme events when accurate predictions are critical.

Jana Kolassa↗

Assimilation of SMAP Observations Over Land Improves the Simulation and Prediction of Tropical Cyclone Idai

This work is focused on the role of soil moisture in the prediction of tropical cyclones (TCs) approaching land and after landfall. Soil moisture conditions can impact the circulation and structure of an existing tropical cyclone (TC) when part or all of the circulation is over land. For example, dry land surface conditions may lead to faster dissipation of a TC over land (often associated with changes in precipitation structure), whereas very wet conditions may help sustain or in rare cases re-intensify a TC. Moreover, the presence of strong soil moisture gradients may affect the symmetry and development of the TC circulation leading to changes in its over-land track. While the link between soil moisture conditions and TC evolution in proximity to land is relatively well understood in theory, applications of these findings in the context of numerical weather prediction (NWP) have been limited. Here we present a case study that explores the potential of improving TC predictions through an improved soil moisture initialization in an NWP framework. Specifically, we examine the impact of assimilating observations from the NASA Soil Moisture Active Passive (SMAP) mission into the NASA Goddard Earth Observing System (GEOS) global weather model on the prediction of South-West Indian Ocean TC Idai (2019). SMAP provides accurate L-band (1.4 GHz) brightness temperatures (Tb) observations that are sensitive to soil moisture globally and at high revisit times of 2-3 days. It has previously been shown that the assimilation of SMAP Tb observations significantly improves modeled land surface states. Thus, it is expected that SMAP can be used to constrain land surface initial conditions and potentially benefit TC forecasts. Here we present two sets of retrospective forecasts of TC Idai that are compared in an Observing System Experiment framework at ¼ degree resolution: (i) forecasts initialized from an analysis that is comparable to the GEOS operational analysis (without SMAP Tb assimilation) and (ii) forecasts initialized from an analysis that additionally assimilates SMAP brightness temperature observations over land using a weakly-coupled land analysis. We find that the assimilation of SMAP meaningfully improves the representation of TC Idai’s structure as well as the prediction of its intensity and track. The analyzed TC size, as measured by the wind speed radius, is improved by up to 18% in the analysis with SMAP assimilation relative to the control run. The forecast intensity error, measured against the observed intensity, is reduced by up to 23%. At the 1/4-degree resolution used here, GEOS unavoidably under-estimates TC intensity and over-estimates TC size. The SMAP assimilation therefore corrects the model in the right direction, leading to a storm that is more energetic and more compact. Furthermore, we find that the along-track forecast error is reduced by up to 34%, indicating a more accurate propagation speed, which is consistent with the fact that TC speed over land is strongly affected by surface processes. The impact of SMAP assimilation on the forecast cross-track error is neutral. Across the TC forecast skill metrics used here, the improvements from SMAP DA are largest at lead times of 36 to 72 hours, suggesting that the predictability of forecasts at shorter lead times may be dominated by short-term convective processes, while the land and its longer memory gains in importance as a source of predictability on a 2-3 day timescale. We further investigated the underlying mechanisms leading to the skill improvements from SMAP data assimilation by isolating the land areas that directly influence TC Idai using a back trajectory analysis. We find that the assimilation of SMAP leads to wetter soil moisture conditions that cause an increased latent heat flux, which ultimately results in TC analyzed representation that has higher column-integrated total moisture content and total energy compared to the analysis in the control run without SMAP assimilation. Overall, the results highlight that the assimilation of SMAP observations into a global numerical weather prediction model can lead to pronounced improvements of TC predictions. This is a crucial step towards a better mitigation of the socio-economic impact of landfalling TCs and thus safeguarding human lives. Finally, our study presents an event-based approach that assesses the impact of land data assimilation for a particular weather event rather than by globally averaging differences in skill. We argue that global skill assessments – while necessary – can mute the impact of land data assimilation, because the land’s influence on the atmosphere is constrained to certain locations and certain times. Instead, the event-based approach better highlights the true potential of land data assimilation in the context of NWP, especially for extreme events when accurate predictions are critical.

Jana Kolassa↗

TPSAS-NF1676L-17931-DND

Many geophysical variables including temperature, clouds, and precipitation exhibit robust diurnal cycles in response to the daily cycle of solar insolation. Due to the fundamental nature of this variability, it is critical that weather and climate models accurately represent the diurnal cycle. Numerical model, however, have difficulty reproducing this observed diurnal cycle behavior, which leads to systematic errors in model representation of earth energy budget terms: including TOA and surface radiation, precipitation, and surface latent and sensible heat fluxes. This study evaluates the regional diurnal cycle in the Tropics within reanalysis models (ERA-Interim and MERRA) and quantifies systematic errors in the simulated TOA flux and precipitation due to biases in the diurnal cycle representation. The focus of this study is to quantify the importance of diurnal cycle simulation to systematic bias in reanalysis data set climatologies.

Patrick C Taylor↗

Machine Learning Explainability and Transferability for Path Navigation

Deep neural networks are powerful tools for machine perception. Unfortunately their decisions are difficult to explain due to the complexity and size of the networks. Previously we have alleviated this issue by using the representational portion of a deep neural network and combining it with a k-nearest neighbor (KNN) classifier. Through inspection of the decisions made by the KNN, we can directly see the training data responsible for the decisions, allowing us to determine the quality of the overall decision and the quality of the representational layer of the deep NN. While the technique worked well, it requires tens of thousands of latent vectors to be stored for classification. In addition, it lacks the ability to show how parts of an image influence the classification decision. Here we address these issues by 1) Using a radial basis function network (RBFN) in place of the KNN allowing far fewer images to be used in deployment and 2) Using an auto encoder network for explainability. In addition to these techniques, we examine the effects of transfer learning to determine that results are robust. All results are tested on a domain where an unmanned aerial vehicle (UAV) navigates a forest trail through a single camera.

explainable machine learning↗

Microphysics, Radiation and Surface Processes in the Goddard Cumulus Ensemble (GCE) Model

One of the most promising methods to test the representation of cloud processes used in climate models is to use observations together with Cloud Resolving Models (CRMs). The CRMs use more sophisticated and realistic representations of cloud microphysical processes, and they can reasonably well resolve the time evolution, structure, and life cycles of clouds and cloud systems (size about 2-200 km). The CRMs also allow explicit interaction between out-going longwave (cooling) and in-coming solar (heating) radiation with clouds. Observations can provide the initial conditions and validation for CRM results. The Goddard Cumulus Ensemble (GCE) Model, a CRM, has been developed and improved at NASA/Goddard Space Flight Center over the past two decades. The GCE model has been used to understand the following: 1) water and energy cycles and their roles in the tropical climate system; 2) the vertical redistribution of ozone and trace constituents by individual clouds and well organized convective systems over various spatial scales; 3) the relationship between the vertical distribution of latent heating (phase change of water) and the large-scale (pre-storm) environment; 4) the validity of assumptions used in the representation of cloud processes in climate and global circulation models; and 5) the representation of cloud microphysical processes and their interaction with radiative forcing over tropical and midlatitude regions. Four-dimensional cloud and latent heating fields simulated from the GCE model have been provided to the TRMM Science Data and Information System (TSDIS) to develop and improve algorithms for retrieving rainfall and latent heating rates for TRMM and the NASA Earth Observing System (EOS). More than 90 referred papers using the GCE model have been published in the last two decades. Also, more than 10 national and international universities are currently using the GCE model for research and teaching. In this talk, five specific major GCE improvements: (1) ice microphysics, (2) longwave and shortwave radiative transfer processes, (3) land surface processes, (4) ocean surface fluxes and (5) ocean mixed layer processes are presented. The performance of these new GCE improvements will be examined. Observations are used for model validation.

Tao, Wei-Kuo↗

Investigation of Aerodynamic and Radiometric Land Surface Temperatures

The surface temperature, T(sub s), of a land surface measured by a radiometer, T(sub s,r), and the temperature "felt" by the air, T(sub aero), often differ significantly and are difficult if not impossible to define rigorously. However, recent studies conducted by the principal investigators with several land surface models suggest that this problem can be largely resolved. The main goal of this project was to use model-based and empirical studies to improve understanding and reconcile the difference between T(sub s,r) and T(sub aero), while maintaining consistency within the models and with theory and data. The results from this effort have contributed progress towards the effective use of remotely sensed surface temperature measurements taken from an arbitrary view angle over a partial canopy cover for producing high quality sensible and latent heat flux estimates. In addition, we have developed parameterizations that are designed to improve the representation of the roughness length for heat in climate and mesoscale models. This not only provides improved representation of surface energy balance in such models, but should also facilitate the use of surface temperature measurements for validating or updating the surface temperature produced by SVATs (soil-vegetation-atmosphere schemes) in climate or mesoscale models.

Friedl, Mark↗

The Surface Heat Flux as a Function of Ground Cover for Climate Models

Surface heat fluxes were examined as a function of surface properties and meteorological conditions in a 100 km x 100 km grid square at 1-km spatial resolution centered at the location of the First ISLSCP (International Satellite Land Surface Climatology Project) Field Experiment (FIFE), the Forest Ecosystem Dynamics site in central Maine, and a semiarid rangeland site around Walnut Gulch, Arizona. This investigation treats the surface heat flux variability within a GCM grid box to provide insight into methods for treating that variability in climate models. The heat fluxes were calculated using NOAA AVHRR and available meteorological data. The average heat fluxes that were estimated using the various area ground-cover representations were compared with the ensemble average heat fluxes for the entire area, which were assumed to be the best representation of the heat fluxes for the areas. Average beat fluxes were estimated for the entire 100 km x 100 km area based on a single ground-cover representation, and the mean error for the area sensible heat flux was about 10% and for the area latent heat flux, 21%. The estimation error was reduced, and in some cases significantly reduced, when the area heat fluxes were estimated by partitioning the area according to significant ground cover. The most significant effect of the partitioning was on the latent heat flux estimates.

Vukovich, Fred M.↗

Assessment of surface turbulent fluxes using geostationary satellite surface skin temperatures and a mixed layer planetary boundary layer scheme

A method is presented for evaluating the fluxes of sensible and latent heating at the land surface, using satellite-measured surface temperature changes in a composite surface layer-mixed layer representation of the planetary boundary layer. The basic prognostic model is tested by comparison with synoptic station information at sites where surface evaporation climatology is well known. The remote sensing version of the model, using satellite-measured surface temperature changes, is then used to quantify the sharp spatial gradient in surface heating/evaporation across the central United States. An error analysis indicates that perhaps five levels of evaporation are recognizable by these methods and that the chief cause of error is the interaction of errors in the measurement of surface temperature change with errors in the assigment of surface roughness character. Finally, two new potential methods for remote sensing of the land-surface energy balance are suggested which will relay on space-borne instrumentation planned for the 1990s.

Diak, George R.↗

Exploring Semantic Search Capability of Graph Convolutions Over a Knowledge Graph Built Using Earth Science Corpora

Traditional knowledge graphs tend to be too generic, and often perform poorly on complex scientific queries. Often times, precedence is given to pop culture over scientific knowledge for queries. This is predominantly due to the use of internet sources for building the knowledge graph. With this work, we aim to explore the effectiveness of combining a knowledge graph generated from earth science corpora with a language model and graph convolutions for the purpose of surfacing latent and related sentences given a natural language query. In this model, sentences are conceptualized in the graph as nodes which are connected through entities—words and phrases of interest found in the text—extracted using Google Cloud’s entity extraction model. The language model we used for this is Bidirectional Encoder Representations from Transformers (BERT).The sentences are given a numeric representation by the BERT model. Graph convolutions are then applied to sentence embeddings in order to obtain a vector representation of the sentence as well as the surrounding graph structure, thereby leveraging the power of adjacency inherently encoded in graph structures. With this presentation, we demonstrate the ability of graph convolutions and their improved ability to surface relevant, latent information based on the subject of the input query.

Muthukumaran Ramasubramanian↗