Search NASA⌕ Search

SEARCH · Search NASA

Results for “Deep ensembles”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Uncertainty Quantification using Deep Ensembles for Decision Making in Cyber-Physical-Human Systems

In this paper and its companion, Differential Equation Approximation Using Gradient-Boosted Quantile Regression, Robison et al., we examine an approach to quantifying model uncertainty with the aim of increasing the trustworthiness of computational models in human-machine interactions. In Differential Equation Approximation Using Gradient-Boosted Quantile Regression, we focus on gradient-boosted decision trees, while in this one, we give more details about deep ensembles. Uncertainty quantification is crucial for building trustworthy autonomous decision-making agents in human-machine teams. There are two types of uncertainties: aleatoric and epistemic. The former is related to the inherent stochasticity (noise) of the process, whereas the latter is associated with the lack of knowledge or representation capability of models, such as neural networks. By lack of knowledge, we mean the model’s inability to accurately predict outputs for all possible inputs. The aleatory uncertainty can be estimated fairly easily with, for example, filters, whereas epistemic uncertainty is challenging to compute. This paper uses deep ensembles to quantify both aleatory and epistemic uncertainty. It can act as an uncertainty-aware surrogate transition model for decision-making frameworks. "Uncertainty-aware" means that the surrogate transition model should make predictions along with confidence in those predictions. In the context of decision-making, the transition models are ordinary differential equations (ODEs). Since ODEs can be simulated to make one-step or multi-step predictions, a good surrogate model for them should perform reasonably well in both modes. In a multi-step approach, the trajectory sampling method TS∞ was used to propagate uncertainty over multiple steps. The cartpole dynamical system was selected to demonstrate the ability of deep ensembles as good surrogate transition models for decision-making frameworks. The deep ensembles modeled the dynamics of cartpole ODEs and made uncertainty-aware predictions in single-step and multi-step transition modes.

CPH systems↗
NASA NTRS2020

Ensemble-Based Deep Learning for Estimating PM2.5 over California with Multisource Big Data Including Wildfire Smoke

Estimating PM2.5 concentrations and their prediction uncertainties at a high spatiotemporal resolution is important for air pollution health effect studies. This is particularly challenging for California, which has high variability in natural (e.g. wildfires, dust) and anthropogenic emissions, meteorology, topography (e.g. desert surfaces, mountains, snow cover) and land use.

air quality↗
NASA NTRS2021

Automated Data Accountability for Missions in Mars Rover Data

As the Mars Curiosity Rover transmits data to the JPL Ground Data System (GDS), it frequently observes data loss and corruption, requiring re-transmits from the rover and Ground Data System Analysts (GDSA) to monitor the downlink process. As new missions are launched, the GDSA team redistributes analysts to these new missions, causing shortages in previous missions. The GDSA team can significantly benefit from the automation and optimization of the downlink process of telemetry data. In fact, there is a need for a better understanding of why the data is corrupted, so that the GDSA team can best determine the root cause of the issues in the GDS. This paper presents machine learning and deep learning based approaches to automate and optimize the detection of data loss. We first created a pipeline to automatically accumulate data from the telemetry databases (MAROS, Telemetry Data Storage, and GDS Elastic Search Database) in the downlink process. With our newly created datasets, we perform feature selection to supplement the GDSA understanding of the downlink process and provide supplemental analysis on the importance of different features. We implement various machine learning and deep learning based models, including support vector machines, ensemble methods, and deep neural networks and evaluate their accuracies in identifying whether a downlink process is complete or incomplete. We utilize fast hyperparameter optimization methods that allow our models to quickly be re-trained, allowing them to quickly be tuned and optimized on daily incoming data in real time. This hyperparameter optimization also allows our methods to be quickly integrated into other JPL missions. Our results show that our best-performing machine learning and deep learning based models outperform the existing GDSA detection software by 6 accuracy points and can aid analysts by providing insights into the data accountability problem. Since these various machine learning and deep learning approaches vary significantly in interpretability, we provide a discussion on the tradeoffs between their performance and trustworthiness in helping detect issues in data transmission.

Divsalar, Dariush↗
NASA NTRSDate not supplied

DeepONet-Assisted Optimization of Surface Topography for Transition Delay in A Mach 4.5 Boundary Layer

We use deep learning, an ensemble variationaltechnique (EnVar), and direct numerical simulations(DNS) to design an optimal topography for a two-dimensional roughness element that delays the on-set of laminar-turbulent transition in a Mach 4.5 flat-plate boundary layer. Deep operator networks (Deep-ONets), which have the known ability to learn com-plex nonlinear operators within dynamical systems,are used for machine learning. For the baseline config-uration of a smooth flat plate, the second-mode wavesat the DNS inflow cause a quick nonlinear breakdownof the high-speed boundary layer within the computa-tional domain. Results reported in the present studyvalidate the ability of DeepONets to model the tran-sition delay via a given topography of the roughnesselement. The computing cost to optimize the rough-ness element for minimal skin-friction drag is substan-tially lowered by the DeepONets-based reduced-ordermodel. In comparison to the baseline method of EnVaroptimization based on DNS alone, the DeepONets-based EnVar optimizer is able to delay transition pastthe outflow boundary of the computational domainwhile utilizing almost 5–6 times fewer DNS.

Machine Learning↗
NASA NTRSDate not supplied

DeepONet-Assisted Optimization of Surface Topography for Transition Delay in a Mach 4.5 Boundary Layer

We use deep learning, an ensemble variational technique (EnVar), and direct numerical simulations(DNS) to design an optimal topography for a two-dimensional roughness element that delays the on-set of laminar-turbulent transition in a Mach 4.5 flat-plate boundary layer. Deep operator networks (DeepONets), which have the known ability to learn complex nonlinear operators within dynamical systems, are used for machine learning. For the baseline configuration of a smooth flat plate, the second-mode waves at the DNS inflow cause a quick nonlinear breakdown of the high-speed boundary layer within the computational domain. Results reported in the present study validate the ability of DeepONets to model the transition delay via a given topography of the roughness element. The computing cost to optimize the rough-ness element for minimal skin-friction drag is substantially lowered by the DeepONets-based reduced-order model. In comparison to the baseline method of EnVar optimization based on DNS alone, the DeepONets-based EnVar optimizer is able to delay transition past the outflow boundary of the computational domain while utilizing almost 5–6 times fewer DNS.

Machine Learning↗
NASA NTRSDate not supplied

Consistent Pixel Resolution Characterization of Deep Convective Clouds for Calibration

The NASA CERES project provides global TOA shortwave and longwave fluxes for climate monitoring and validation that spans over 20 years. CERES utilizes broadband fluxes derived from geostationary (GEO) imagers to estimate broadband fluxes between the CERES observations. In order for these fluxes to be viable, the GEO imager calibration must be stable over time. One such calibration method used by CERES is to evaluate ensemble sets of deep convective clouds (DCC) as invariant targets (IT) over time. DCC targets can also provide radiometric scaling between sensors. An international collaboration through GSICS is also evaluating the DCC-IT calibration methodology to provide consistent calibration coefficients across geostationary sensors. Tropical DCC are the coldest, brightest, and most Lambertian TOA Earth targets identified using a window channel brightness temperature threshold. The DCC-IT technique involves a large ensemble of TOA pixel-level reflectances, which are binned into probability density functions (PDF). The PDF structure dependency on sensor pixel resolution, which can vary greatly among sensors, is not well known. This study will identify the impact of pixel resolution on the DCC PDFs by aggregating VIIRS and Landsat OLI/TIRS pixel resolutions into various coarser pixel resolutions and comparing the shape and statistics of the resulting PDFs. This study should assist in mitigating the pixel resolution dependency in the DCC-IT approach for providing scaling factors between sensors.

Conor Haney↗
NASA NTRS1992

Infrared, microwave, and spaceborne radar simulations of a deep convective system using a 3-D cloud ensemble method

A 3D cloud model is used to simulate the storm structure, and the results are linked to microwave and infrared radiative transfer models for simulation of aircraft observations. Spaceborne radar data are also simulated along the aircraft flight track. The cloud and radiative model simulations are studied and compared with aircraft observations. The initial results indicate that the 3D cloud model is capable of simulating the major features of observed storm systems when given a representative atmospheric sounding to initialize the convective systems. The simulations of infrared and microwave radiances provide reasonably good comparisons with the observations.

Yeh, H.-Y. M.↗
NASA NTRS1984

Using GPS and VLBI technology to maintain 14 digit synchronization

To facilitate the navigation of spacecraft to the outer planets, Jupiter and beyond, the JPL-NASA Deep Space Network (DSN) has implemented three ensembles of atomic clocks at widely separated locations. These clocks must be maintained, synchronized, to with a few parts in 10 to the 13th power of each other and, the entire group must be maintained, to a lesser degree, in synchronism with Coordinated Universal Time (UTC)NBS/USNO. Over the last 1 1/2 years the DSN has been using Global Positioning Satellites (GPS) and Very Long Baseline Interferometry (VLBI) technology to perform these critical Frequency and Time (F&T) synchronization tasks. A year of F&T synchronization data collected from the intercomparison of 3 sets of cesium and hydrogen maser driven clock ensembles through the use of GPS and VLBI techniques are covered. Also covered, are some of the problems met and limitations of these two techniques at their present level of technology.

Ward, S. C.↗
NASA NTRS2023

Global and Zonal-Mean Hydrological Response to Early Eocene Warmth

Earth's hydrological cycle is expected to intensify in response to global warming, with a “wet-gets-wetter, dry-gets-drier” response anticipated over the ocean. Subtropical regions (∼15°–30°N/S) are predicted to become drier, yet proxy evidence from past warm climates suggests these regions may be characterized by wetter conditions. Here we use an integrated data-modeling approach to reconstruct global and zonal-mean rainfall patterns during the early Eocene (∼56–48 million years ago). The Deep-Time Model Intercomparison Project (DeepMIP) model ensemble indicates that the mid- (30°–60°N/S) and high-latitudes (>60°N/S) are characterized by a thermodynamically dominated hydrological response to warming and overall wetter conditions. The tropical band (0°–15°N/S) is also characterized by wetter conditions, with several DeepMIP models simulating narrowing of the Inter-Tropical Convergence Zone. However, the latter is not evident from the proxy data. The subtropics are characterized by negative precipitation-evaporation anomalies (i.e., drier conditions) in the DeepMIP models, but there is surprisingly large inter-model variability in mean annual precipitation (MAP). Intriguingly, we find that models with weaker meridional temperature gradients (e.g., CESM, GFDL) are characterized by a reduction in subtropical moisture divergence, leading to an increase in MAP. These model simulations agree more closely with our new proxy-derived precipitation reconstructions and other key climate metrics and imply that the early Eocene was characterized by reduced subtropical moisture divergence. If the meridional temperature gradient was even weaker than suggested by those DeepMIP models, circulation-induced changes may have outcompeted thermodynamic changes, leading to wetter subtropics. This highlights the importance of accurately reconstructing zonal temperature gradients when reconstructing past rainfall patterns.

Margot J. Cramwinckel↗
NASA NTRS2004

A Study of the Response of Deep Tropical Clouds to Mesoscale Processes: Sensitivities to Microphysics, Radiation, and Surface Fluxes - Part 2

The Goddard Cumulus Ensemble (GCE) model is used to examine the sensitivities of surface fluxes, explicit radiation, and ice microphysical processes on multi-day simulations of deep tropical convection over the Tropical Ocean Global Atmosphere Coupled Ocean-Atmosphere Response Experiment (TOGA COARE). The simulations incorporate large-scale advective temperature and moisture forcing, as well as large-scale momentum, that are updated every time step on a periodic lateral boundary grid. This study shows that when surface fluxes are eliminated, the mean atmosphere is much cooler and drier, convection and CAPE are much weaker, precipitation is less, and cloud coverage in stratiform regions much greater. Surface fluxes using the TOGA COARE flux algorithm are weaker than with the aerodynamic formulation, but closer to the observed fluxes. In addition, similar trends noted above for the case without surface fluxes are produced for the TOGA flux case, albeit to a much lesser extent. The elimination of explicit shortwave and longwave radiation is found to have only minimal effects on the mean thermodynamics, convection, and precipitation. However explicit radiation does have a significant impact on cloud temperatures and structure above 200 mb and on the overall mean vertical circulation. The removal of ice processes produces major changes in the structure of the cloud. Much of the liquid water is transported aloft and into anvils above the melting layer (600 mb), leaving narrow, but intense bands of rainfall in convective regions. The elimination of melting processes leads to greater hydrometeor mass below the melting layer, and produces a much warmer and moister boundary layer, leading to a greater mean CAPE. Finally, the elimination of the graupel species has only a small impact on mean total precipitation, thermodynamics, and dynamics of the simulation, but does produce much greater snow mass just above the melting layer. Some of these results differ from previous CRM studies of tropical systems, which is likely due to the type of simulated system, total time integration, and model setup.

Johnson, Daniel↗
NASA NTRS2009

Dynamics and Predictability of Hurricane Humberto (2007) Revealed from Ensemble Analysis and Forecasting

This study uses short-range ensemble forecasts initialized with an Ensemble-Kalman filter to study the dynamics and predictability of Hurricane Humberto, which made landfall along the Texas coast in 2007. Statistical correlation is used to determine why some ensemble members strengthen the incipient low into a hurricane and others do not. It is found that deep moisture and high convective available potential energy (CAPE) are two of the most important factors for the genesis of Humberto. Variations in CAPE result in as much difference (ensemble spread) in the final hurricane intensity as do variations in deep moisture. CAPE differences here are related to the interaction between the cyclone and a nearby front, which tends to stabilize the lower troposphere in the vicinity of the circulation center. This subsequently weakens convection and slows genesis. Eventually the wind-induced surface heat exchange mechanism and differences in landfall time result in even larger ensemble spread. 1

Sippel, Jason A.↗
NASA NTRS2019

Estimating Alpine Snow Depth by Combining Multi-Frequency Passive Radiance Observations with Ensemble Snowpack Modeling

This paper presents a physically-based snow depth retrieval algorithm adapted for deep mountainous snowpack and airborne multifrequency (10.7, 18.7, 37.0 and 89.0 GHz) passive microwave (PM) radiance observations from a single flight. The algorithm employs a single forecast-analysis cycle of a traditional sequential assimilation scheme. It uses an ensemble of multi-layer snowpack model runs to resolve snow microstructure and melt-refreeze crusts, andmicrowave radiative transfer models to relate snow properties to microwave measurements.Snow depth was retrieved at a 120 m spatial resolution over three 1 km2 Intensive Study Area (ISA) within the Rabbit Ears Meso-Cell Study Area (MSA) from the NASA Cold Land Processes Experiment (CLPX) in Colorado (United States) for one date in February 2003. When evaluated against in situ observations, root mean square error (RMSE) of the snow depth from the assimilation was 13.3 cm for areas with low (<5 %) forest cover, which was a reduction of 48 % in the RMSE compared with the modeled snow depth when the PM observations were not assimilated; indicating a ~5% relative error of the posterior snow depth with respect to the average snow depth (200 cm) measured at these pixels. For pixels with forest cover ranging from 5-15% and 15-30%, results were improved (R2 increased from 0.65 to 0.71 and from 0 to 0.38, respectively) by introducing a forest radiative transfer model during the assimilation.

Airborne Multifrequency↗
NASA NTRSDate not supplied

NASA’s Prototype Spectral Water Inversion Processor and Emulator (SWIPE): Towards Global Coastal and Inland Water Quality and Algal Biodiversity Monitoring

Degradation of Earth’s inland water resources due to anthropogenic perturbations and climate anomalies at both local and global scales continues to place human health at substantial risk. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This presentation will provide updates on NASA’s prototype open-source aquatic modeling platform, Spectral Water Inversion Processor and Emulator (SWIPE), which is a comprehensive, multi-faceted modeling platform for both forward and inverse modeling of diverse aquatic ecosystems from the benthos to top-of-atmosphere (TOA). SWIPE provides a cohesive application which leverages recent advancements in particle modeling, Big Data analytics, and machine learning to develop a high-fidelity synthetic training ground for sensitivity studies and algorithm development for multispectral or upcoming hyperspectral missions. Some of the prominent features of SWIPE to be discussed include: 1. Advanced hyperspectral modeling of globally diverse algal and non-algal particles using a novel two-layer coated sphere scattering model and radiative transfer modeling, 2. Massive, highly detailed synthetic spectral libraries of Analysis-Ready-Data (ARD) which include spectral libraries of particle microphysics, water biogeophysical and optical properties, as well as surface and TOA reflectances at 1 nm resolution, 3. An ensemble of pre-built analytic, machine learning, and deep learning inversion algorithms for various water quality and biodiversity related retrieval parameters and uncertainty quantification, 4. Sensor-agnostic water quality inversion at wide ranging spatial and spectral resolutions including a codebase for seamless application in the Google Earth Engine and NASA Earth Exchange (NEX) for planetary scale analysis. SWIPE will be a fully open-source platform based in python with comprehensive documentation, tutorials, and options for distributed computing on high performance computing clusters or on single, local machines. Further, we will discuss how we envision SWIPE contributing towards a global analysis of coastal and inland water quality dynamics.

top-of-atmosphere (TOA)↗
NASA NTRS2021

Evaluating the Large-Scale Hydrological Cycle Response within the Pliocene Model Intercomparison Project Phase 2 (PlioMIP2) Ensemble

The mid-Pliocene (∼3 Ma) is one of the most recent warm periods with high CO2 concentrations in the atmosphere and resulting high temperatures, and it is often cited as an analog for near-term future climate change. Here, we apply a moisture budget analysis to investigate the response of the large-scale hydrological cycle at low latitudes within a 13-model ensemble from the Pliocene Model Intercomparison Project Phase 2 (PlioMIP2). The results show that increased atmospheric moisture content within the mid-Pliocene ensemble (due to the thermodynamic effect) results in wetter conditions over the deep tropics, i.e., the Pacific intertropical convergence zone (ITCZ) and the Maritime Continent, and drier conditions over the subtropics. Note that the dynamic effect plays a more important role than the thermodynamic effect in regional precipitation minus evaporation (PmE) changes (i.e., northward ITCZ shift and wetter northern Indian Ocean). The thermodynamic effect is offset to some extent by a dynamic effect involving a northward shift of the Hadley circulation that dries the deep tropics and moistens the subtropics in the Northern Hemisphere (i.e., the subtropical Pacific). From the perspective of Earth's energy budget, the enhanced southward cross-equatorial atmospheric transport (0.22 PW), induced by the hemispheric asymmetries of the atmospheric energy, favors an approximately 1∘ northward shift of the ITCZ. The shift of the ITCZ reorganizes atmospheric circulation, favoring a northward shift of the Hadley circulation. In addition, the Walker circulation consistently shifts westward within PlioMIP2 models, leading to wetter conditions over the northern Indian Ocean. The PlioMIP2 ensemble highlights that an imbalance of interhemispheric atmospheric energy during the mid-Pliocene could have led to changes in the dynamic effect, offsetting the thermodynamic effect and, hence, altering mid-Pliocene hydroclimate.

mid-Pliocene↗
NASA NTRS2001

A Study of the Response of Deep Tropical Clouds to Mesoscale Processes: Modeling Strategies and Simulations of TOGA-COARE Convective Systems - Part 1

Interactions between deep tropical clouds over the western Pacific warm pool and the larger-scale environment are key to understanding climate change. Cloud models are an extremely useful tool in simulating and providing statistical information on heat and moisture transfer processes between cloud systems and the environment, and can therefore be utilized to substantially improve cloud parameterizations in climate models. In this paper, the Goddard Cumulus Ensemble (GCE) cloud-resolving model is used in multi-day simulations of deep tropical convective activity over the Tropical Ocean-Global Atmosphere Coupled Ocean-Atmosphere Response Experiment (TOGA COARE). Large-scale temperature and moisture advective tendencies, and horizontal momentum from the TOGA-COARE Intensive Flux Array (IFA) region, are applied to the GCE version which incorporates cyclical boundary conditions. Sensitivity experiments show that grid domain size produces the largest response to domain-mean temperature and moisture deviations, as well as cloudiness, when compared to grid horizontal or vertical resolution, and advection scheme. It is found that a minimum grid-domain size of 500 km is needed to adequately resolve the convective cloud features. The control experiment shows that the atmospheric heating and moistening is primarily a response to cloud latent processes of condensation/evaporation, and deposition/sublimation, and to a lesser extent, melting of ice particles. Air-sea exchange of heat and moisture is found to be significant, but of secondary importance, while the radiational response is small. The simulated rainfall and atmospheric heating and moistening, agrees well with observations, and performs favorably to other models simulating this case.

Johnson, Daniel E.↗
NASA NTRS2000

Numerical Simulations of TRMM LBA, TOGA, COARE, GATE, ARM and PRESTORM Convective Systems: Sensitivity tests on Microphysical Processes

The 3D Goddard Cumulus Ensemble (GCE) model was utilized to examine the behavior and response of simulated deep tropical cloud systems that occurred over the west Pacific warm pool region, the Atlantic ocean and the central United States. The periods chosen for simulation were convectively active periods during TOGA-COARE (February 22 1993, December 11-17, 1992; December 19-28, February 9-13, 1993), GATE (September 4, 1974), LBA (January 26 and February 23, 1998), ARM (1997 IOP) and PRESTORM (June 11, 1985). We will examine differences in the microphysics for both warm rain and ice processes (evaporation /sublimation and condensation/ deposition), Q1 (Temperature), Q2 (Water vapor) and Q3 (momentum both U and V) budgets for these three convective events from different large-scale environments. The contribution of stratiform precipitation and its relationship to the vertical shear of the large-scale horizontal wind will also be examined. New improvements to the GCE model (i.e., microphysics: 4ICE two moments and 3ICE one moment; advection schemes) as well as their sensitivity to the model results will be discussed. Preliminary results indicated that various microphysical schemes could have a major impact on stratiform formation as well as the size of convective systems. However, they do not change the major characteristics of the convective systems, such as: arc shape, strong rotational circulation on both ends of system, heavy precipitation along the leading edge of systems.

Tao, W.-K.↗
NASA NTRS2014

Using Ensemble Short-Term Initialized Coupled NASA GEOS5 Climate Model Integrations to Study Convective Bias Growth

The representation of convective processes, particularly deep convection in the tropics, remains a persistent problem in climate models. In fact structural biases in the distribution of tropical rainfall in the CMIP5 models is hardly different than that of the CMIP3 versions. Given that regional climate change at higher latitudes is sensitive to the configuration of tropical forcing, this persistent bias is a major issue for the credibility of climate change projections. In this study we use model output from integrations of the NASA Global Earth Observing System Five (GEOS5) climate modeling system to study the evolution of biases in the location and intensity of convective processes. We take advantage of a series of hindcast experiments done in support of the US North American Multi-Model Ensemble (NMME) initiative. For these experiments a nine-month forecast using a coupled model configuration is made approximately every five days over the past 30 years. Each forecast is started with an updated analysis of the ocean, atmosphere and land states. For a given calendar month we have approximately 180 forecasts with daily means of various quantities. These forecasts can be averaged to essentially remove "weather scales" and highlight systematic errors as they evolve. Our primary question is to ask how the spatial structure of daily mean precipitation over the tropics evolves from the initial state and what physical processes are involved. Errors in parameterized convection, various water and energy fluxes and the divergent circulation are found to set up on fast time scales (order five days) compared to errors in the ocean, although SST changes can be non-negligible over that time. For the month of June the difference between forecast day five versus day zero precipitation looks quite similar to the difference between the June precipitation climatology and that from the Global Precipitation Climatology Project (GPCP). We focus much of our analysis on the influence of SST gradients, associated PBL baroclinicity enabled by turbulent mixing, the ensuing PBL moisture convergence, and how changes in these processes relate to convective precipitation bias growth over this short period.

Cohen, Charlie↗