Search NASA⌕ Search

SEARCH · Search NASA

Results for “hybrid cloud”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

SatCORPS Hybridized Cloud Product Data Storage: The Design of a Hybrid Data Repository That Leverages the Strengths of the Cloud and the Data Center

There is a strong demand for the near real time NASA Langley Satellite ClOud and Radiation Property retrieval System (SatCORPS) products. As important as real-time information, archived copies of the products form the basis for targeted research focusing on specific events or conditions. To make these SatCORPS products available for downloading, the SatCORPS group has developed a number of tools and technologies to create a hybrid data storage system that leverages the strengths of both cloud and on-premises resources. In this work, we describe the technologies the group uses to marshal disparate data repositories and materialize them into a single searchable overview and give a broad description of the organization of the dataset. As with any implementation, the strengths, weaknesses and constraints surrounding the components establish priorities and provide insight where trade-offs are necessary. We further describe the design and architecture underpinning our hybrid data repository and delivery system.

AWS↗

Cloud-Precipitation Hybrid Regimes and their Projection onto IMERG Precipitation Data

We extend and enhance the concept of the Cloud Regimes (CRs) developed from two-dimensional joint histograms of cloud optical thickness and cloud top pressure from the Moderate Resolution Imaging Spectroradiometer (MODIS), by adding precipitation information in order to better understand cloud-precipitation relationships. Taking advantage of the high-resolution Integrated Multi-satellitE Retrievals for GPM (IMERG) precipitation dataset, cloud-precipitation “hybrid” regimes are derived by implementing the k-means clustering algorithm with advanced initialization and objective measures to determine the most optimal clusters. By expressing precipitation rates within 1-degree grid cell as histograms and making choices on the relative weight of cloud and precipitation, we could obtain several editions of hybrid cloud-precipitation regimes (CPRs), and examine their characteristics. In the deep tropics, when precipitation is weighted weakly, the cloud part of the hybrid entroids resembles the centroid of cloud-only regimes, but still tightens the cloud-precipitation relationship by decreasing the precipitation variability of each regime. As precipitation weight progressively increases, the shape of the cloudy part of the hybrid centroids becomes blunter, while the precipitation part of the centroids sharpens. In the case where cloud and precipitation are weighted equally, the CPRs representing high clouds with intermediate to heavy precipitation exhibit distinct features in the precipitation parts of the centroids, which allows us to project them onto the 30-minly IMERG domain. Such a projection can be used to overcome the temporal sparseness of MODIS cloud observations, which leads to great application potential for various convection-focused studies, including diurnal cycle analysis.

cloud-precipitation↗

NREL's Journey with HPC in the Cloud and Hybrid Computing

This is a planned lightning talk at the NLIT Summit 2025 conference. This would serve as somewhat of a progress update to the presentation I gave at re:Invent 2024 back in November which can be seen here: https://www.youtube.com/watch?t=2133&v=NMq3kL9qObU&feature=youtu.be (my section begins at the included timestamp value). This presentation discusses our usage of Cloud-hosted HPC systems, and in what circumstances they benefit our researchers strategically. We have been making incremental progress in this area since that recording, so for this presentation I would include our latest experiences and observations as we are beginning to implement a hybrid HPC solution. We're in the midst of a cross-team effort of implementing a prototype hybridization solution which would allow users to strategically burst jobs to the cloud. In this talk for NLIT, I would detail lessons-learned, non-starters, architecture diagrams, and other implementation details that may benefit those interested as we continue our experimentation. Our prototype may not be complete by the time of this presentation, but even in the discovery phase of our anticipated design we've discovered a lot of information from others who have worked on hybrid solutions that are worth sharing.

97 MATHEMATICS AND COMPUTING↗

Quasi-Langrangian models of nascent thermals

The motions in and around an isolated thermal were studied and rising motion in the core, and sinking motion on the outside were found; while the circulation resembled that of a vortex ring. In an entity cloud model, cloudy thermal is tracked, in a Lagrangian fashion, as a discrete entity; the field of motion in and around the thermal is not explicitly simulated. Field of motion cloud models, in which the equations of motion are numerically integrated on an Eulerian grid were developed. It is shown that the great potential of a hybrid cloud model can combine the simplicity of the entity models with the generality and flexibility of the field-of-motion models. A key problem to be overcome in the development of a hybrid model is the formulation of a mathematical framework within which the cloud dynamics can be represented.

Rambaldi, S.↗

Creating Satellite Data Products in the Cloud: SatCORPS Global Cloud Composites

Real time satellite observations and real time derived cloud products are becoming an important tool for both science as well as business ventures. The SatCORPS group leverages public and private cloud-based sources of satellite observations to create its Global Cloud Composite product in near real-time. This dataset allows others access to cloud information that can be accessed directly from the cloud. In this work, we describe the software algorithms and software infrastructure that we have created to create and distribute this product through our hybrid cloud and on-premises system that leverages the strengths and weaknesses of each platform. We will also describe the GCC product itself in terms of the scientific parameters available, resolution and temporal availability. Finally, we will also describe our web-based tools including our Geographic Information System that can be used for visualization and analysis. The products from the processing can be geospatially-service enabled as ArcGIS Image Services and Open Geospatial Consortium (OGC) Web Mapping/Coverage Services for visualization and analysis via a web mapping application and common geospatial software. The SatCORPS Global Composite Cloud product provides sophisticated global cloud products with very low latency which we see that as filling a rapidly growing need in the research, modelling and business community. We present a detailed description of the SatCORPS GCC product in terms of the capabilities and research benefits as well as the delivery architecture in AWS. We take the discussion further and describe the web tools that the SatCORPS group has developed that allow users to access and use the GIS data that it creates.

Global Cloud Composite SatCORPS SMCE AWS↗

Utilization of Streamtubes to Analyze the Physical Interaction of a Dispersed Cloud with the CRM65 Hybrid Midspan Model

Recently there have been numerous efforts to identify the relevant icing physics related to the formation of complex three dimensional features, sometimes referred to as ’scallops’, on swept wings. However, much of the physics is still not well understood. This paper computationally investigates the interaction of the icing cloud with the 65 percent Common Research Model (CRM65). Both the interaction with an uniced model, and the interaction with a representative simulated three dimensional ice accretion are analyzed. Preliminary results suggest that the liquid water content increases near the aerodynamic body. For small droplets on the uniced geometry, the particle velocity vector becomes nearly parallel with the aerodynamic model resulting in a low value of collection efficiency. When a three dimensional feature with a length scale much smaller than the leading edge of the airfoil is introduced into the flow, the impingement of small particles can become significantly more perpendicular to the particle velocity vector in the region of these features. Since the liquid water content near the body has increased due to the interaction with the larger scale features of the aerodynamic model, i.e. the leading edge of the swept wing, extremely high collection efficiency is observed. These results suggest that three dimensional features are likely a significant physical driver that should be modeled in some capacity when simulating the impingement of a cloud on an aerodynamic model.

Icing↗

Utilization of Streamtubes to Analyze the Physical Interaction of a Dispersed Cloud with the CRM65 Hybrid Midspan Model

Recently there have been numerous efforts to identify the relevant icing physics related to the formation of complex three dimensional features, sometimes referred to as ’scallops’, on swept wings. However, much of the physics is still not well understood. This paper computationally investigates the interaction of the icing cloud with the 65 percent Common Research Model (CRM65). Both the interaction with an uniced model, and the interaction with a representative simulated three dimensional ice accretion are analyzed. Preliminary results suggest that the liquid water content increases near the aerodynamic body. For small droplets on the uniced geometry, the particle velocity vector becomes nearly parallel with the aerodynamic model resulting in a low value of collection efficiency. When a three dimensional feature with a length scale much smaller than the leading edge of the airfoil is introduced into the flow, the impingement of small particles can become significantly more perpendicular to the particle velocity vector in the region of these features. Since the liquid water content near the body has increased due to the interaction with the larger scale features of the aerodynamic model, i.e. the leading edge of the swept wing, extremely high collection efficiency is observed. These results suggest that three dimensional features are likely a significant physical driver that should be modeled in some capacity when simulating the impingement of a cloud on an aerodynamic model.

Icing↗

Tracking the Large-scale Tropical Convective Systems and MJO Modulation

Science questions that motivate us − How well do Cloud-Precipitation Hybrid Regimes identify tropical convective systems? − Can we examine the life cycle of convective systems using the hybrid regimes? − What are the effects of MJO on the evolution of convective systems?

tropical convective systems↗

GeoNEX: A Cloud Gateway for Near Real-time Processing of Geostationary Satellite Products

The emergence of a new generation of geostationary satellite sensors provides land andatmosphere monitoring capabilities similar to MODIS and VIIRS with far greater temporal resolution (5-15 minutes). However, processing such large volume, highly dynamic datasets requires computing capabilities that (1) better support data access and knowledge discovery for scientists; (2) provide resources to enable real-time processing for emergency response (wildfire, smoke, dust, etc.); and (3) provide reliable and scalable services for the broader user community. This paper presents an implementation of GeoNEX (Geostationary NASA-NOAA Earth Exchange) services that integrate scientific algorithms with Amazon Web Services (AWS) to provide near realtime monitoring (~5 minute latency) capability in a hybrid cloud-computing environment. It offers a user-friendly, manageable and extendable interface and benefits from the scalability provided by Amazon Web Services. Four use cases are presented to illustrate how to (1) search and access geostationary data; (2) configure computing infrastructure to enable near real-time processing; (3) disseminate and utilize research results, visualizations, and animations to concurrent users; and (4) use a Jupyter Notebook-like interface for data exploration and rapid prototyping. As an example of (3), the Wildfire Automated Biomass Burning Algorithm (WF_ABBA) was implemented on GOES-16 and -17 data to produce an active fire map every 5 minutes over the conterminous US. Details of the implementation strategies, architectures, and challenges of the use cases are discussed.

GeoNEX↗

A New Organization Metric for Synoptic Scale Tropical Convective Aggregation

Organization metrics were originally developed to measure how densely convective clouds are arranged at mesoscales. In this work, we apply organization metrics to describe tropical synoptic scale convective activity. Such activity is identified by cloud-precipitation (hybrid) regimes defined at 1-degree and 1-hourly resolution. Existing metrics were found to perform inadequately for such convective regime aggregates because the large domain size and co-existence of sparse aggregate occurrences with noisy isolated convection often violate assumptions inherent in these metrics. In order to capture these characteristics, in this study the existing “convective organization potential” (COP) metric was modified so as to focus on local organization and provide increased weight to aggregate size. The resulting “area-based COP” (ABCOP) follows the principle that the more numerous the objects, the higher the chance of organization. It is thus optimized to capture large-scale convective events occurring during phenomena such as ENSO and MJO, while also performs as well as existing metrics for small domain sizes.

Synoptic scales↗

Cloud cover over the equatorial eastern Pacific derived from July 1983 International Satellite Cloud Climatology Project data using a hybrid bispectral threshold method

A set of visible and IR data obtained with GOES from July 17-31, 1983 is analyzed using a modified version of the hybrid bispectral threshold method developed by Minnis and Harrison (1984). This methodology can be divided into a set of procedures or optional techniques to determine the proper contaminate clear-sky temperature or IR threshold. The various optional techniques are described; the options are: standard, low-temperature limit, high-reflectance limit, low-reflectance limit, coldest pixel and thermal adjustment limit, IR-only low-cloud temperature limit, IR clear-sky limit, and IR overcast limit. Variations in the cloud parameters and the characteristics and diurnal cycles of trade cumulus and stratocumulus clouds over the eastern equatorial Pacific are examined. It is noted that the new method produces substantial changes in about one third of the cloud amount retrieval; and low cloud retrievals are affected most by the new constraints.

Minnis, Patrick↗

Image-Driven Hybrid Structural Analysis Based on Continuum Point Cloud Method with Boundary Capturing Technique

Conventional approaches for the structural health monitoring of infrastructures often rely on physical sensors or targets attached to structural members, which require considerable preparation, maintenance, and operational effort, including continuous on-site adjustments. This paper presents an image-driven hybrid structural analysis technique that combines digital image processing (DIP) and regression analysis with a continuum point cloud method (CPCM) built on a particle-based strong formulation. Polynomial regressions capture the boundary shape change due to the structural loading and precisely identify the edge and corner coordinates of the deformed structure. The captured edge profiles are transformed into essential boundary conditions. This allows the construction of a strongly formulated boundary value problem (BVP), classified as the Dirichlet problem. Capturing boundary conditions from the digital image is novel, although a similar approach was applied to the point cloud data. It was shown that the CPCM is more efficient in this hybrid simulation framework than the weak-form-based numerical schemes. Unlike the finite element method (FEM), it can avoid aligning boundary nodes with regression points. A three-point bending test of a rubber beam was simulated to validate the developed technique. The simulation results were benchmarked against numerical results by ANSYS and various relevant numerical schemes. The technique can effectively solve the Dirichlet-type BVP, yielding accurate deformation, stress, and strain values across the entire problem domain when employing a linear strain model and increasing the number of CPCM nodes. In addition, comparative analysis with conventional displacement tracking techniques verifies the developed technique’s robustness. The proposed technique effectively circumvents the inherent limitations of traditional monitoring methods resulting from the reliance on physical gauges or target markers so that a robust and non-contact solution for remote structural health monitoring in real-scale infrastructures can be provided, even in unfavorable experimental environments.

Chemistry↗

Satellite cloud retrieval - Past, present, future

Satellite cloud observation is reviewed, including past accomplishments, current problems, and possible future developments. Past and current cloud retrieval algorithms are discussed, noting efforts to overcome various problems associated with cloud retrieval. The Hybrid Bispectral Threshold Method (Minnis and Harrison, 1984), the CO2 slicing algorithm (Chahine, 1974) and the ISCCEP algorithm (Rossow et al., 1985) are considered. An error analysis is presented for the determination of reference cloud fraction from Landsat TM data. The implications of the preliminary results from the First ISCCP Regional Experiment are examined and plans for future research projects are given.

Wielicki, Bruce A.↗

A Decadal Hybrid GCM Simulation Using Deep‐Learning‐Based Cloud and Convection Parameterization Generalized to a Warm Climate

A critical challenge for machine‐learning (ML) parameterization in global climate models (GCMs) is to achieve stable, accurate simulations under climates not seen during training. Previous studies have demonstrated promising offline performance and year‐long online stability in aquaplanet simulations but have encountered difficulties in real geography and under climate warming. Here we report that a GCM with real geography configuration using neural‐network‐based cloud and convection parameterization, trained exclusively with present‐day climate data, successfully performs a stable, decade‐long simulation of a warm climate with +4 K sea surface temperature (SST). The neural network (NN) is based on Han et al. (2023, https://doi.org/10.1029/2022ms003508 ) with additional inputs. The simulation captures the global precipitation distribution, surface temperatures, vertical atmospheric structures, and extreme precipitation very well, closely matching simulations from both the superparameterized CAM (SPCAM) and the conventional CAM5 in the warm climate without accuracy degradation compared to those in the baseline climate. Moreover, it produces a climate response to +4 K SST in atmospheric thermodynamic states and circulations similar to those from SPCAM and CAM5. Prognostic ablation tests on NN input variables show that the NN without convective memory as input suffers from numerical instability, and the NN without considering radiative variables and land fraction as input, or with reduced training samples produce less accurate results. To our knowledge, this is the first time an ML parameterization successfully achieves online extrapolation to a warm climate without using additional warm‐climate data for training. It demonstrates the potential of ML‐driven parameterizations for credible long‐term climate projections.

Atmosphere model↗