Search NASA⌕ Search

SEARCH · Search NASA

Results for “Cloud Implementation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2000

Performance of an Optimized Eta Model Code on the Cray T3E and a Network of PCs

In the year 2001, NASA will launch the satellite TRIANA that will be the first Earth observing mission to provide a continuous, full disk view of the sunlit Earth. As a part of the HPCC Program at NASA GSFC, we have started a project whose objectives are to develop and implement a 3D cloud data assimilation system, by combining TRIANA measurements with model simulation, and to produce accurate statistics of global cloud coverage as an important element of the Earth's climate. For simulation of the atmosphere within this project we are using the NCEP/NOAA operational Eta model. In order to compare TRIANA and the Eta model data on approximately the same grid without significant downscaling, the Eta model will be integrated at a resolution of about 15 km. The integration domain (from -70 to +70 deg in latitude and 150 deg in longitude) will cover most of the sunlit Earth disc and will continuously rotate around the globe following TRIANA. The cloud data assimilation is supposed to run and produce 3D clouds on a near real-time basis. Such a numerical setup and integration design is very ambitious and computationally demanding. Thus, though the Eta model code has been very carefully developed and its computational efficiency has been systematically polished during the years of operational implementation at NCEP, the current MPI version may still have problems with memory and efficiency for the TRIANA simulations. Within this work, we optimize a parallel version of the Eta model code on a Cray T3E and a network of PCs (theHIVE) in order to improve its overall efficiency. Our optimization procedure consists of introducing dynamically allocated arrays to reduce the size of static memory, and optimizing on a single processor by splitting loops to limit the number of streams. All the presented results are derived using an integration domain centered at the equator, with a size of 60 x 60 deg, and with horizontal resolutions of 1/2 and 1/3 deg, respectively. In accompanying charts we report the elapsed time, the speedup and the Mflops as a function of the number of processors for the non-optimized version of the code on the T3E and theHIVE. The large amount of communication required for model integration explains its poor performance on theHIVE. Our initial implementation of the dynamic memory allocation has contributed to about 12% reduction of memory but has introduced a 3% overhead in computing time. This overhead was removed by performing loop splitting in some of the high demanding subroutines. When the Eta code is fully optimized in order to meet the memory requirement for TRIANA simulations, a non-negligeable overhead may appear that may seriously affect the efficiency of the code. To alleviate this problem, we are considering implementation of a new algorithm for the horizontal advection that is computationally less expensive, and also a new approach for marching in time.

Kouatchou, Jules↗
NASA NTRS2012

Investigation into Cloud Computing for More Robust Automated Bulk Image Geoprocessing

Geospatial resource assessments frequently require timely geospatial data processing that involves large multivariate remote sensing data sets. In particular, for disasters, response requires rapid access to large data volumes, substantial storage space and high performance processing capability. The processing and distribution of this data into usable information products requires a processing pipeline that can efficiently manage the required storage, computing utilities, and data handling requirements. In recent years, with the availability of cloud computing technology, cloud processing platforms have made available a powerful new computing infrastructure resource that can meet this need. To assess the utility of this resource, this project investigates cloud computing platforms for bulk, automated geoprocessing capabilities with respect to data handling and application development requirements. This presentation is of work being conducted by Applied Sciences Program Office at NASA-Stennis Space Center. A prototypical set of image manipulation and transformation processes that incorporate sample Unmanned Airborne System data were developed to create value-added products and tested for implementation on the "cloud". This project outlines the steps involved in creating and testing of open source software developed process code on a local prototype platform, and then transitioning this code with associated environment requirements into an analogous, but memory and processor enhanced cloud platform. A data processing cloud was used to store both standard digital camera panchromatic and multi-band image data, which were subsequently subjected to standard image processing functions such as NDVI (Normalized Difference Vegetation Index), NDMI (Normalized Difference Moisture Index), band stacking, reprojection, and other similar type data processes. Cloud infrastructure service providers were evaluated by taking these locally tested processing functions, and then applying them to a given cloud-enabled infrastructure to assesses and compare environment setup options and enabled technologies. This project reviews findings that were observed when cloud platforms were evaluated for bulk geoprocessing capabilities based on data handling and application development requirements.

Brown, Richard B.↗
NASA NTRS2006

The Impact of Microphysics on Intensity and Structure of Hurricanes

During the past decade, both research and operational numerical weather prediction models, e.g. Weather Research and Forecast (WRF) model, have started using more complex microphysical schemes originally developed for high-resolution cloud resolving models (CRMs) with a 1-2 km or less horizontal resolutions. WFW is a next-generation mesoscale forecast model and assimilation system that has incorporated modern software framework, advanced dynamics, numeric and data assimilation techniques, a multiple moveable nesting capability, and improved physical packages. WFW model can be used for a wide range of applications, from idealized research to operational forecasting, with an emphasis on horizontal grid sizes in the range of 1-10 km. The current WRF includes several different microphysics options such as Lin et al. (1983), WSM 6-class and Thompson microphysics schemes. We have recently implemented three sophisticated cloud microphysics schemes into WRF. The cloud microphysics schemes have been extensively tested and applied for different mesoscale systems in different geographical locations. The performances of these schemes have been compared to those from other WRF microphysics options. We are performing sensitivity tests in using WW to examine the impact of six different cloud microphysical schemes on hurricane track, intensity and rainfall forecast. We are also performing the inline tracer calculation to comprehend the physical processes @e., boundary layer and each quadrant in the boundary layer) related to the development and structure of hurricanes.

Tao, Wei-Kuo↗
NASA NTRS2007

The Impact of Microphysics on Intensity and Structure of Hurricanes and Mesoscale Convective Systems

During the past decade, both research and operational numerical weather prediction models, e.g. Weather Research and Forecast (WRF) model, have started using more complex microphysical schemes originally developed for high-resolution cloud resolving models (CRMs) with a 1-2 km or less horizontal resolutions. WRF is a next-generation mesoscale forecast model and assimilation system that has incorporated modern software framework, advanced dynamics, numeric and data assimilation techniques, a multiple moveable nesting capability, and improved physical packages. WRF model can be used for a wide range of applications, from idealized research to operational forecasting, with an emphasis on horizontal grid sizes in the range of 1-10 km. The current WRF includes several different microphysics options such as Purdue Lin et al. (1983), WSM 6-class and Thompson microphysics schemes. We have recently implemented three sophisticated cloud microphysics schemes into WRF. The cloud microphysics schemes have been extensively tested and applied for different mesoscale systems in different geographical locations. The performances of these schemes have been compared to those from other WRF microphysics options. We are performing sensitivity tests in using WRF to examine the impact of six different cloud microphysical schemes on precipitation processes associated hurricanes and mesoscale convective systems developed at different geographic locations [Oklahoma (IHOP), Louisiana (Hurricane Katrina), Canada (C3VP - snow events), Washington (fire storm), India (Monsoon), Taiwan (TiMREX - terrain)]. We will determine the microphysical schemes for good simulated convective systems in these geographic locations. We are also performing the inline tracer calculation to comprehend the physical processes (i.e., boundary layer and each quadrant in the boundary layer) related to the development and structure of hurricanes and mesoscale convective systems.

Tao, Wei-Kuo↗
NASA NTRS2004

Implementation of a Message Passing Interface into a Cloud-Resolving Model for Massively Parallel Computing

The capability for massively parallel programming (MPP) using a message passing interface (MPI) has been implemented into a three-dimensional version of the Goddard Cumulus Ensemble (GCE) model. The design for the MPP with MPI uses the concept of maintaining similar code structure between the whole domain as well as the portions after decomposition. Hence the model follows the same integration for single and multiple tasks (CPUs). Also, it provides for minimal changes to the original code, so it is easily modified and/or managed by the model developers and users who have little knowledge of MPP. The entire model domain could be sliced into one- or two-dimensional decomposition with a halo regime, which is overlaid on partial domains. The halo regime requires that no data be fetched across tasks during the computational stage, but it must be updated before the next computational stage through data exchange via MPI. For reproducible purposes, transposing data among tasks is required for spectral transform (Fast Fourier Transform, FFT), which is used in the anelastic version of the model for solving the pressure equation. The performance of the MPI-implemented codes (i.e., the compressible and anelastic versions) was tested on three different computing platforms. The major results are: 1) both versions have speedups of about 99% up to 256 tasks but not for 512 tasks; 2) the anelastic version has better speedup and efficiency because it requires more computations than that of the compressible version; 3) equal or approximately-equal numbers of slices between the x- and y- directions provide the fastest integration due to fewer data exchanges; and 4) one-dimensional slices in the x-direction result in the slowest integration due to the need for more memory relocation for computation.

Juang, Hann-Ming Henry↗
DOE OSTI2021

Evolving CO 2 rather than SST leads to a factor of ten decrease in GCM convergence time

The high computational cost of Global Climate Models (GCMs) is a problem that limits their use in many areas. Recently an inverse climate modeling (InvCM) method, which fixes the global mean sea surface temperature (SST) and evolves the CO 2 mixing ratio to equilibrate climate, has been implemented in a cloud resolving model. In this paper, we apply InvCM to ExoCAM GCM aquaplanet simulations, allowing the SST pattern to evolve while maintaining a fixed global-mean SST. We find that InvCM produces the same climate as normal slab-ocean simulations but converges an order of magnitude faster. We then use InvCM to calculate the equilibrium CO 2 for SSTs ranging from 290 K to 340 K at 1 K intervals and reproduce the large increase in climate sensitivity at an SST of about 315 K at much higher temperature resolution. The speedup provided by InvCM could be used to equilibrate GCMs at higher spatial resolution or to perform broader parameter space exploration in order to gain new insight into the climate system. Additionally, InvCM could be used to find unstable and hidden climate states, and to find climate states close to bifurcations such as the runaway greenhouse transition.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Lidar Cloud Detection with Fully Convolutional Networks

In this contribution, we present a novel approach for segmenting laser radar (lidar) imagery into geometric time- height cloud locations with a fully convolutional network (FCN). We describe a semi-supervised learning method to train the FCN by: pre-training the classification layers of the FCN with image-level annotations, pre-training the en- tire FCN with the cloud locations of the MPLCMASK cloud mask algorithm, and fully supervised learning with hand-labeled cloud locations. We show the model achieves higher levels of cloud identification compared to the cloud mask algorithm implementation.

Cromwell, Erol LD↗
DOE OSTI2022

Enhancing Convection Parameterization for Next Generation E3SM (Final Technical Report)

This technical report summarizes the achievements during the project period. The general goal of the project is to enhance the representation of atmospheric deep convection in the DOE global climate model E3SM. By implementing a stochastic convection scheme into E3SM, we improved the simulation of precipitation intensity and frequency. As a result, it has a profound impact on the simulation of other fields in the model, including aerosol scavenging by precipitation and aerosol radiative effects. We also implemented a convective cloud microphysics scheme into E3SMv2 to represent more accurately the interaction between convection and grid-scale clouds. An extensive analysis of model simulations as part of the Next Generation Development (NGD) convection scheme assessment project found that including the convective microphysics scheme improved the simulation of Madden-Julian oscillations (MJO) in the model. To make convective parameterization schemes more scale-aware as the GCM resolution increases, we analyzed the output from cloud-resolving model (CRM) simulations of both organized and unorganized convection by coarse-graining the CRM data to different GCM resolutions. Using a novel approach to modify the convective closure, we demonstrated that the convection scheme used in E3SM (ZM scheme) can be made scale-aware.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Field Validation of a Building Operating System Platform

The U.S General Services Administration's (GSA's) Green Proving Ground program, in partnership with the National Renewable Energy Laboratory. completed a large pilot study of an Energy Management Information Systems (EMIS) with Automated System Optimization (ASO). Four test bed facilities, each with different building characteristics and systems, were chosen for the implementation of cloud-based EMIS with ASO. Depending on functionality, this tool can be extremely effective in energy management and energy optimization in buildings. The capabilities evaluated in the pilot ranged from energy savings and energy consumption predictions to evaluations of user acceptance, operability, and ease of installation. This report presents the methodology, lessons learned and best practices, and deployment recommendations for the GSA's portfolio of commercial office space, comprising more than 8,500 properties.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

The Earth Model Column Collaboratory (EMC 2 ) v1.1: an open-source ground-based lidar and radar instrument simulator and subcolumn generator for large-scale models

Abstract. Climate models are essential for our comprehensive understanding of Earth's atmosphere and can provide critical insights on future changes decades ahead. Because of these critical roles, today's climate models are continuously being developed and evaluated using constraining observations and measurements obtained by satellites, airborne, and ground-based instruments. Instrument simulators can provide a bridge between the measured or retrieved quantities and their sampling in models and field observations while considering instrument sensitivity limitations. Here we present the Earth Model Column Collaboratory (EMC2), an open-source ground-based lidar and radar instrument simulator and subcolumn generator, specifically designed for large-scale models, in particular climate models, but also applicable to high-resolution model output. EMC2 provides a flexible framework enabling direct comparison of model output with ground-based observations, including generation of subcolumns that may statistically represent finer model spatial resolutions. In addition, EMC2 emulates ground-based (and air- or space-borne) measurements while remaining faithful to large-scale models' physical assumptions implemented in their cloud or radiation schemes. The simulator uses either single particle or bulk particle size distribution lookup tables, depending on the selected scheme approach, to perform the forward calculations. To facilitate model evaluation, EMC2 also includes three hydrometeor classification methods, namely, radar- and sounding-based cloud and precipitation detection and classification, lidar-based phase classification, and a Cloud Feedback Model Intercomparison Project Observational Simulator Package (COSP) lidar simulator emulator. The software is written in Python, is easy to use, and can be straightforwardly customized for different models, radars, and lidars. Following the description of the logic, functionality, features, and software structure of EMC2, we present a case study of highly supercooled mixed-phase cloud based on measurements from the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) West Antarctic Radiation Experiment (AWARE). We compare observations with the application of EMC2 to outputs from four configurations of the NASA Goddard Institute for Space Studies (GISS) climate model (ModelE3) in single-column model (SCM) mode and from a large-eddy simulation (LES) model. We show that two of the four ModelE3 configurations can form and maintain highly supercooled precipitating cloud for several hours, consistent with observations and LES. While our focus is on one of these ModelE3 configurations, which performed slightly better in this case study, both of these configurations and the LES results post-processed with EMC2 generally provide reasonable agreement with observed lidar and radar variables. As briefly demonstrated here, EMC2 can provide a lightweight and flexible framework for comparing the results of both large-scale and high-resolution models directly with observations, with relatively little overhead and multiple options for achieving consistency with model microphysical or radiation scheme physics.

58 GEOSCIENCES↗
NASA NTRS1993

Model simulations of the competing climatic effects of SO2 and CO2

Sulfur dioxide-derived cloud condensation nuclei are expected to enhance the planetary albedo, thereby cooling the planet. This effect might counteract the global warming expected from enhanced greenhouse gases. A detailed treatment of the relationship between fossil fuel burning and the SO2 effect on cloud albedo is implemented in a two-dimensional model for assessing the climate impact. Using a conservative approach, results show that the cooling induced by the SO2 emission can presently counteract 50 percent of the CO2 greenhouse warming. Since 1980, a strong warming trend has been predicted by the model: 0.15 C during the 1980-1990 period alone. The model predicts that by the year 2060 the SO2 cooling reduces climate warming by 0.5 C or 25 percent for the Intergovernmental Panel on Climate Change (IPCC) business as usual (BAU) scenario and 0.2 C or 20 percent for scenario D (for a slow pace of fossil fuel burning). The hypothesis is examined that the different responses between the Northern Hemisphere and the Southern Hemisphere can be used to validate the presence of the SO2-induced cooling.

Kaufman, Yoram J.↗
NASA NTRS1994

System Design for a Spaceborne Cloud Rada

This paper presents some crucial design parameters and a strawman system design for a nadir-looking, 94-GHz spaceborne cloud profiling radar. This sensor is expected to provide cloud measurements at vertical resolution of 500 m and with a minimum detectable cloud reflectivity of slightly better than -30 dBZ. The radar design is intended to be accommodated by a spacecraft with limited resources. It uses a 2-m antenna and an extended interaction amplifier (EIA) that are readily available in either ground-based and airborne applications. For space application, improvements in the EIA lifetime and space qualification will be required. For various reasons, the spaceborne cloud radar system development is expected to be greatly benefited by the implementation of an aircraft cloud radar instrument.

Cloud Measurement Spaceborne Cloud↗
NASA NTRS2007

Comparison of TWP-ICE Satellite and Field Campaign Aircraft Derived Cloud Properties

Cloud and radiation products derived from the MTSAT-1R satellite have been developed for TWP-ICE. These include pixel-level, gridded, and ground site and aircraft matched. These products are available from the Langley website and the ARM data center. As shown in Figs 2, and 4-6, these products compare favorably with in-situ ground and aircraft based measurements. With additional quantitative validation these products can provide valuable information about tropical convection and its impact on the radiation budget and climate. As new algorithm improvements, such as multi-layer cloud detection, are implemented these products will be reprocessed and updated.

Ayers, J. K.↗
NASA NTRS2015

MISR Calibration Issues in High-Contrast Scenes, and Empirical Corrections

We diagnose the potential causes for the Multi-angle Imaging SpectroRadiometer's (MISR) persistent high aerosol optical depth (AOD) bias at low AOD with the aid of coincident MODerate-resolution Imaging Spectroradiometer (MODIS) imagery from NASA's Terra satellite. Internal reflections within the MISR instrument are responsible for a large portion of the high AOD bias in high-contrast scenes, which are especially common as broken-cloud situations over ocean. Discrepancies between MODIS and MISR nadir-viewing near-infrared (NIR) images are used to optimize nine parameters, along with a background reflectance modulation term (that was modeled separately), to represent the observed features. Independent, surface-based AOD measurements from the AErosol RObotic NETwork (AERONET) and the Marine Aerosol Network (MAN) are compared with MISR Research Algorithm (RA) AOD retrievals for 1118 coincidences to validate the corrections when applied to the nadir and off-nadir cameras. Additionally, the calibration coefficients for the red and NIR channels used for MISR over-water aerosol retrievals were reassessed with the RA to be consistent on a camera-by-camera basis. With these corrections, plus the baseline RA corrections applied (except enhanced cloud screening), the median AOD bias in the mid-visible (green) band decreases from 0.010 to 0.002, the RMSE decreases by approx. 10%, and the slope and correlation of the MISR vs. sun photometer Ångström Exponent improves. For AOD558 nm < 0.10 and with additional cloud screening, the median bias for the RA-retrieved AOD in the green band decreases from 0.011 to 0.003, compared to ~ 0.023 for the Standard Algorithm (SA). RMSE decreases by ~ 20% compared to the baseline (uncorrected) RA and by 17-53% compared to the SA. After all corrections and cloud screening are implemented, for AOD558 nm < 0.10, which includes about half the validation data, 68% absolute AOD errors for the RA have dropped to < 0.02 (approx. 0.018).

MISR↗
NASA NTRS2022

The Earth Model Column Collaboratory (EMC2) v1.1: An Open-Source Ground-Based Lidar and Radar Instrument Simulator and Subcolumn Generator for Large-Scale Models

Climate models are essential for our comprehensive understanding of Earth's atmosphere and can provide critical insights on future changes decades ahead. Because of these critical roles, today's climate models are continuously being developed and evaluated using constraining observations and measurements obtained by satellites, airborne, and ground-based instruments. Instrument simulators can provide a bridge between the measured or retrieved quantities and their sampling in models and field observations while considering instrument sensitivity limitations. Here we present the Earth Model Column Collaboratory (EMC2), an open-source ground-based lidar and radar instrument simulator and subcolumn generator, specifically designed for large-scale models, in particular climate models, but also applicable to high-resolution model output. EMC2 provides a flexible framework enabling direct comparison of model output with ground-based observations, including generation of subcolumns that may statistically represent finer model spatial resolutions. In addition, EMC2 emulates ground-based (and air- or space-borne) measurements while remaining faithful to large-scale models' physical assumptions implemented in their cloud or radiation schemes. The simulator uses either single particle or bulk particle size distribution lookup tables, depending on the selected scheme approach, to perform the forward calculations. To facilitate model evaluation, EMC2 also includes three hydrometeor classification methods, namely, radar- and sounding-based cloud and precipitation detection and classification, lidar-based phase classification, and a Cloud Feedback Model Intercomparison Project Observational Simulator Package (COSP) lidar simulator emulator. The software is written in Python, is easy to use, and can be straightforwardly customized for different models, radars, and lidars. Following the description of the logic, functionality, features, and software structure of EMC2, we present a case study of highly supercooled mixed-phase cloud based on measurements from the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) West Antarctic Radiation Experiment (AWARE). We compare observations with the application of EMC2 to outputs from four configurations of the NASA Goddard Institute for Space Studies (GISS) climate model (ModelE3) in single-column model (SCM) mode and from a large-eddy simulation (LES) model. We show that two of the four ModelE3 configurations can form and maintain highly supercooled precipitating cloud for several hours, consistent with observations and LES. While our focus is on one of these ModelE3 configurations, which performed slightly better in this case study, both of these configurations and the LES results post-processed with EMC2 generally provide reasonable agreement with observed lidar and radar variables. As briefly demonstrated here, EMC2 can provide a lightweight and flexible framework for comparing the results of both large-scale and high-resolution models directly with observations, with relatively little overhead and multiple options for achieving consistency with model microphysical or radiation scheme physics.

Earth Model Column Collaboratory↗
NASA NTRS2022

A Dynamic Landslide Hazard Monitoring Framework for the Lower Mekong Region

The Lower Mekong region is one of the most landslide-prone areas of the world. Despite the need for dynamic characterization of landslide hazard zones within the region, it is largely understudied for several reasons. Dynamic and integrated understanding of landslide processes requires landslide inventories across the region, which have not been available previously. Computational limitations also hamper regional landslide hazard assessment, including accessing and processing remotely sensed information. Finally, open-source software and modelling packages are required to address regional landslide hazard analysis. Leveraging an open-source data-driven global Landslide Hazard Assessment for Situational Awareness model framework, this study develops a region-specific dynamic landslide hazard system leveraging satellite-based Earth observation data to assess landslide hazards across the lower Mekong region. A set of landslide inventories were prepared from high-resolution optical imagery using advanced image-processing techniques. Several static and dynamic explanatory variables (i.e., rainfall, soil moisture, slope, relief, distance to roads, distance to faults, distance to rivers) were considered during the model development phase. An extreme gradient boosting decision tree model was trained for the monsoon period of 2015–2019 and the model was evaluated with independent inventory information for the 2020 monsoon period. The model performance demonstrated considerable skill using receiver operating characteristic curve statistics, with Area Under the Curve values exceeding 0.95. The model architecture was designed to use near-real-time data, and it can be implemented in a cloud computing environment (i.e., Google Cloud Platform) for the routine assessment of landslide hazards in the Lower Mekong region. This work was developed in collaboration with scientists at the Asian Disaster Preparedness Center as part of the NASA SERVIR Program’s Mekong hub. The goal of this work is to develop a suite of tools and services on accessible open-source platforms that support and enable stakeholder communities to better assess landslide hazard and exposure at local to regional scales for decision making and planning.

Nishan Kumar Biswas↗
NASA NTRSDate not supplied

Propagation of the MJO and Associated Moist Dynamics, and the Advantages of Enhanced Resolution in NASA’s GEOS-S2S Forecast System

This presentation explores how reliably the NASA’s new subseasonal to seasonal (S2S) forecast system represents the key features of the Madden-Julian Oscillation (MJO). This system is a fully coupled global model that includes the components of atmosphere, ocean, land, and sea ice. The model runs at an approximate spatial resolution of 0.5 degree for the atmosphere and 0.25 degree for the ocean. It employs a two-moment cloud microphysics to enable aerosol-cloud interaction and implements a novel atmosphere-ocean interface layer to enhance the representation of the diurnal warm and cool-skin layer.

Young-Kwon Lim↗