Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

Parameterizing Grid-Averaged Longwave Fluxes for Inhomogeneous Marine Boundary Layer Clouds

This paper examines the relative impacts on grid-averaged longwave flux transmittance (emittance) for Marine Boundary Layer (MBL) cloud fields arising from horizontal variability of optical depth tau and cloud sides, First, using fields of Landsat-inferred tau and a Monte Carlo photon transport algorithm, it is demonstrated that mean all-sky transmittances for 3D variable MBL clouds can be computed accurately by the conventional method of linearly weighting clear and cloudy transmittances by their respective sky fractions. Then, the approximations of decoupling cloud and radiative properties and assuming independent columns are shown to be adequate for computation of mean flux transmittance. Since real clouds have nonzero geometric thicknesses, cloud fractions A'(sub c) presented to isotropic beams usually exceed the more familiar vertically projected cloud fractions A(sub c). It is shown, however, that when A(sub c)less than or equal to 0.9, biases for all-sky transmittance stemming from use of A(sub c) as opposed to A'(sub c) are roughly 2-5 times smaller than, and opposite in sign to, biases due to neglect of horizontal variability of tau. By neglecting variable tau, all-sky transmittances are underestimated often by more than 0.1 for A(sub c) near 0.75 and this translates into relative errors that can exceed 40% (corresponding errors for all-sky emittance are about 20% for most values of A(sub c). Thus, priority should be given to development of General Circulation Model (GCM) parameterizations that account for the effects of horizontal variations in unresolved tau, effects of cloud sides are of secondary importance. On this note, an efficient stochastic model for computing grid-averaged cloudy-sky flux transmittances is furnished that assumes that distributions of tau, for regions comparable in size to GCM grid cells, can be described adequately by gamma distribution functions. While the plane-parallel, homogeneous model underestimates cloud transmittance by about an order of magnitude when 3D variable cloud transmittances are less than or equal to 0.2 and by approx. 20% to 100% otherwise, the stochastic model reduces these biases often by more than 80%.

Barker, Howard W.↗

IN13B-1660: Analytics and Visualization Pipelines for Big Data on the NASA Earth Exchange (NEX) and OpenNEX

We are developing capabilities for an integrated petabyte-scale Earth science collaborative analysis and visualization environment. The ultimate goal is to deploy this environment within the NASA Earth Exchange (NEX) and OpenNEX in order to enhance existing science data production pipelines in both high-performance computing (HPC) and cloud environments. Bridging of HPC and cloud is a fairly new concept under active research and this system significantly enhances the ability of the scientific community to accelerate analysis and visualization of Earth science data from NASA missions, model outputs and other sources. We have developed a web-based system that seamlessly interfaces with both high-performance computing (HPC) and cloud environments, providing tools that enable science teams to develop and deploy large-scale analysis, visualization and QA pipelines of both the production process and the data products, and enable sharing results with the community. Our project is developed in several stages each addressing separate challenge - workflow integration, parallel execution in either cloud or HPC environments and big-data analytics or visualization. This work benefits a number of existing and upcoming projects supported by NEX, such as the Web Enabled Landsat Data (WELD), where we are developing a new QA pipeline for the 25PB system.

visualization↗

Prognostics As-A-Service: A Scalable Cloud Architecture for Prognostics

Comprehensive aircraft system health-state awareness is critical for maintaining safe, efficient growth in global operations, enabling higher levels of autonomy, and facilitating new forms of aviation. Maintainers, vehicle operators, air traffic controllers, dispatchers, pilots, autonomous systems, and other decision-makers must have reliable real-time knowledge of the vehicle health, the health of its critical composite systems, predictions of how health changes with time, and forecasts of how its capabilities change with health degradation to preserve safety and efficiency. Providing this information in a reliable manner in computationally constrained environments and across a wide range of vehicles and systems continues to be a challenge. This challenge can be partially resolved through cloud computing, where the execution of prognostic and diagnostic algorithms is performed on a network of remote servers hosted on the internet. NASA is developing a cloud computing service, Prognostics As-A-Service (PaaS), that explores the feasibility and challenges of cloud-enhanced prognostics. Though such a system has broad applicability, this research effort is focused on aviation applications.

Prognostics↗

Collapse and equilibrium of rotating, adiabatic clouds

A numerical hydrodynamics computer code analysis of the collapse and establishment of equilibrium of adiabatic gas clouds restricted to axial symmetry found that the clouds are originally uniform in density and rotation. The method can compare the dynamic collapse and approach to equilibrium with the data on incompressible uniformly rotating equilibrium clouds and on equilibrium structures of differentially rotating polytropes. It is concluded that the stellar formation theory indicates that the low alpha fragments produced at the termination of the dynamic isothermal collapse phase of interstellar clouds may undergo significant dynamic collapse in an adiabatic regime leading to transitory ring formation and additional fragmentation on a smaller scale.

Boss, A. P.↗

The three-dimensional structure of cumulus clouds over the ocean. 1: Structural analysis

Thermal channel (channel 6, 10.4-12.5 micrometers) images of five Landsat thematic mapper cumulus scenes over the ocean are examined. These images are thresholded using the standard International Satellite Cloud Climatology Project (ISCCP) thermal threshold algorithm. The individual clouds in the cloud fields are segmented to obtain their structural statistics which include size distribution, orientation angle, horizontal aspect ratio, and perimeter-to-area (PtA) relationship. The cloud size distributions exhibit a double power law with the smaller clouds having a smaller absolute exponent. The cloud orientation angles, horizontal aspect ratios, and PtA exponents are found in good agreement with earlier studies. A technique also is developed to recognize individual cells within a cloud so that statistics of cloud cellular structure can be obtained. Cell structural statistics are computed for each cloud. Unicellular clouds are generally smaller (less than or equal to 1 km) and have smaller PtA exponents, while multicellular clouds are larger (greater than or equal to 1 km) and have larger PtA exponents. Cell structural statistics are similar to those of the smaller clouds. When each cell is approximated as a quadric surface using a linear least squares fit, most cells have the shape of a hyperboloid of one sheet, but about 15% of the cells are best modeled by a hyperboloid of two sheets. Less than 1% of the clouds are ellipsoidal. The number of cells in a cloud increases slightly faster than linearly with increasing cloud size. The mean nearest neighbor distance between cells in a cloud, however, appears to increase linearly with increasing cloud size and to reach a maximum when the cloud effective diameter is about 10 km; then it decreases with increasing cloud size. Sensitivity studies of threshold and lapse rate show that neither has a significant impact upon the results. A goodness-of-fit ratio is used to provide a quantitative measure of the individual cloud results. Significantly improved results are obtained after applying a smoothing operator, suggesting the eliminating subresolution scale variations with higher spatial resolution may yield even better shape analyses.

Kuo, Kwo-Sen↗

Infrared radiative transfer through a regular array of cuboidal clouds

Infrared radiative transfer through a regular array of cuboidal clouds is studied and the interaction of the sides of the clouds with each other and the ground is considered. The theory is developed for black clouds and is extended to scattering clouds using a variable azimuth two-stream approximation. It is shown that geometrical considerations often dominate over the microphysical aspects of radiative transfer through the clouds. For example, the difference in simulated 10 micron brightness temperature between black isothermal cubic clouds and cubic clouds of optical depth 10, is less than 2 deg for zenith angles less than 50 deg for all cloud fractions when viewed parallel to the array. The results show that serious errors are made in flux and cooling rate computations if broken clouds are modeled as planiform. Radiances computed by the usual practice of area-weighting cloudy and clear sky radiances are in error by 2 to 8 K in brightness temperature for cubic clouds over a wide range of cloud fractions and zenith angles. It is also shown that the lapse rate does not markedly affect the exiting radiances for cuboidal clouds of unit aspect ratio and optical depth 10.

HARSHVARDHAN↗

Application of an automatic cloud tracking technique to Meteosat water vapor and infrared observations

The automatic cloud tracking system was applied to METEOSAT 6.7 micrometers water vapor measurements to learn whether the system can track the motions of water vapor patterns. Data for the midlatitudes, subtropics, and tropics were selected from a sequence of METEOSAT pictures for 25 April 1978. Trackable features in the water vapor patterns were identified using a clustering technique and the features were tracked by two different methods. In flat (low contrast) water vapor fields, the automatic motion computations were not reliable, but in areas where the water vapor fields contained small scale structure (such as in the vicinity of active weather phenomena) the computations were successful. Cloud motions were computed using METEOSAT infrared observations (including tropical convective systems and midlatitude jet stream cirrus).

Endlich, R. M.↗

Using Multi-Scale Modeling Systems and Satellite Data to Study the Precipitation Processes

In recent years, exponentially increasing computer power extended Cloud Resolving Model (CRM) integrations from hours to months, the number of computational grid points from less than a thousand to close to ten million. Three-dimensional models are now more prevalent. Much attention is devoted to precipitating cloud systems where the crucial 1-km scales are resolved in horizontal domains as large as 10,000 km in two-dimensions, and 1,000 x 1,000 sq km in three-dimensions. Cloud resolving models now provide statistical information useful for developing more realistic physically based parameterizations for climate models and numerical weather prediction models. It is also expected that NWP and mesoscale models can be run in grid size similar to cloud resolving models through nesting technique. Recently, a multi-scale modeling system with unified physics was developed at NASA Goddard. It consists of (1) a cloud-resolving model (Goddard Cumulus Ensemble model, GCE model). (2) a regional scale model (a NASA unified weather research and forecast, W8F). (3) a coupled CRM and global model (Goddard Multi-scale Modeling Framework, MMF), and (4) a land modeling system. The same microphysical processes, long and short wave radiative transfer and land processes and the explicit cloud-radiation and cloud-land surface interactive processes are applied in this multi-scale modeling system. This modeling system has been coupled with a multi-satellite simulator to use NASA high-resolution satellite data to identify the strengths and weaknesses of cloud and precipitation processes simulated by the model. In this talk, a review of developments and applications of the multi-scale modeling system will be presented. In particular, the results from using multi-scale modeling systems to study the interactions between clouds, precipitation, and aerosols will be presented. Also how to use the multi-satellite simulator to improve precipitation processes will be discussed.

Tao, Wei--Kuo↗

Diagnosing convective instability using VAS data

The utility of combining visible and various infrared images from the VAS to produce a forecasting tool, that can be available on a near real time basis, to predict severe weather development is shown. Areas where dry air in the midtroposphere overlays substantial moisture at low levels are used to diagnose mesoscale regions that have the potential for being convectively unstable before the onset of severe convection. Specifically, 6.7 micron water vapor imagery, used for isolating regions of substantial midlevel dryness, are combined with images of low level clouds or with split-window low level moisture images to delineate regions that have the potential for convective instability. In areas where scattered low level clouds are present, computer generated, color image combinations are used to isolate those warm, low level clouds that are in potential convectively unstable environments from clouds that exist under a deeply moist atmosphere. In clear regions, the split window technique is used for delineating areas of substantial boundary layer moisture. These images are again computer overlayed by the midlevel dryness to produce a color coded image of potential convective instability.

Petersen, R. A.↗

Computation of the Effects of Inhomogeneous Clouds on Retrieval of Remotely Sensed Properties

Current and future earth observation programs depend on satellite measurements of radiance to retrieve the properties of clouds on a global basis. At present, this retrieval is made assuming that the clouds in the instrument field of view are plane parallel and independent of adjacent pixels. While this assumption is known to be false except in very limited cases, its impact can be evaluated, and if possible corrected, based on emerging theoretical techniques. In this study, the Spherical Harmonic Discrete Ordinate Method (SHDOM, Evans, 1996) has been used to assess the sensitivity of the retrieval to a variety of cloud parameters. SHDOM allows the plane parallel assumption to be relaxed and makes 2D and even 3D radiative solutions practical. A previous study (Chambers et al., 1996) assessed the effect of horizontal inhomogeneity in 45 LANDSAT scenes of boundary layer clouds over ocean. The four scenes studied here represent overcast, broken, scattered and strongly thermally forced cloud fields and are used to perform sensitivity studies to a wider variety of parameters. Comparisons are made at three solar zenith angles (theta (sub 0) = 0, 49, and 63 degrees) to avoid ambiguity in the results due to solar zenith angle.

Chambers, Lin H.↗

Implementation of a Message Passing Interface into a Cloud-Resolving Model for Massively Parallel Computing

The capability for massively parallel programming (MPP) using a message passing interface (MPI) has been implemented into a three-dimensional version of the Goddard Cumulus Ensemble (GCE) model. The design for the MPP with MPI uses the concept of maintaining similar code structure between the whole domain as well as the portions after decomposition. Hence the model follows the same integration for single and multiple tasks (CPUs). Also, it provides for minimal changes to the original code, so it is easily modified and/or managed by the model developers and users who have little knowledge of MPP. The entire model domain could be sliced into one- or two-dimensional decomposition with a halo regime, which is overlaid on partial domains. The halo regime requires that no data be fetched across tasks during the computational stage, but it must be updated before the next computational stage through data exchange via MPI. For reproducible purposes, transposing data among tasks is required for spectral transform (Fast Fourier Transform, FFT), which is used in the anelastic version of the model for solving the pressure equation. The performance of the MPI-implemented codes (i.e., the compressible and anelastic versions) was tested on three different computing platforms. The major results are: 1) both versions have speedups of about 99% up to 256 tasks but not for 512 tasks; 2) the anelastic version has better speedup and efficiency because it requires more computations than that of the compressible version; 3) equal or approximately-equal numbers of slices between the x- and y- directions provide the fastest integration due to fewer data exchanges; and 4) one-dimensional slices in the x-direction result in the slowest integration due to the need for more memory relocation for computation.

Juang, Hann-Ming Henry↗

Solar Radiation Transport in the Cloudy Atmosphere: A 3D Perspective on Observations and Climate Impacts

The interplay of sunlight with clouds is a ubiquitous and often pleasant visual experience, but it conjures up major challenges for weather, climate, environmental science and beyond. Those engaged in the characterization of clouds (and the clear air nearby) by remote sensing methods are even more confronted. The problem comes, on the one hand, from the spatial complexity of real clouds and, on the other hand, from the dominance of multiple scattering in the radiation transport. The former ingredient contrasts sharply with the still popular representation of clouds as homogeneous plane-parallel slabs for the purposes of radiative transfer computations. In typical cloud scenes the opposite asymptotic transport regimes of diffusion and ballistic propagation coexist. We survey the three-dimensional (3D) atmospheric radiative transfer literature over the past 50 years and identify three concurrent and intertwining thrusts: first, how to assess the damage (bias) caused by 3D effects in the operational 1D radiative transfer models? Second, how to mitigate this damage? Finally, can we exploit 3D radiative transfer phenomena to innovate observation methods and technologies? We quickly realize that the smallest scale resolved computationally or observationally may be artificial but is nonetheless a key quantity that separates the 3D radiative transfer solutions into two broad and complementary classes: stochastic and deterministic. Both approaches draw on classic and contemporary statistical, mathematical and computational physics.

Davis, Anthony B.↗

Characteristics of middle and upper tropospheric clouds as deduced from rawinsonde data

The static environment of middle and upper tropospheric clouds is characterized. Computed relative humidity with respect to ice is used to diagnose the presence of cloud layer. The deduced seasonal mean cloud cover estimates based on this technique are shown to be reasonable. The cases are stratified by season and pressure thickness, and the dry static stability, vertical wind speed shear, and Richardson number are computed for three layers for each case. Mean values for each parameter are presented for each stratification and layer. The relative frequency of occurrence of various structures is presented for each stratification. The observed values of each parameter and the observed structure of each parameter are quite variable. Structures corresponding to any of a number of different conceptual models may be found. Moist adiabatic conditions are not commonly observed and the stratification based on thickness yields substantially different results for each group.

Starr, D. D. O.↗

Joint ESA-NASA Multi-Mission Algorithm and Analysis Platform (MAAP)

The scientific community is faced with a need for greatly improved data sharing, analysis, visualization and advanced collaboration based firmly on open science principles. Recent and upcoming launches of new satellite missions with more complex and voluminous data, as well as the ever more urgent need to better understand the global carbon budget and related ecological processes, provided the immediate rational for the ESA-NASA Multi-mission Algorithm and Analysis Platform (MAAP). This highly collaborative joint project of ESA and NASA established a framework between ESA and NASA to share data, science algorithms and compute resources in order to foster and accelerate scientific research conducted by ESA and NASA EO data users. Presented to the public in October 2021, the current version of MAAP provides a common cloud-based platform with computing capabilities co-located with the data, a collaborative coding and analysis environment, and a set of interoperable tools and algorithms developed to support the estimation and visualization of global above-ground biomass. Data from the Global Ecosystem Dynamics Investigation (GEDI) mission on the International Space Station and the Ice, Cloud, and Land Elevation Satellite-2 (ICESat-2) have been instrumental in the first products of MAAP including the first comprehensive map of Boreal above-ground Biomass and a current Global Biomass Harmonization Activity, but the platform is also being specifically designed to support the forthcoming ESA Biomass mission and incorporate data from the upcoming NASA-ISRO SAR (NISAR) mission. While these missions and the corresponding research which includes airborne, field, and calibration/validation data collection and analyses, provide a wealth of data and information relating to global biomass estimation, they also present data storing, processing and sharing challenges. The NISAR mission alone will produce about 80TB/day. These large data volumes present a challenge that would otherwise place accessibility limits on the scientific community and impact scientific progress. Other challenges being addressed by MAAP include: 1) Enabling researchers to easily discover, process, visualize and analyze large volumes of data from both agencies; 2) Providing a wide variety of data in the same coordinate reference frame to enable comparison, analysis, data evaluation, and data generation; 3) Providing a version-controlled science algorithm development environment that supports tools, co-located data and processing resources; and 4) Addressing intellectual property and sharing challenges related to collaborative algorithm development and sharing of data and algorithms. MAAP products can be explored on the MAAP Dashboard at https://earthdata.nasa.gov/maap-biomass or the joint platform entrance at scimaap.net. MAAP also can be accessed through individual NASA (https://maap-project.org) and ESA (https://esa-maap.org/) landing pages.

cloud computing↗

A Fast Infrared Radiative Transfer Model for Overlapping Clouds

A fast infrared radiative transfer model (FIRTM2) appropriate for application to both single-layered and overlapping cloud situations is developed for simulating the outgoing infrared spectral radiance at the top of the atmosphere (TOA). In FIRTM2 a pre-computed library of cloud reflectance and transmittance values is employed to account for one or two cloud layers, whereas the background atmospheric optical thickness due to gaseous absorption can be computed from a clear-sky radiative transfer model. FIRTM2 is applicable to three atmospheric conditions: 1) clear-sky, 2) single-layered ice or water cloud, and 3) two simultaneous cloud layers in a column (e.g., ice cloud overlying water cloud). Moreover, FIRTM2 outputs the derivatives (i.e., Jacobians) of the TOA brightness temperature with respect to cloud optical thickness and effective particle size. Sensitivity analyses have been carried out to assess the performance of FIRTM2 for two spectral regions, namely the longwave (LW) band (587.3 - 1179.5/cm) and the short-to-medium wave (SMW) band (1180.1 - 2228.9/cm). The assessment is carried out in terms of brightness temperature differences (BTD) between FIRTM2 and the well-known discrete ordinates radiative transfer model (DISORT), henceforth referred to as BTD (F-D). The BTD (F-D) values for single-layered clouds are generally less than 0.8 K. For the case of two cloud layers (specifically ice cloud over water cloud), the BTD(F-D) values are also generally less than 0.8 K except for the SMW band for the case of a very high altitude (>15 km) cloud comprised of small ice particles. Note that for clear-sky atmospheres, FIRTM2 reduces to the clear-sky radiative transfer model that is incorporated into FIRTM2, and the errors in this case are essentially those of the clear-sky radiative transfer model.

Niu, Jianguo↗

Translucent molecular clouds: Theory and observations

Few suitable stars behind molecular clouds have been identified. A limited survey was performed of interstellar lines toward highly reddened stars in the southern sky, using the ESO 1.4 m CAT telescope with a Reticon detector, and the Cerro Tololo 4 m telescope equipped with a GEC charge coupled device (CCD) detector. Because of the reduced extinction at longer wavelengths, molecules were searched for with transitions in the red part of the spectrum such as C2 and CN. For some lines-of-sight for which C2 was detected, the 4300 A line of CH was also observed. Absorption lines of interstellar C2 around 8750 A were detected in the spectra of about 1/4 of the 36 observed stars. The inferred C2 column densities range between 10 to the 13th power and 10 to the 14th power sq. cm., and are up to an order of magnitude larger than those found for diffuse clouds. The observed column densities of CH correlate very well with those of C2 over this range. In contrast, the measured column densities of CN vary by orders of magnitude between the various regions, and they do not correlate with those of C2 and CH. The observed rotational population distribution of C2 also provides information about the physical conditions in the clouds. Models of translucent molecular clouds have been constructed along the lines described by van Dishoeck and Black (1986) for diffuse clouds. The models compute accurately the fractions of atomic and molecular hydrogen as functions of depth into the clouds, as well as the excitation of H2 by ultraviolet pumping. They also incorporate a detailed treatment of the photodissociation processes of the molecules (cf. van Dishoeck 1986), which play an important role in the chemistry up to depths of about 3 mag.

Vandishoeck, E. F.↗

Big Data in the Earth Observing System Data and Information System

Approaches that are being pursued for the Earth Observing System Data and Information System (EOSDIS) data system to address the challenges of Big Data were presented to the NASA Big Data Task Force. Cloud prototypes are underway to tackle the volume challenge of Big Data. However, advances in computer hardware or cloud won't help (much) with variety. Rather, interoperability standards, conventions, and community engagement are the key to addressing variety.

data systems↗

A New Approach to Using a Cloud-Resolving Model to Study the Interactions between Clouds, Precipitation and Aerosols

Recently Grabowski and Khairoutdinov and Randall have proposed and demonstrated, the feasibility of using 2D CRMs (these did not include detailed land processes and used periodic lateral boundary conditions) as 'super-parameterizations or a multi-scale modeling framework MMF' for cloud processes within atmospheric generation circulation models (GCMs). In the MMF, a fine-resolution 2D CRM takes the place of the single-column parameterization that is used in conventional GCMs. An overview of this approach is given by Randall et al.. Since a CRM can explicitly simulate cloud processes at the natural space and time scales of clouddynamical processes, it's possible to compute statistics of cloud fields, including radiances and radar backscatters, directly simulated/produced by the CRM. A seed fund is available at NASA Goddard to build a MMF based on a 2D GCE model and the Goddard fvGCM. A prototype MMF will be developed at end of 2004. The major objectives are to test and evaluate its performance using the GCE model as the super parameterization and compare its results with other super parameterizations, conventional GCMs and observations. Recently, a detailed spectral-bin microphysical scheme was implemented into the Goddard Cumulus Ensemble (WE) model. The GCE model is a CRM and it has been improved and applied to study the precipitation processes in the past two decades. Atmospheric aerosols are also described using number density size-distribution functions. The model is tested by studying the evolution of deep tropical clouds in the west Pacific warm pool region and summertime convection over a mid-latitude continent with different concentrations of CCN: a low 'clean' concentration and a high 'dirty' concentration. The impact of atmospheric aerosol concentration on cloud and precipitation will be investigated. In addition, the similarities and differences between bulk- and spectral-bin microphysics will be presented,

Tao, Wei-Kuo↗