Search NASA⌕ Search

SEARCH · Search NASA

Results for “cloud applications”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Fast Simulators for Satellite Cloud Optical Centroid Pressure Retrievals, 1. Evaluation of OMI Cloud Retrievals

The cloud Optical Centroid Pressure (OCP), also known as the effective cloud pressure, is a satellite-derived parameter that is commonly used in trace-gas retrievals to account for the effects of clouds on near-infrared through ultraviolet radiance measurements. Fast simulators are desirable to further expand the use of cloud OCP retrievals into the operational and climate communities for applications such as data assimilation and evaluation of cloud vertical structure in general circulation models. In this paper, we develop and validate fast simulators that provide estimates of the cloud OCP given a vertical profile of optical extinction. We use a pressure-weighting scheme where the weights depend upon optical parameters of clouds and/or aerosol. A cloud weighting function is easily extracted using this formulation. We then use fast simulators to compare two different satellite cloud OCP retrievals from the Ozone Monitoring Instrument (OMI) with estimates based on collocated cloud extinction profiles from a combination of CloudS at radar and MODIS visible radiance data. These comparisons are made over a wide range of conditions to provide a comprehensive validation of the OMI cloud OCP retrievals. We find generally good agreement between OMI cloud OCPs and those predicted by CloudSat. However, the OMI cloud OCPs from the two independent algorithms agree better with each other than either does with the estimates from CloudSat/MODIS. Differences between OMI cloud OCPs and those based on CloudSat/MODIS may result from undetected snow/ice at the surface, cloud 3-D effects, low altitude clouds missed by CloudSat, and the fact that CloudSat only observes a relatively small fraction of an OMI field-of-view.

Joiner, J.↗

A case study of tuning MapReduce for efficient Bioinformatics in the cloud

The combination of the Hadoop MapReduce programming model and cloud computing allows biological scientists to analyze next-generation sequencing (NGS) data in a timely and cost-effective manner. Cloud computing platforms remove the burden of IT facility procurement and management from end users and provide ease of access to Hadoop clusters. However, biological scientists are still expected to choose appropriate Hadoop parameters for running their jobs. More importantly, the available Hadoop tuning guidelines are either obsolete or too general to capture the particular characteristics of bioinformatics applications. In this paper, we aim to minimize the cloud computing cost spent on bioinformatics data analysis by optimizing the extracted significant Hadoop parameters. When using MapReduce-based bioinformatics tools in the cloud, the default settings often lead to resource underutilization and wasteful expenses. We choose k-mer counting, a representative application used in a large number of NGS data analysis tools, as our study case. Experimental results show that, with the fine-tuned parameters, we achieve a total of 4× speedup compared with the original performance (using the default settings). Finally, this paper presents an exemplary case for tuning MapReduce-based bioinformatics applications in the cloud, and documents the key parameters that could lead to significant performance benefits.

97 MATHEMATICS AND COMPUTING↗

H31G-1596: DeepSAT's CloudCNN: A Deep Neural Network for Rapid Cloud Detection from Geostationary Satellites

Cloud and cloud shadow detection has important applications in weather and climate studies. It is even more crucial when we introduce geostationary satellites into the field of terrestrial remote sensing. With the challenges associated with data acquired in very high frequency (10-15 mins per scan), the ability to derive an accurate cloud shadow mask from geostationary satellite data is critical. The key to the success for most of the existing algorithms depends on spatially and temporally varying thresholds,which better capture local atmospheric and surface effects.However, the selection of proper threshold is difficult and may lead to erroneous results. In this work, we propose a deep neural network based approach called CloudCNN to classify cloudshadow from Himawari-8 AHI and GOES-16 ABI multispectral data. DeepSAT's CloudCNN consists of an encoderdecoder based architecture for binary-class pixel wise segmentation. We train CloudCNN on multi-GPU Nvidia Devbox cluster, and deploy the prediction pipeline on NASA Earth Exchange (NEX) Pleiades supercomputer. We achieved an overall accuracy of 93.29% on test samples. Since, the predictions take only a few seconds to segment a full multispectral GOES-16 or Himawari-8 Full Disk image, the developed framework can be used for real-time cloud detection, cyclone detection, or extreme weather event predictions.

GOES-1↗

Grid Operator Analytics and Assessment Tools for Inverter- Based Resources Dominated Grid (GOAAT-IBR) Project Update

This presentation provides an update on the OPTIMA GOAAT project, with emphasis on the cloud-native data platform developed in-house to ingest, manage, and operationalize high-resolution power system data. Since our last NASPI presentation, accessible via OSTI ID #2671437, the project team advanced the design and deployment of a scalable architecture capable of handling both synchronized and non-synchronized streams, including PMU, point-on-wave (POW), COMTRADE, and SCADA data. These materials review the project status, recent progress, and key lessons learned. The core of the presentation examines the architecture and engineering of our cloud-native ingestion and data management platform. We then explain how pipelines were designed to collect, normalize, time-align, store, and serve heterogeneous data at scale. We will discuss design choices such as data models, streaming versus batch ingestion, storage tiers, and interoperability with analytics applications. Practical experiences with cloud-native technologies were shared during the event, including benefits, limitations, and integration challenges in a utility environment, along with methods used to improve performance, reduce latency, and optimize resource usage. The presentation also showcases user interface designs and visualization tools that convert raw measurements and analytics results into intuitive, actionable insights for operators and engineers. During the presentation examples were provided demonstrating how visualization, event views, and summarized analytics enhance situational awareness and support operational decision-making. These use cases illustrate how a well-designed data infrastructure can bridge the gap between high-volume measurements and practical grid operations.

Aminifar, Farrokh↗

A comparison of Amazon Web Services and Microsoft Azure cloud platforms for high performance computing

Advances in commercial cloud computing necessitate continual evaluation of the cloud's performance on a variety of applications. This work looks at compute oriented instances from Amazon Web Services and Microsoft Azure cloud platforms and evaluates them with several high-performance computing benchmarks, including HPCC and HPCG. These benchmarks illustrate that the most cost competitive solution depends on the application to be run.

Kotas, Charlotte↗

A Linearized Prognostic Cloud Scheme in NASAs Goddard Earth Observing System Data Assimilation Tools

A linearized prognostic cloud scheme has been developed to accompany the linearized convection scheme recently implemented in NASA's Goddard Earth Observing System data assimilation tools. The linearization, developed from the nonlinear cloud scheme, treats cloud variables prognostically so they are subject to linearized advection, diffusion, generation, and evaporation. Four linearized cloud variables are modeled, the ice and water phases of clouds generated by large-scale condensation and, separately, by detraining convection. For each species the scheme models their sources, sublimation, evaporation, and autoconversion. Large-scale, anvil and convective species of precipitation are modeled and evaporated. The cloud scheme exhibits linearity and realistic perturbation growth, except around the generation of clouds through large-scale condensation. Discontinuities and steep gradients are widely used here and severe problems occur in the calculation of cloud fraction. For data assimilation applications this poor behavior is controlled by replacing this part of the scheme with a perturbation model. For observation impacts, where efficiency is less of a concern, a filtering is developed that examines the Jacobian. The replacement scheme is only invoked if Jacobian elements or eigenvalues violate a series of tuned constants. The linearized prognostic cloud scheme is tested by comparing the linear and nonlinear perturbation trajectories for 6-, 12-, and 24-h forecast times. The tangent linear model performs well and perturbations of clouds are well captured for the lead times of interest.

Precipitation↗

If We Build Them, They Will Run: Automated HPC Apps Deployment and Profiling with eBPF in Cloud

The high performance computing (HPC) community is in a period of transition. The rise of AI/ML coupled with a changing landscape of resources deems portability a new metric of performance, and methods to move between on-premises and cloud environments and assess compatibility are paramount. Here we design and test a strategy for bridging the gap between traditional HPC and Kubernetes environments – first containerizing applications, providing automated orchestration to run studies, and packaging the setup with automated means to assess performance using low overhead eXtended Berkeley Packet Filter (eBPF) programs. We first assess different designs for eBPF collection, demonstrating a tradeoff between number of programs deployed on a node and overhead added. We develop 5 low overhead eBPF programs that combine with streaming ML models to assess CPU, futex, TCP, shared memory, and file access across four different builds of an HPC application for CPU and GPU. We use eBPF data to generate insights into the possible underlying etiology of scaling issues. We then assess compatibility of a well-known benchmark, HPCG, across matrices of micro-architectures and optimization levels (217 containers across 24 instance types and over 7500 runs). We provide to the community 30 applications to deploy in our automated setup and perform a scaling study from 4 to a maximum of 256 nodes for both CPU and GPU applications. Finally, we use our gained knowledge about performance to generate compatibility artifacts that are used by a newly developed Kubernetes controller to intelligently select instance type based on optimizing a figure of merit. Along with insights to scaling in this environment with a collection of applications and templates to work from, we provide an overall strategy for approaching HPC application deployment and image selection based on compatibility in cloud.

Computer science↗

Optical properties of marine stratocumulus clouds modified by ships

Results are presented of an application of the diffusion domain method to multispectral solar radiation measurements obtained deep within a marine stratocumulus cloud layer modified by pollution from ships. In situ airborne measurements of the relative angular distribution of scattered radiation are compared to known asymptotic expressions for the intensity field deep within an optically thick cloud layer. Analytical expressions relating the ratio of the nadir-to-zenith intensities to surface reflectance, similarity parameter, and scaled optical depth beneath the aircraft flight level are used to analyze measurements obtained with the cloud absorption radiometer mounted on the University of Washington's C-131A research aircraft. It is shown that the total optical thickness of the cloud layer increased in the ship tracks, in contrast to the similarity parameter, which decreased. The decrease in absorption was a direct consequence of the reduction in cloud droplet size that occurred within the ship tracks.

King, Michael D.↗

Observations and Modeling of the Green Ocean Amazon 2014/15. CHUVA Field Campaign Report

The physical processes inside clouds are one of the most unknown components of weather and climate systems. A description of cloud processes through the use of standard meteorological parameters in numerical models has to be strongly improved to accurately describe the characteristics of hydrometeors, latent heating profiles, radiative balance, air entrainment, and cloud updrafts and downdrafts. Numerical models have been improved to run at higher spatial resolutions where it is necessary to explicitly describe these cloud processes. For instance, to analyze the effects of global warming in a given region it is necessary to perform simulations taking into account all of the cloud processes described above. Another important application that requires this knowledge is satellite precipitation estimation. The analysis will be performed focusing on the microphysical evolution and cloud life cycle, different precipitation estimation algorithms, the development of thunderstorms and lightning formation, processes in the boundary layer, and cloud microphysical modeling. This project intends to extend the knowledge of these cloud processes to reduce the uncertainties in precipitation estimation, mainly from warm clouds, and, consequently, improve knowledge of the water and energy budget and cloud microphysics.

54 ENVIRONMENTAL SCIENCES↗

Remote Sensing of Cloud, Aerosol, and Water Vapor Properties from MODIS

MODIS is an earth-viewing cross-track scanning spectroradiometer launched on the Terra satellite in December 1999. MODIS scans a swath width sufficient to provide nearly complete global coverage every two days from a polar orbiting, sun-synchronous, platform at an altitude of 705 kilometers, and provides images in 36 spectral bands between 0.415 and 14.235 micrometers with spatial resolutions of 250 meters (2 bands), 500 meters (5 bands) and 1000 meters (29 bands). These bands have been carefully selected to enable advanced studies of land, ocean, and atmospheric processes. In this presentation we review the comprehensive set of remote sensing algorithms that have been developed for the remote sensing of atmospheric properties using MODIS data, placing primary emphasis on the principal atmospheric applications of (i) developing a cloud mask for distinguishing clear sky from clouds, (ii) retrieving global cloud radiative and microphysical properties, including cloud top pressure and temperature, effective emissivity, cloud optical thickness, thermodynamic phase, and effective radius, (iii) monitoring tropospheric aerosol optical thickness over the land and ocean and aerosol size distribution over the ocean, (iv) determining atmospheric profiles of moisture and temperature, and (v) estimating column water amount. The physical principles behind the determination of each of these atmospheric products will be described, together with an example of their application using MODIS observations. All products are archived into two categories: pixel-level retrievals (referred to as Level-2 products) and global gridded products at a latitude and longitude resolution of 1 degree (Level-3 products). An overview of the MODIS atmosphere algorithms and products, status, validation activities, and early level-2 and -3 results will be presented.

King, Michael D.↗

Observations of the Spectral Distribution of Solar Irradiance at the Ground During SUCCESS

During SUCCESS two independent and independently calibrated spectrometers were deployed at a surface site to determine the spectrally resolved downwelling solar irradiance. Preliminary evidence shows that for cloud-free conditions there is general agreement between measurements and model derived irradiance, at least to within instrumental and model uncertainties of 5%, with greatest disagreement Occurring in the 400 nm - 700 nm band. Cirrus effects are most prominent in the near-infrared bands beyond 1500 nm while the influence of very thin (subvisual) cirrus is evident in the scattered flux at the surface. Further remote sensing applications and the assessment of cloud absorption is contingent upon measurements of the surface spectral albedo.

Pilewskie, Peter↗

Remote Sensing of Cloud, Aerosol, and Water Vapor Properties from MODIS

MODIS is an earth-viewing cross-track scanning spectroradiometer launched on the Terra satellite in December 1999. MODIS scans a swath width sufficient to provide nearly complete global coverage every two days from a polar-orbiting, sun-synchronous, platform at an altitude of 705 km, and provides images in 36 spectral bands from 0.415 to 14.235 microns with spatial resolutions of 250 m (2 bands), 500 m (5 bands) and 1000 m (29 bands). These bands have been carefully selected to enable advanced studies of land, ocean, and atmospheric processes. In this presentation I will review the comprehensive set of remote sensing algorithms that have been developed for the remote sensing of atmospheric properties using MODIS data, placing primary emphasis on the principal atmospheric applications of: (1) developing a cloud mask for distinguishing clear sky from clouds, (2) retrieving global cloud radiative and microphysical properties, including cloud top pressure and temperature, effective emissivity, cloud optical thickness, thermodynamic phase, and effective radius, (3) monitoring tropospheric aerosol optical thickness over the land and ocean and aerosol size distribution over the ocean, (4) determining atmospheric profiles of moisture and temperature, and (5) estimating column water amount. The physical principles behind the determination of each of these atmospheric products will be described, together with an example of their application using MODIS observations. All products are archived into two categories: pixel-level retrievals (referred to as Level-2 products) and global gridded products at a latitude and longitude resolution of 1 deg (Level-3 products). An overview of the MODIS atmosphere algorithms and products, status, validation activities, and early level-2 and -3 results will be presented. Finally, I will present some highlights from the land and ocean algorithms developed for processing global MODIS observations, including: (1) surface reflectance, (2) vegetation indices, leaf area index, and FPAR, (3) albedo and nadir BRDF-adjusted reflectance, (4) normalized water-leaving radiance, (5) chlorophyll-a concentration, and (6) sea surface temperature.

King, Michael D.↗

Lidar Remote Sensing for Industry and Environment Monitoring

Contents include the following: 1. Keynote paper: Overview of lidar technology for industrial and environmental monitoring in Japan. 2. lidar technology I: NASA's future active remote sensing mission for earth science. Geometrical detector consideration s in laser sensing application (invited paper). 3. Lidar technology II: High-power femtosecond light strings as novel atmospheric probes (invited paper). Design of a compact high-sensitivity aerosol profiling lidar. 4. Lasers for lidars: High-energy 2 microns laser for multiple lidar applications. New submount requirement of conductively cooled laser diodes for lidar applications. 5. Tropospheric aerosols and clouds I: Lidar monitoring of clouds and aerosols at the facility for atmospheric remote sensing (invited paper). Measurement of asian dust by using multiwavelength lidar. Global monitoring of clouds and aerosols using a network of micropulse lidar systems. 6. Troposphere aerosols and clouds II: Scanning lidar measurements of marine aerosol fields at a coastal site in Hawaii. 7. Tropospheric aerosols and clouds III: Formation of ice cloud from asian dust particles in the upper troposphere. Atmospheric boundary layer observation by ground-based lidar at KMITL, Thailand (13 deg N, 100 deg. E). 8. Boundary layer, urban pollution: Studies of the spatial correlation between urban aerosols and local traffic congestion using a slant angle scanning on the research vessel Mirai. 9. Middle atmosphere: Lidar-observed arctic PSC's over Svalbard (invited paper). Sodium temperature lidar measurements of the mesopause region over Syowa Station. 10. Differential absorption lidar (dIAL) and DOAS: Airborne UV DIAL measurements of ozone and aerosols (invited paper). Measurement of water vapor, surface ozone, and ethylene using differential absorption lidar. 12. Space lidar I: Lightweight lidar telescopes for space applications (invited paper). Coherent lidar development for Doppler wind measurement from the International Space Station. 13. Space lidar II: Using coherent Doppler lidar to estimate river discharge. 14. Poster session: Lidar technology, optics for lidar. Laser for lidar. Middle atmosphere observations. Tropospheric observations (aerosols, clouds). Boundary layer, urban pollution. Differential absorption lidar. Doppler lidar. and Space lidar.

Singh, Upendra N.↗

Chemical evolution of dense clouds

Attention is given to chemical processes which could determine the molecular composition of the cloud during the several stages of its evolution, taking into account thermal reactions at the relatively high interstellar densities expected during the processes. The origin of the observed molecules is discussed together with questions of molecular evolution during collapse of the cloud and the role of organic molecules in planetary chemical evolution. A number of experiments are also considered along with the application of the experimental results to cloud equilibrium problems.

Chapelle, E. W.↗

Cloud Detection Using Measured and Modeled State Parameters

In this study, hourly RUC analyses were used to examine the differences between RH and temperature values from RUC reanalysis data and from radiosonde atmospheric profiles obtained at the ARM SCF. The results show that the temperature observations from the SONDE and RUC are highly correlated. The RHs are also well-correlated, but the SONDE values generally exceed those from RUC. Inside cloud layers, the RH from RUC is 2-14% lower than the RH from SONDE for all RUC layers. Although the layer mean RH within clouds is much greater than the layer mean RH outside cloud or in the clear-sky, RH thresholds chosen as a function of temperature can more accurately diagnose cloud occurrence for either dataset. For overcast clouds, it was found that the 50% probability RH threshold for diagnosing a cloud, within a given upper tropospheric layer is roughly 90% for the Vaisala RS80-15LH radisonde and 80% for RUC data. While for the partial cloud (cloud amount is less than 90%), the RH thresholds of SONDE are close to RUC for a given probability in upper tropospheric layers. The probabilities of detecting clouds at a given RH and temperature should be useful for a variety of application such as the development of new cloud parameterizations or for estimating the vertical profile of cloudiness underneath a given cloud observed from the satellite to construct a 3-D cloud data set for computing atmospheric radiative heating profiles or determining potential aircraft icing conditions.

Yi, Y.↗

The Use of the Deep Convective Cloud Technique (DCCT) to Monitor On-Orbit Performance of the Geostationary Lightning Mapper (GLM): Use of Lightning Imaging Sensor (LIS) Data as Proxy

The Geostationary Lightning Mapper (GLM) on the next generation Geostationary Operational Environmental Satellite-R (GOES-R) will not have onboard calibration capability to monitor its performance. The Lightning Imaging Sensor (LIS) onboard the Tropical Rainfall Measuring Mission (TRMM) satellite has been providing observations of total lightning over the Earth's Tropics since 1997. The GLM design is based on LIS heritage, making it a good proxy dataset. This study examines the performance of LIS throughout its time in orbit. This was accomplished through application of the Deep Convective Cloud Technique (DCCT) (Doelling et al., 2004) to LIS background pixel radiance data. The DCCT identifies deep convective clouds by their cold Infrared (IR) brightness temperatures and using them as invariant targets in the solar reflective portion of the solar spectrum. The GLM and LIS operate in the near-IR at a wavelength of 777.4 nm. In the present study the IR data is obtained from the Visible Infrared Sensor (VIRS) which is collocated with LIS onboard the Tropical Rainfall Measuring Mission (TRMM) satellite. The DCCT is applied to LIS observations for July and August of each year from 1998-2010. The resulting distributions of LIS background DCC pixel radiance for each July August are very similar, indicating stable performance. The mean radiance of the DCCT analysis does not show a long term trend and the maximum deviation of the July August mean radiance for each year is within 0.7% of the overall mean. These results demonstrate that there has been no discernible change in LIS performance throughout its lifetime. A similar approach will used for monitoring the performance of GLM, with cold clouds identified using IR data from the Advanced Baseline Imager (ABI) which will also be located on GOES-R. Since GLM is based on LIS design heritage, the LIS results indicate that GLM should also experience stable performance over its lifetime.

Buechler, Dennis E.↗

Cloud and Aerosol Measurements from the GLAS Polar Orbiting Lidar: First Year Results

The Geoscience Laser Altimeter System (GLAS) launched in 2003 is the first polar orbiting satellite lidar. The instrument was designed for high performance observations of the distribution and optical scattering cross sections of clouds and aerosol. GLAS is approaching six months of on orbit data operation. These data from thousands of orbits illustrate the ability of space lidar to accurately and dramatically measure the height distribution of global cloud and aerosol to an unprecedented degree. There were many intended science applications of the GLAS data and significant results have already been realized. One application is the accurate height distribution and coverage of global cloud cover with one goal of defining the limitation and inaccuracies of passive retrievals. Comparison to MODIS cloud retrievals shows notable discrepancies. Initial comparisons to NOAA 14&15 satellite cloud retrievals show basic similarity in overall cloud coverage, but important differences in height distribution. Because of the especially poor performance of passive cloud retrievals in polar regions, and partly because of high orbit track densities, the GLAS measurements are by far the most accurate measurement of Arctic and Antarctica cloud cover from space to date. Global aerosol height profiling is a fundamentally new measurement from space with multiple applications. A most important aerosol application is providing input to global aerosol generation and transport models. Another is improved measurement of aerosol optical depth. Oceanic surface energy flux derivation from PBL and LCL height measurements is another application of GLAS data that is being pursued. A special area of work for GLAS data is the correction and application of multiple scattering effects. Stretching of surface return pulses in excess of 40 m from cloud propagation effects and other interesting multiple scattering phenomena have been observed. As an EOS project instrument, GLAS data products are openly available to the science community. First year results from GLAS are summarized.

Spinhirne, J. D.↗

Satellite Sounder Products in NASA GES DISC & Services Supporting Their Applications

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC), in collaboration with NASA Sounder Team at the Jet Propulsion Laboratory (JPL), provides processing, archiving, and distribution services for remotely-sensed data acquired by satellite sounders. Supported data sets begin chronologically with the legacy TIROS Operational Vertical Sounder (TOVS) Pathfinder, continue to the Atmospheric Infrared Sounder (AIRS), a modern hyperspectral sounder onboard the Aqua satellite, and are followed by data from the subsequent Suomi-National Polar-orbiting Partnership Cross-track Infrared Sounder (CrIS) mission and the Joint Polar Satellite System (JPSS) series CrIS missions. These satellite sounders provide long-term global observations of the atmospheric state, including temperature and humidity profiles, outgoing longwave radiation, cloud properties, and trace gases. Applications of sounder data products cover a broad range of fields, including meteorology climatology, hydrology, and air quality. The GES DISC has developed many services to assist users, including simplified and efficient methods for searching, accessing, downloading, and analytically exploring these satellite sounder data products. We have also developed the Giovanni system, a broadly used Web-based application, which provides a simple and intuitive way to visualize, analyze, and access Earth science remote sensing data. In this presentation, we will introduce the standard and near-real time sounder data products, and demonstrate our services through some use cases. Highlights of our service capabilities include data subset, vertical profile plot, inter-comparison, multi-year monthly/seasonal mean, interannual monthly/seasonal time series, and anomaly analysis.

Ding, Feng↗