Effective Cloud Detection and Segmentation Using a Gradient-Based Algorithm for Satellite Imagery: Application to Improve PERSIANN-CCS
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
In this paper we explore the application of combined millimeter-wave radar and radiometry to remotely measure snowfall. During January-February of 2003, a field campaign was conducted with the NASA P-3 aircraft in Wakasa Bay, Japan for the validation of the AMSRE microwave radiometer on board the Aqua satellite. Among the suite of instruments-on board the P-3 aircraft were the Millimeter-wave Imaging Radiometer (MIR) from the NASA Goddard Space Flight Center and the 94 GHz Airborne Cloud Radar (ACR) which is co-owned and operated by NASA Jet Propulsion Laboratory/University of Massachusetts. MIR is a total power, across-track scanning radiometer that measures radiation at the frequencies of 89, 150, 183.3 +/- 1, 183.3 +/- 3, 183.3 +/-7, 220, and 340 GHz. The MIR has flown many successful missions since its completion in May 1992. ACR is a newer instrument and flew only a few times prior to the Wakasa Bay deployment. These two instruments which are particularly well suited for the detection of snowfall functioned normally during flights over snowfall and excellent data sets were acquired. On January 14, 28, and 29 flights were conducted over snowfall events. The MIR and ACR detected strong signals during periods of snowfall over ocean and land. Results from the analysis of these concurrent data sets show that (1) the scattering of millimeter-wave radiation as detected by the MIR is strongly correlated with ACR radar reflectivity profiles, and (2) the scattering is highly frequency-dependent, the higher the frequency the stronger the scattering. Additionally, the more transparent channels of the MIR (e.g., 89, 150, and 220 GHz) are found to display ambiguous signatures of snowfall because of their exposure to surface features. Thus, the snowfall detection and retrievals of snowfall parameters, such as the ice water path (IWP) and median mass diameter (D(me)) are best conducted at the more opaque channels near 183.3 GHz and 340 GHz. Retrievals of IWP and D(me) using the MIR measurements at 183.3 and 340 GHZ are currently in progress, and the results will be compared with those derived from the ACR reflectivity profiles. Implication from this comparison will be discussed.
This year the Argonne Leadership Computing Facility (ALCF) delivered nearly 900 million core hours of science. The research conducted at their leadership class facility touched our lives in both minute and massive ways - whether it was studying the catalytic properties of gold nanoparticles, predicting protein structures, or unearthing the secrets of exploding stars. The authors remained true to their vision to act as the forefront computational center in extending science frontiers by solving pressing problems for our nation. Our success in this endeavor was due mainly to the Department of Energy's (DOE) INCITE (Innovative and Novel Computational Impact on Theory and Experiment) program. The program awards significant amounts of computing time to computationally intensive, unclassified research projects that can make high-impact scientific advances. This year, DOE allocated 400 million hours of time to 28 research projects at the ALCF. Scientists from around the world conducted the research, representing such esteemed institutions as the Princeton Plasma Physics Laboratory, National Institute of Standards and Technology, and European Center for Research and Advanced Training in Scientific Computation. Argonne also provided Director's Discretionary allocations for research challenges, addressing such issues as reducing aerodynamic noise, critical for next-generation 'green' energy systems. Intrepid - the ALCF's 557-teraflops IBM Blue/Gene P supercomputer - enabled astounding scientific solutions and discoveries. Intrepid went into full production five months ahead of schedule. As a result, the ALCF nearly doubled the days of production computing available to the DOE Office of Science, INCITE awardees, and Argonne projects. One of the fastest supercomputers in the world for open science, the energy-efficient system uses about one-third as much electricity as a machine of comparable size built with more conventional parts. In October 2009, President Barack Obama recognized the excellence of the entire Blue Gene series by awarding it to the National Medal of Technology and Innovation. Other noteworthy achievements included the ALCF's collaboration with the National Energy Research Scientific Computing Center (NERSC) to examine cloud computing as a potential new computing paradigm for scientists. Named Magellan, the DOE-funded initiative will explore which science application programming models work well within the cloud, as well as evaluate the challenges that come with this new paradigm. The ALCF obtained approval for its next-generation machine, a 10-petaflops system to be delivered in 2012. This system will allow us to resolve ever more pressing problems, even more expeditiously through breakthrough science in the years to come.
We report the development of a novel Lagrangian microphysics methodology for simulations of warm ice-free clouds. The approach applies the traditional Eulerian method for the momentum and continuous thermodynamic fields such as the temperature and water vapor mixing ratio, and uses Lagrangian super-droplets to represent condensed phase such as cloud droplets and drizzle or rain drops. In other applications of the Lagrangian warm-rain microphysics, the super-droplets outside clouds represent unactivated cloud condensation nuclei (CCN) that become activated upon entering a cloud and can further grow through diffusional and collisional processes. The original methodology allows for the detailed study of not only effects of CCN on cloud microphysics and dynamics, but also CCN processing by a cloud. However, when cloud processing is not of interest, a simpler and computationally more efficient approach can be used with super-droplets forming only when CCN is activated and no super-droplet existing outside a cloud. This is possible by applying the Twomey activation scheme where the local supersaturation dictates the concentration of cloud droplets that need to be present inside a cloudy volume, as typically used in Eulerian bin microphysics schemes. Since a cloud volume is a small fraction of the computational domain volume, the Twomey super-droplets provide significant computational advantage when compared to the original super-droplet methodology. Additional advantage comes from significantly longer time steps that can be used when modeling of CCN deliquescence is avoided. Moreover, other formulation of the droplet activation can be applied in case of low vertical resolution of the host model, for instance, linking the concentration of activated cloud droplets to the local updraft speed. This paper discusses the development and testing of the Twomey super-droplet methodology, focusing on the activation and diffusional growth. Details of the activation implementation, transport of super-droplets in the physical space, and the coupling between super-droplets and the Eulerian temperature and water vapor field are discussed in detail. Some of these are relevant to the original super-droplet methodology as well and to the ice phase modeling using the Lagrangian approach. As a computational example, the scheme is applied to an idealized moist thermal rising in a stratified environment, with the original super-droplet methodology providing a benchmark to which the new scheme is compared.
A computationally efficient method is presented to account for the horizontal cloud inhomogeneity by using a radiatively equivalent plane parallel homogeneous (PPH) cloud. The algorithm can accurately match the calculations of the reference (rPPH) independent column approximation (ICA) results, but use only the same computational time required for a single plane parallel computation. The effective optical depth of this synthetic sPPH cloud is derived by exactly matching the direct transmission to that of the inhomogeneous ICA cloud. The ffective9 scattering asymmetry factor is found from a pre-calculated albedo inverse look-up-table that is allowed to vary over the range from -1.0 to 1.0. In the special cases of conservative scattering and total absorption, the synthetic method is exactly equivalent to the ICA, with only a small bias (about 0.2% in flux) relative to ICA due to imperfect interpolation in using the look-up tables. In principle, the ICA albedo can be approximated accurately regardless of cloud inhomogeneity. For a more complete comparison, the broadband shortwave albedo and transmission calculated from the synthetic sPPH cloud and averaged over all incident directions, have the RMS biases of 0.26% and 0.76%, respectively, for inhomogeneous clouds over a wide variation of particle size. The advantages of the synthetic PPH method are that (1) it is not required that all the cloud subcolumns have uniform microphysical characteristic, (2) it is applicable to any 1D radiative transfer scheme, and (3) it can handle arbitrary cloud optical depth distributions and an arbitrary number of cloud subcolumns with uniform computational efficiency.
The potential for utilizing data gathered by Nimbus satellites to study the earth surface and its physical properties is illustrated. The Nimbus data applicable to investigations of the earth and its resources, and to the problems of resolution and cloud cover are described. Geological, hydrological, and oceanographic applications are discussed. Applications of the data to other fields, such as cartography, agriculture, forestry, and urban analysis are presented. Relevant information is also given on the Nimbus orbit and experiments; surface and atmospheric effects on HRIR and THIR radiation measurements; and noise problems in the AVCS, IDCS, HRIR, and THIR data.
The NASA Short-term Prediction Research and Transition (SPoRT) Center focuses on the transition of unique observations and research capabilities to the operational weather community, with a goal of improving short-term forecasts on a regional scale. Advances in research computing have lead to "Climate in a Box" systems, with hardware configurations capable of producing high resolution, near real-time weather forecasts, but with footprints, power, and cooling requirements that are comparable to desktop systems. The SPoRT Center has developed several capabilities for incorporating unique NASA research capabilities and observations with real-time weather forecasts. Planned utilization includes the development of a fully-cycled data assimilation system used to drive 36-48 hour forecasts produced by the NASA Unified version of the Weather Research and Forecasting (WRF) model (NU-WRF). The horsepower provided by the "Climate in a Box" system is expected to facilitate the assimilation of vertical profiles of temperature and moisture provided by the Atmospheric Infrared Sounder (AIRS) aboard the NASA Aqua satellite. In addition, the Moderate Resolution Imaging Spectroradiometer (MODIS) instruments aboard NASA s Aqua and Terra satellites provide high-resolution sea surface temperatures and vegetation characteristics. The development of MODIS normalized difference vegetation index (NVDI) composites for use within the NASA Land Information System (LIS) will assist in the characterization of vegetation, and subsequently the surface albedo and processes related to soil moisture. Through application of satellite simulators, NASA satellite instruments can be used to examine forecast model errors in cloud cover and other characteristics. Through the aforementioned application of the "Climate in a Box" system and NU-WRF capabilities, an end goal is the establishment of a real-time forecast system that fully integrates modeling and analysis capabilities developed within the NASA SPoRT Center, with benefits provided to the operational forecasting community.
Nomograms of mean column heating due to surface sensible and latent heat fluxes were developed. Mean sensible heating of the cloud free region is related to the cloud free path (CFP, the distance from the shore to the first cloud formation) and the difference between land air and sea surface temperatures, theta sub 1 and theta sub 0, respectively. Mean latent heating is related to the CFP and the difference between land air and sea surface humidities q sub 1 and q sub 0 respectively. Results are also applicable to any path within the cloud free region. Corresponding heat fluxes may be obtained by multiplying the mean heating by the mean wind speed in the boundary layer. The sensible heating estimated by the present method is found to be in good agreement with that computed from the bulk transfer formula. The sensitivity of the solutions to the variations in the initial coastal soundings and large scale subsidence is also investigated. The results are not sensitive to divergence but are affected by the initial lapse rate of potential temperature; the greater the stability, the smaller the heating, other things being equal. Unless one knows the lapse rate at the shore, this requires another independent measurement. For this purpose the downwind slope of the square of the boundary layer height is used, the mean value of which is also directly proportional to the mean sensible heating. The height of the boundary layer should be measurable by future spaceborn lidar systems.
Observations of cloud geometry using scan-synchronized stereo geostationary satellites having images with horizontal spatial resolution of approximately 0.5 km, and temporal resolution of up to 3 min are presented. The stereo does not require a cloud with known emissivity to be in equilibrium with an atmosphere with a known vertical temperature profile. It is shown that absolute accuracies of about 0.5 km are possible. Qualitative and quantitative representations of atmospheric dynamics were shown by remapping, display, and stereo image analysis on an interactive computer/imaging system. Applications of stereo observations include: (1) cloud top height contours of severe thunderstorms and hurricanes, (2) cloud top and base height estimates for cloud-wind height assignment, (3) cloud growth measurements for severe thunderstorm over-shooting towers, (4) atmospheric temperature from stereo heights and infrared cloud top temperatures, and (5) cloud emissivity estimation. Recommendations are given for future improvements in stereo observations, including a third GOES satellite, operational scan synchronization of all GOES satellites and better resolution sensors.
Containers have taken over large swaths of cloud computing as the most convenient way of packaging and deploying applications. The features that containers offer for packaging and deploying applications translate to high performance computing (HPC) as well. At The National Oceanic and Atmospheric Administration, containers provide an easy way to build and distribute complex HPC applications, allowing faster collaboration, portability, and experiment computer environment reproducibility amongst the scientific community. The challenge arises when applications rely on message passing interface (MPI). This necessitates investigation into how to properly run these applications with their own unique requirements and produce performance on par with native runs. We investigate the MPI performance for benchmarks and containerized climate models for various containers covering selection of compiler and MPI library combinations from the Cray provided programming environments on the Cray XC supercomputer GAEA. Performance from the benchmarks and the climate models shows that for the most part containerized applications perform on par with the natively built applications when the system optimized Cray MPICH libraries are bound into the container, and the hybrid model containers have poor performance in comparison. We also describe several challenges and our solutions in running these containers, particularly challenges with heterogeneous jobs for the containerized model runs.
The extinction and backscattering of 514 nm laser radiation in polydisperse water droplet clouds was studied in the laboratory. Three cloud size distributions with modal diameters of 0.02, 5.0, and 12.0 microns were investigated. The relationships between the cloud optical parameters (attentuation coefficient, sigma and volume backscattering coefficient, Beta (sub pi)) and the cloud water content, C, were measured for each size distribution. It was found that a linear relationship exists between sigma and C and between beta (sub pi) and C for cloud water content values up to 3gm/cubic m. The linear relationships obtained, however, have slopes which depend on the droplet size distribution. For a given water content both sigma and beta (sub pi) increase as the modal diameter decreases. The measured data are compared with existing theoretical analyses and discussed in terms of thie application to lidar measurements of atmospheric clouds. It is concluded that the empirical information obtained can serve as a basis for quantitative lidar measurements.
Comprehensive aircraft system health-state awareness is critical for maintaining safe, efficient growth in global operations, enabling higher levels of autonomy, and facilitating new forms of aviation. Maintainers, vehicle operators, air traffic controllers, dispatchers, pilots, autonomous systems, and other decision-makers must have reliable real-time knowledge of the vehicle health, the health of its critical composite systems, predictions of how health changes with time, and forecasts of how its capabilities change with health degradation to preserve safety and efficiency. Providing this information in a reliable manner in computationally constrained environments and across a wide range of vehicles and systems continues to be a challenge. This challenge can be partially resolved through cloud computing, where the execution of prognostic and diagnostic algorithms is performed on a network of remote servers hosted on the internet. NASA is developing a cloud computing service, Prognostics As-A-Service (PaaS), that explores the feasibility and challenges of cloud-enhanced prognostics. Though such a system has broad applicability, this research effort is focused on aviation applications.
In this paper we describe a powerful method for mapping the distribution of dust through a molecular cloud using data obtained in large-scale, multiwavelength, infrared imaging surveys. This method combines direct measurements of near-infrared color excess and certain techniques of star counting to derive mean extinctions and map the dust column density distribution through a cloud at higher angular resolutions and greater optical depths than those achieved previously by optical star counting. We report the initial results of the application of this method to a dark cloud complex near the cluster IC 5146, where we have performed coordinated, near-infrared, JHK imaging and (13)CO, C(18)O, and CS millimeter-wave, molecular-line surveys of a large portion of the complex. More than 4000 stars were detected in our JHK survey of the cloud. Of these, all but about a dozen appear to be field stars not associated with the cloud. Star count maps at J band show a striking and detailed anticorrelation between the surface density of J-band sources and CO and CS molecular-line emission. We used the (H-K) colors and positions of nearly 1300 sources to directly measure and map the extinction and thus trace the dust column density through the cloud at an effective angular resolution of 1 min .5. We report an interesting correlation between the measured dispersion in our extinction determinations and the extinction. Modeling this relation indicates that effects of small-scale cloud structure dominate the uncertainties in our measurements. Moreover, we demonstrate that such observations can be used to place constraints on the nature of the spatial distribution of extinction on scales smaller than our resolution. In particular, we show that models in which the dust is distributed uniformly or in discrete high-extinction clumps on scales smaller than (1 min .5) are inconsistent with the observations. We have derived extinctions at the same positions and at the same angular resolution (1 min .7) as our molecular-line observations. This enabled a direct comparison of (13)CO, C(18)O, and CS integrated intensities and column densities with A(sub V) for more than 500 positions in the cloud, corresponding to a range in A(sub V) between 0 to 32 mag of extinction. We found the integrated intensities of (13)CO, C(18)O, and CS to be roughly linearly correlated with extinction over different ranges of extinction. However, for all three molecules we find the scatter in the observed relations to be larger than can be accounted for by instrumental error, suggesting that there are large intrinsic variations in the abundances or excitation of the molecules through the cloud. Mean abundances for all the molecules relative to hydrogen were directly derived from the data. The ratio of (13)CO to C(18)O abundances was found to be significantly higher than the terrestrial ratio in regions where extinction is less than 10 mag. In the same region, the dispersion in the abundance ratio is also found to be very large, suggesting that the abundances of one or both molecules are very unstable even at relatively large cloud optical depths. Beyond 10 mag of extinction the abundances of both species appear very stable with their ratio close to the terrestrial value.
Formerly known as the Cloud Retrieval Evaluation Workshop (CREW; see the list of acronyms used in this paper below) group (Roebeling et al. 2013, 2015), the International Cloud Working Group (ICWG) was created and endorsed during the 42nd Meeting of CGMS. The CGMS-ICWG provides a forum for space agencies to seek coherent progress in science and applications and also to act as a bridge between space agencies and the cloud remote sensing and applications community. The ICWG plans to serve as a forum to exchange and enhance knowledge on state-of-the-art cloud parameter retrievals algorithms, to stimulate support for training in the use of cloud parameters, and to encourage space agencies and the cloud remote sensing community to share knowledge. The ICWG plans to prepare recommendations to guide the direction of future research-for example, on observing severe weather events or on process studies-and to influence relevant programs of the WMO, WCRP, GCOS, and the space agencies.
Velocity field in a nonprecipitating Cu under BOMEX conditions, simulated by SAM with 10-m resolution and spectral bin microphysics is separated into the convective part and the turbulent part, using a wavelet filtering. In Part II of the study properties of convective motions of this Cu were investigated. Here in Part III of the study, the parameters of cloud turbulence are calculated in the cloud updraft zone at different stages of cloud development. The main points of this study are (i) application of a fine-scale LES model of a single convective cloud allowed a direct estimation of turbulence parameters using the resolved flow in the cloud and (ii) the separation of the resolved flow into the turbulence flow and the nonturbulence flow allowed us to estimate different turbulent parameters with sufficient statistical accuracy. We calculated height and time dependences of the main turbulent parameters such as turbulence kinetic energy (TKE), spectra of TKE, dissipation rate, and the turbulent coefficient. It was found that the main source of turbulence in the cloud is buoyancy whose contribution is described by the buoyancy production term (BPT). The shear production term (SPT) increases with height and reaches its maximum near cloud top, and so does BPT. In agreement with the behavior of BPT and SPT, turbulence in the lower cloud part (below the inversion level) is weak and hardly affects the processes of mixing and entrainment. The fact that BPT is larger than SPT determines many properties of cloud turbulence. For instance, the turbulence is nonisotropic, so the vertical component of TKE is substantially larger than the horizontal components. Another consequence of the fact that BPT is larger than STP manifests itself in the finding that the turbulence spectrum largely obeys the -11/5 Bolgiano–Obukhov scaling. The classical Kolmogorov -5/3 scaling dominates for the low part of a cloud largely at the dissolving stage of cloud evolution. Using the spectra obtained we evaluated an “effective” dissipation rate which increases with height from nearly zero at cloud base up to 20 cm 2 s -3 near cloud top. The coefficient of turbulent diffusion was found to increase with height and ranged from 5 m 2 s -1 near cloud base to 25 m 2 s -1 near cloud top. In conclusion, the possible role of turbulence in the process of lateral entrainment and mixing is discussed.
With the preliminary release of AIRS Level 1 and 2 data to the scientific community, there is a growing need for an accurate AIRS cloud mask for data assimilation studies and in producing products derived from cloud free radiances. Current cloud information provided with the AIRS data are limited or based on simplified threshold tests. A multispectral cloud detection approach has been developed for AIRS that utilizes the hyper-spectral capabilities to detect clouds based on specific cloud signatures across the short wave and long wave infrared window regions. This new AIRS cloud mask has been validated against the existing AIRS Level 2 cloud product and cloud information derived from MODIS. Preliminary results for both day and night applications over the continental U.S. are encouraging. Details of the cloud detection approach and validation results will be presented at the conference.
Attention is given to a general derivation of the fractional standard deviation (FSD) of any integrated property X such that X(D) = cD to the n. This work extends that of Joss and Waldvogel (1969). The equation is applicable to measuring integrated properties of cloud, rain or hail populations (such as water content, precipitation rate, kinetic energy, or radar reflectivity) which are subject to statistical sampling errors due to the Poisson distributed fluctuations of particles sampled in each particle size interval and the weighted sum of the associated variances in proportion to their contribution to the integral parameter to be measured. Universal curves are presented which are applicable to the exponential size distribution permitting FSD estimation of any parameters from n = 0 to n = 6. The equations and curves also permit corrections for finite upper limits in the size spectrum and a realistic fall speed law.
Scheduled to launch in 2024, the Ocean Color Instrument (OCI) onboard the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission will collect hyperspectral data from 315 nm – 895 nm via two grating spectrometers (in both the blue and red spectral regions) and 9 multi-spectral bands in the short-wave infrared (940 nm – 2260 nm). The increased spectral resolution and radiometric accuracy is expected to improve upon data collected by heritage sensors such as SeaWiFs, MODIS, and VIIRS, allowing new applications in ocean color, aerosol, and cloud science. During ground testing, higher than expected spatial-spectral crosstalk was measured for the hyperspectral bands in the blue spectrograph. Using a monochromatic-collimated light source, light from a single science pixel (1km x 1km) was found to produce crosstalk signals over 31 pixels in the cross-track direction. This spatial augmentation is caused by the spectral crosstalk’s asynchronous spatial movement during Time Delay Integration (TDI). To fully characterized the magnitude and spectral dependency from this, a crosstalk model was developed by synthesizing data collected from monochromatic-collimated light and monochromatic light that filled the OCI optical aperture. The model was validated by showing good agreement between predicted values and other relevant test data collected using both monochromatic and white light sources.