Search NASA⌕ Search

SEARCH · Search NASA

Results for “masking algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Cloud Detection from Satellite Imagery: A Comparison of Expert-Generated and Automatically-Generated Decision Trees

Automated cloud detection and tracking is an important step in assessing global climate change via remote sensing. Cloud masks, which indicate whether individual pixels depict clouds, are included in many of the data products that are based on data acquired on- board earth satellites. Many cloud-mask algorithms have the form of decision trees, which employ sequential tests that scientists designed based on empirical astrophysics studies and astrophysics simulations. Limitations of existing cloud masks restrict our ability to accurately track changes in cloud patterns over time. In this study we explored the potential benefits of automatically-learned decision trees for detecting clouds from images acquired using the Advanced Very High Resolution Radiometer (AVHRR) instrument on board the NOAA-14 weather satellite of the National Oceanic and Atmospheric Administration. We constructed three decision trees for a sample of 8km-daily AVHRR data from 2000 using a decision-tree learning procedure provided within MATLAB(R), and compared the accuracy of the decision trees to the accuracy of the cloud mask. We used ground observations collected by the National Aeronautics and Space Administration Clouds and the Earth s Radiant Energy Systems S COOL project as the gold standard. For the sample data, the accuracy of automatically learned decision trees was greater than the accuracy of the cloud masks included in the AVHRR data product.

Shiffman, Smadar↗

Marine Boundary Layer Cloud Property Retrievals from High-Resolution ASTER Observations: Case Studies and Comparison with Terra MODIS

A research-level retrieval algorithm for cloud optical and microphysical properties is developed for the Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) aboard the Terra satellite. It is based on the operational MODIS algorithm. This paper documents the technical details of this algorithm and evaluates the retrievals for selected marine boundary layer cloud scenes through comparisons with the operational MODIS Data Collection 6 (C6) cloud product. The newly developed, ASTERspecific cloud masking algorithm is evaluated through comparison with an independent algorithm reported in Zhao and Di Girolamo (2006). To validate and evaluate the cloud optical thickness (tau) and cloud effective radius (r(sub eff)) from ASTER, the high-spatial-resolution ASTER observations are first aggregated to the same 1000m resolution as MODIS. Subsequently, tau(sub aA) and r(sub eff, aA) retrieved from the aggregated ASTER radiances are compared with the collocated MODIS retrievals. For overcast pixels, the two data sets agree very well with Pearson's product-moment correlation coefficients of R greater than 0.970. However, for partially cloudy pixels there are significant differences between r(sub eff, aA) and the MODIS results which can exceed 10 micrometers. Moreover, it is shown that the numerous delicate cloud structures in the example marine boundary layer scenes, resolved by the high-resolution ASTER retrievals, are smoothed by the MODIS observations. The overall good agreement between the research-level ASTER results and the operational MODIS C6 products proves the feasibility of MODIS-like retrievals from ASTER reflectance measurements and provides the basis for future studies concerning the scale dependency of satellite observations and three-dimensional radiative effects.

marine boundary layer↗

Combing Visible and Infrared Spectral Tests for Dust Identification

The MODIS Dark Target aerosol algorithm over Ocean (DT-O) uses spectral reflectance in the visible, near-IR and SWIR wavelengths to determine aerosol optical depth (AOD) and Angstrom Exponent (AE). Even though DT-O does have "dust-like" models to choose from, dust is not identified a priori before inversion. The "dust-like" models are not true "dust models" as they are spherical and do not have enough absorption at short wavelengths, so retrieved AOD and AE for dusty regions tends to be biased. The inference of "dust" is based on postprocessing criteria for AOD and AE by users. Dust aerosol has known spectral signatures in the near-UV (Deep blue), visible, and thermal infrared (TIR) wavelength regions. Multiple dust detection algorithms have been developed over the years with varying detection capabilities. Here, we test a few of these dust detection algorithms, to determine whether they can be useful to help inform the choices made by the DT-O algorithm. We evaluate the following methods: The multichannel imager (MCI) algorithm uses spectral threshold tests in (0.47, 0.64, 0.86, 1.38, 2.26, 3.9, 11.0, 12.0 micrometer) channels and spatial uniformity test [Zhao et al., 2010]. The NOAA dust aerosol index (DAI) uses spectral contrast in the blue channels (412nm and 440nm) [Ciren and Kundragunta, 2014]. The MCI is already included as tests within the "Wisconsin" (MOD35) Cloud mask algorithm.

aerosol optical depth↗

Assessment of Cloud Fraction Derived from a New Geostationary Satellite Cloud Retrieval Algorithm for CERES and Progress Towards Cross-platform Continuity

For over two decades The Clouds and the Earth’s Radiant Energy System (CERES) project has produced long-term records of top-of-atmosphere (TOA) and surface irradiances for detecting changes in the Earth’s radiation budget and advancing understanding of how clouds contribute to those changes. Accurate characterization of the spatial and temporal distributions of clouds are a critical component for producing CERES datasets. The CERES Cloud Working Group (CWG) derives cloud properties from both geostationary (GEO) and low-Earth orbit (LEO) satellite sensors in order to provide complete global coverage at hourly temporal resolution. However, the use of multiple sensors to provide this spatiotemporal coverage throughout a long-term record presents some challenges, because the various sensors generally have different spectral band characteristics (e.g., spectral band width and response) and spatial resolution. These differences can result in spatial artifacts at the coverage boundary between two sensors or temporal artifacts when one sensor replaces another in the record. For the upcoming Edition 5 release of CERES products, the CWG is developing cloud retrieval algorithms which utilize only spectral bands common to most modern passive satellite radiometers and account for differences in spectral width and response. The goal with this approach is to provide global cloud properties for CERES with greater cross-platform consistency than the previous Edition 4 products and thus mitigate artifacts which are evident at the interface of two sensors. This study focuses on retrieval of total cloud fraction from various GEO sensors, and we use Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) observations to assess the accuracy of total cloud fraction derived from the various sensors. The Edition 5 cloud mask algorithm depends on estimates of cloud-free TOA spectral radiances to differentiate clear and cloudy conditions, and CALIOP is used to assess the accuracy of those estimates when cloud-free conditions are indeed observed.

CALIOP↗

The EOS CERES Global Cloud Mask

To detect long-term climate trends, it is essential to produce long-term and consistent data sets from a variety of different satellite platforms. With current global cloud climatology data sets, such as the International Satellite Cloud Climatology Experiment (ISCCP) or CLAVR (Clouds from Advanced Very High Resolution Radiometer), one of the first processing steps is to determine whether an imager pixel is obstructed between the satellite and the surface, i.e., determine a cloud 'mask.' A cloud mask is essential to studies monitoring changes over ocean, land, or snow-covered surfaces. As part of the Earth Observing System (EOS) program, a series of platforms will be flown beginning in 1997 with the Tropical Rainfall Measurement Mission (TRMM) and subsequently the EOS-AM and EOS-PM platforms in following years. The cloud imager on TRMM is the Visible/Infrared Sensor (VIRS), while the Moderate Resolution Imaging Spectroradiometer (MODIS) is the imager on the EOS platforms. To be useful for long term studies, a cloud masking algorithm should produce consistent results between existing (AVHRR) data, and future VIRS and MODIS data. The present work outlines both existing and proposed approaches to detecting cloud using multispectral narrowband radiance data. Clouds generally are characterized by higher albedos and lower temperatures than the underlying surface. However, there are numerous conditions when this characterization is inappropriate, most notably over snow and ice of the cloud types, cirrus, stratocumulus and cumulus are the most difficult to detect. Other problems arise when analyzing data from sun-glint areas over oceans or lakes over deserts or over regions containing numerous fires and smoke. The cloud mask effort builds upon operational experience of several groups that will now be discussed.

Berendes, T. A.↗

Planck 2013 results. XXIII. Isotropy and statistics of the CMB

The two fundamental assumptions of the standard cosmological model-that the initial fluctuations are statistically isotropic and Gaussian-are rigorously tested using maps of the cosmic microwave background (CMB) anisotropy from the Planck satellite. The detailed results are based on studies of four independent estimates of the CMB that are compared to simulations using a fiducial ΛCDM model and incorporating essential aspects of the Planck measurement process. Deviations from isotropy have been found and demonstrated to be robust against component separation algorithm, mask choice, and frequency dependence. Many of these anomalies were previously observed in the WMAP data, and are now confirmed at similar levels of significance (about 3σ). However, we find little evidence of non-Gaussianity, with the exception of a few statistical signatures that seem to be associated with specific anomalies. In particular, we find that the quadrupole-octopole alignment is also connected to a low observed variance in the CMB signal. A power asymmetry is now found to persist on scales corresponding to about ℓ = 600 and can be described in the low-ℓ regime by a phenomenological dipole modulation model. However, any primordial power asymmetry is strongly scale-dependent and does not extend to arbitrarily small angular scales. Finally, it is plausible that some of these features may be reflected in the angular power spectrum of the data, which shows a deficit of power on similar scales. Indeed, when the power spectra of two hemispheres defined by a preferred direction are considered separately, one shows evidence of a deficit in power, while its opposite contains oscillations between odd and even modes that may be related to the parity violation and phase correlations also detected in the data. Although these analyses represent a step forward in building an understanding of the anomalies, a satisfactory explanation based on physically motivated models is still lacking.

79 ASTRONOMY AND ASTROPHYSICS↗

The effects of cloud inhomogeneities upon radiative fluxes, and the supply of a cloud truth validation dataset

The ASTER polar cloud mask algorithm is currently under development. Several classification techniques have been developed and implemented. The merits and accuracy of each are being examined. The classification techniques under investigation include fuzzy logic, hierarchical neural network, and a pairwise histogram comparison scheme based on sample histograms called the Paired Histogram Method. Scene adaptive methods also are being investigated as a means to improve classifier performance. The feature, arctan of Band 4 and Band 5, and the Band 2 vs. Band 4 feature space are key to separating frozen water (e.g., ice/snow, slush/wet ice, etc.) from cloud over frozen water, and land from cloud over land, respectively. A total of 82 Landsat TM circumpolar scenes are being used as a basis for algorithm development and testing. Numerous spectral features are being tested and include the 7 basic Landsat TM bands, in addition to ratios, differences, arctans, and normalized differences of each combination of bands. A technique for deriving cloud base and top height is developed. It uses 2-D cross correlation between a cloud edge and its corresponding shadow to determine the displacement of the cloud from its shadow. The height is then determined from this displacement, the solar zenith angle, and the sensor viewing angle.

Welch, Ronald M.↗

Improvements to GOES Twilight Cloud Detection over the ARM SGP

The current ARM satellite cloud products derived from Geostationary Operational Environmental Satellite (GOES) data provide continuous coverage of many cloud properties over the ARM Southern Great Plains domain. However, discontinuities occur during daylight near the terminator, a time period referred to here as twilight. This poster presentation will demonstrate the improvements in cloud detection provided by the improved cloud mask algorithm as well as validation of retrieved cloud properties using surface observations from the Atmospheric Radiation Measurement Southern Great Plains (ARM SGP) site.

Yost, c. R.↗

Distribution and Radiative Forcing of Tropical Thin Cirrus Clouds

To understand the radiative impact of tropical thin cirrus clouds, the frequency of occurrence and optical depths of these clouds have been derived. Thin cirrus clouds are defined here as being those that are not detected by the operational Moderate Resolution Imaging Spectroradiometer (MODIS) cloud mask, corresponding to an optical depth value of approximately 0.3 or smaller, but that are detectable in terms of the cirrus reflectance product based on the MODIS 1.375-micron channel. With such a definition, thin cirrus clouds were present in more than 40% of the pixels flagged as clear sky by the operational MODIS cloud mask algorithm. It is shown that these thin cirrus clouds are frequently observed in deep convective regions in the western Pacific. Thin cirrus optical depths were derived from the cirrus reflectance product. Regions of significant cloud fraction and large optical depths were observed in the Northern Hemisphere during the boreal spring and summer and moved southward during the boreal autumn and winter. The radiative effects of tropical thin cirrus clouds were studied on the basis of the retrieved cirrus optical depths, the atmospheric profiles derived from the Atmospheric Infrared Sounder (AIRS) observations, and a radiative transfer model in conjunction with a parameterization of ice cloud spectral optical properties. To understand how these clouds regulate the radiation field in the atmosphere, the instantaneous net fluxes at the top of the atmosphere (TOA) and at the surface were calculated. The present study shows positive and negative net forcings at the TOA and at the surface, respectively. The positive (negative) net forcing at the TOA (surface) is due to the dominance of longwave (shortwave) forcing. Both the TOA and surface forcings are in a range of 0-20 W/sq m, depending on the optical depths of thin cirrus clouds.

THIN CIRRUS CLOUDS↗

Cloud Detection with the Earth Polychromatic Imaging Camera (EPIC)

The Earth Polychromatic Imaging Camera (EPIC) on board the Deep Space Climate Observatory (DSCOVR) would provide a unique opportunity for Earth and atmospheric research due not only to its Lagrange point sun-synchronous orbit, but also to the potential for synergistic use of spectral channels in both the UV and visible spectrum. As a prerequisite for most applications, the ability to detect the presence of clouds in a given field of view, known as cloud masking, is of utmost importance. It serves to determine both the potential for cloud contamination in clear-sky applications (e.g., land surface products and aerosol retrievals) and clear-sky contamination in cloud applications (e.g., cloud height and property retrievals). To this end, a preliminary cloud mask algorithm has been developed for EPIC that applies thresholds to reflected UV and visible radiances, as well as to reflected radiance ratios. This algorithm has been tested with simulated EPIC radiances over both land and ocean scenes, with satisfactory results. These test results, as well as algorithm sensitivity to potential instrument uncertainties, will be presented.

Meyer, Kerry↗

Quantifying Uncertainties in Nighttime Light Retrievals From Suomi-NPP and NOAA-20 VIIRS Day/Night Band Data

Satellite observations of nighttime lights (NTL) from Suomi-NPP and NOAA-20 VIIRS Day/Night Band data have been widely used to estimate human activities. Long-term changes such as urban development and abrupt short-term changes such as power outages have been monitored from temporal NTL acquired by satellites. While high temporal NTL variation has been found across NTL data of varying temporal scale (e.g., daily, monthly, and annual composites), the sources of measurement error and uncertainty are poorly understood. This paper quantifies the sources of VIIRS-derived NTL uncertainty due to view-illumination geometry, surface Bidirectional Reflectance Distribution Function (BRDF)/albedo, and the effects of snow cover, lunar irradiance, aerosol loading, cloud mask, vegetation, geometry, and ephemeral artifacts (e.g., the Aurora Borealis). Based on this current assessment of NASA Black Marble retrievals (VNP46, Collection V001), we found that angular and atmospheric effects dominate retrieval uncertainty. Errors introduced by upstream data inputs (e.g., a coarser nighttime snow cover flag and misclassification errors in the existing VIIRS nighttime cloud mask) were also found to impact retrieval quality. Despite these challenges, a consistent daily NTL time series record can be routinely generated from top-of-atmosphere VNP46 radiances. Key recommendations include: (1) the use of lunar-BRDF adjusted and atmospherically corrected NTL (i.e., as identified as high-quality retrievals in the VNP46 QA fields), (2) development and improvement to the VIIRS snow cover and cloud masks algorithms to accurately reflect NTL retrieval conditions, (3) characterizing seasonal variations in NTL due to vegetation and snow, (4) reducing geometric effects due to the spatial mismatch of gridded pixel and observation footprint, (5) employing angularly-consistent NTL observations from multiple VIIRS instruments (i.e., Suomi-NPP and NOAA-20) to reduce pixel-based uncertainties and address persistent data gaps, and (6) being mindful of surface-reflected radiance from aurora events at mid-to-high latitudes.

Zhuosen Wang↗

Spatial and Temporal Distribution of Clouds as Observed by MODIS Onboard the Terra and Aqua Satellites

The Moderate Resolution Imaging Spectroradiometer (MODIS) was developed by NASA and launched onboard the Terra spacecraft on December 18,1999 and Aqua spacecraft on May 4, 2002. It achieved its final orbit and began Earth observations on February 24,2000 for Terra and June 24,2002 for Aqua. A comprehensive set of remote sensing algorithms for cloud masking and the retrieval of cloud physical and optical properties has been developed by members of the MODIS atmosphere science team. The archived products from these algorithms have applications in climate change studies, climate modeling, numerical weather prediction, and fundamental atmospheric research. In addition to an extensive cloud mask, products include cloud-top properties (temperature, pressure, effective emissivity), cloud thermodynamic phase, cloud optical and microphysical parameters (optical thickness, effective particle radius, water path), as well as derived statistics. Over the last year, extensive improvements and enhancements in the global cloud products have been implemented, and reprocessing of all MODIS data on Terra has commenced since first light in February 2000. In the cloud mask algorithm, the most extensive improvements were in distinguishing clouds at nighttime, including the challenging polar darkness regions of the world. Additional improvements have been made to properly distinguish sunglint from clouds in the tropical ocean regions, and to improve the identification of clouds from snow during daytime in Polar Regions. We will show global monthly mean cloud fraction for both Terra and Aqua, and show how similar the global daytime cloud fraction is from these morning and afternoon orbits, respectively. We will also show the zonal distribution of cloud fraction over land and ocean regions for both Terra and Aqua, and show the time series of global cloud fraction from July 2002 through June 2006.

King, Michael D.↗

Data communications for a collective operation in a parallel active messaging interface of a parallel computer

Algorithm selection for data communications in a parallel active messaging interface (`PAMI`) of a parallel computer, the PAMI composed of data communications endpoints, each endpoint including specifications of a client, a context, and a task, endpoints coupled for data communications through the PAMI, including associating in the PAMI data communications algorithms and bit masks; receiving in an origin endpoint of the PAMI a collective instruction, the instruction specifying transmission of a data communications message from the origin endpoint to a target endpoint; constructing a bit mask for the received collective instruction; selecting, from among the associated algorithms and bit masks, a data communications algorithm in dependence upon the constructed bit mask; and executing the collective instruction, transmitting, according to the selected data communications algorithm from the origin endpoint to the target endpoint, the data communications message.

97 MATHEMATICS AND COMPUTING↗

Data communications for a collective operation in a parallel active messaging interface of a parallel computer

Algorithm selection for data communications in a parallel active messaging interface (`PAMI`) of a parallel computer, the PAMI composed of data communications endpoints, each endpoint including specifications of a client, a context, and a task, endpoints coupled for data communications through the PAMI, including associating in the PAMI data communications algorithms and bit masks; receiving in an origin endpoint of the PAMI a collective instruction, the instruction specifying transmission of a data communications message from the origin endpoint to a target endpoint; constructing a bit mask for the received collective instruction; selecting, from among the associated algorithms and bit masks, a data communications algorithm in dependence upon the constructed bit mask; and executing the collective instruction, transmitting, according to the selected data communications algorithm from the origin endpoint to the target endpoint, the data communications message.

97 MATHEMATICS AND COMPUTING↗

Automating Genetic Algorithm Mutations for Molecules Using a Masked Language Model

Inspired by the evolution of biological systems, genetic algorithms have been applied to generate solutions for optimization problems in a variety of scientific and engineering disciplines. For a given problem, a suitable genome representation must be defined along with a mutation operator to generate subsequent generations. Unlike natural systems which display a variety of complex rearrangements (e.g. mobile genetic elements), mutation for genetic algorithms commonly utilizes only random point-wise changes. Furthermore, generalizing beyond point-wise mutations poses a key difficulty as useful genome rearrangements depend on the representation and problem domain. To move beyond the limitations of manually defined point-wise changes, here we propose the use of techniques from masked language models to automatically generate mutations. As a first step, common subsequences within a given population are used to generate a vocabulary. The vocabulary is then used to tokenize each genome. A masked language model is trained on the tokenized data in order to generate possible rearrangements (i.e. mutations). In order to illustrate the proposed strategy, we use string representations of molecules and use a genetic algorithm to optimize for drug-likeness and synthesizability. Finally, our results show that moving beyond random point-wise mutations accelerates genetic algorithm optimization.

59 BASIC BIOLOGICAL SCIENCES↗

Remote Sensing of the Radiative and Microphysical Properties of Clouds during TC4: Results from MAS, MASTER, MODIS, and MISR

The MODIS Airborne Simulator (MAS) and MODIS/ASTER Airborne Simulator (MASTER) were used to obtain measurements of the bidirectional reflectance and brightness temperature of clouds at 50 discrete wavelengths between 0.47 and 14.3 (12.9 m for MASTER). These observations were obtained from the NASA ER-2 aircraft as part of the Tropical Composition, Clouds and Climate Coupling Experiment (TC4) conducted over Central America and surrounding Pacific and Atlantic Oceans between July 17 and August 8, 2007. Multispectral images in eight distinct bands were used to derive a confidence in clear sky (or alternatively the probability of cloud) over land and ocean ecosystems. Based on the results of individual tests run as part of this cloud mask, an algorithm was developed to estimate the phase of the clouds (liquid water, ice, or undetermined phase). Finally, the cloud optical thickness and effective radius were derived for both liquid water and ice clouds that were detected during each flight, using a nearly identical algorithm as that implemented operationally to process MODIS cloud data from the Aqua and Terra satellites (Collection 5). This analysis shows that the cloud mask developed for operational use on MODIS, and tested using MAS and MASTER date in TC4, is quite capable of distinguishing both liquid water and ice clouds during daytime conditions over both land and ocean. The cloud optical thickness and effective radius retrievals used three distinct bands of the MAS (or MASTER), and these results were compared with nearly simultaneous retrievals of MODIS on the Terra spacecraft. Finally, this MODIS-based algorithm was adapted to MISR data to infer the cloud optical thickness of liquid water clouds from MISR. Results of this analysis will be presented and discussed.

King, Michael D.↗