Search NASA⌕ Search

SEARCH · Search NASA

Results for “masking algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

A FIRST APPLICATION OF THE ALCOCK-PACZYNSKI TEST TO STACKED COSMIC VOIDS

We report on the first application of the Alcock-Paczynski test to stacked voids in spectroscopic galaxy redshift surveys. We use voids from the Sutter et al. void catalog, which was derived from the Sloan Digital Sky Survey Data Release 7 main sample and luminous red galaxy catalogs. The construction of that void catalog removes potential shape measurement bias by using a modified version of the ZOBOV algorithm and by removing voids near survey boundaries and masks. We apply the shape-fitting procedure presented in Lavaux and Wandelt to 10 void stacks out to redshift z = 0.36. Combining these measurements, we determine the mean cosmologically induced ''stretch'' of voids in three redshift bins, with 1{sigma} errors of 5%-15%. The mean stretch is consistent with unity, providing no indication of a distortion induced by peculiar velocities. While the statistical errors are too large to detect the Alcock-Paczynski effect over our limited redshift range, this proof-of-concept analysis defines procedures that can be applied to larger spectroscopic galaxy surveys at higher redshifts to constrain dark energy using the expected statistical isotropy of structures that are minimally affected by uncertainties in galaxy velocity bias.

79 ASTRONOMY AND ASTROPHYSICS↗

Timing Analysis with INTEGRAL: Comparing Different Reconstruction Algorithms

INTEGRAL is one of the few instruments capable of detecting X-rays above 20keV. It is therefore in principle well suited for studying X-ray variability in this regime. Because INTEGRAL uses coded mask instruments for imaging, the reconstruction of light curves of X-ray sources is highly non-trivial. We present results from the comparison of two commonly employed algorithms, which primarily measure flux from mask deconvolution (ii-lc-extract) and from calculating the pixel illuminated fraction (ii-light). Both methods agree well for timescales above about 10 s, the highest time resolution for which image reconstruction is possible. For higher time resolution, ii-light produces meaningful results, although the overall variance of the lightcurves is not preserved.

Grinberg, V.↗

Operational Detection of Sun Glints in DSCOVR EPIC Images

Satellite images often feature sun glints caused by the specular reflection of sunlight from water surfaces or from horizontally oriented ice crystals occurring in clouds. Such glints can prevent accurate retrievals of atmospheric and surface properties using existing algorithms, but the glints can also be used to infer more about the glint-causing objects—for example about the microphysical properties and radiative effects of ice clouds. This paper introduces the recently released operational glint product of the Earth Polychromatic Camera (EPIC) onboard the Deep Space Climate Observatory (DSCOVR) spacecraft. Most importantly, the paper describes the algorithm used for generating the key component of the new product: a glint mask indicating the presence of sun glint caused by the specular reflection of sunlight from ice clouds and smooth water surfaces. After describing the glint detection algorithm and glint product, the paper shows some examples of the detected glints and discusses some basic statistics of the glint population in a yearlong dataset of EPIC images. These statistics provide insights into the performance of glint detection and point toward possibilities for using the glint product to gain scientific insights about ice clouds and water surfaces.

DSCOVR↗

Utilizing Hierarchical Segmentation to Generate Water and Snow Masks to Facilitate Monitoring Change with Remotely Sensed Image Data

The hierarchical segmentation (HSEG) algorithm is a hybrid of hierarchical step-wise optimization and constrained spectral clustering that produces a hierarchical set of image segmentations. This segmentation hierarchy organizes image data in a manner that makes the image's information content more accessible for analysis by enabling region-based analysis. This paper discusses data analysis with HSEG and describes several measures of region characteristics that may be useful analyzing segmentation hierarchies for various applications. Segmentation hierarchy analysis for generating landwater and snow/ice masks from MODIS (Moderate Resolution Imaging Spectroradiometer) data was demonstrated and compared with the corresponding MODIS standard products. The masks based on HSEG segmentation hierarchies compare very favorably to the MODIS standard products. Further, the HSEG based landwater mask was specifically tailored to the MODIS data and the HSEG snow/ice mask did not require the setting of a critical threshold as required in the production of the corresponding MODIS standard product.

Tilton, James C.↗

Development of a Consistent Cross-Platform GEO-Satellite Cloud Mask to Support CERES

Geostationary satellites provide continuous cloud and meteorological observations over a fixed portion of the Earth’s surface, allowing them to monitor the movement of storm systems and their diurnal variation. For climate studies, geostationary observations provide valuable insight of cloud formation and evolution and how they influence the Earth’s radiation budget. The Geo-Satellite Edition 4 cloud mask (GEO Ed4) is used operationally in NASA’s Cloud and Earth’s Radiant Energy System (CERES) project to help account for diurnal variations in cloudiness on Earth’s radiation budget. The Ed4 cloud mask was applied to imager data on MSG (MeteoSat Second Generation), Himawari, GOES-West, and GOES-East satellites using as much spectral information as possible. That approach led to some discontinuities when a more modern satellite replaced an older satellite with less spectral information. A different strategy is being investigated for the CERES GEO Ed5 cloud mask that only uses spectral channels common on every satellite. Thus, a 3-channel (0.6, 3.9, 11 µm) algorithm for daytime cloud detection, and a 2-channels (3.9 and 11 µm) algorithm for nighttime cloud detection have been implemented and tested for Ed5. The goal of Ed5 cloud mask is to achieve global cloud amount consistency across five geo-satellites, and a smooth transition from an old satellite to a new satellite over each geo-location. This paper compares cloud mask results between Ed4 and a preliminary Ed5 version over the GOES-East region, using GOES-8, GOES-13, and GOES-16 satellites, each with a different spectral channel complement. Instantaneous and monthly regional mean inter-comparisons are performed and evaluated with CALIPSO cloud products to assess the accuracy and consistency of the Ed5 approach relative to that taken in Ed4. Results will be presented and discussed at the conference.

clouds↗

Investigation of the applicability of a functional programming model to fault-tolerant parallel processing for knowledge-based systems

In a fault-tolerant parallel computer, a functional programming model can facilitate distributed checkpointing, error recovery, load balancing, and graceful degradation. Such a model has been implemented on the Draper Fault-Tolerant Parallel Processor (FTPP). When used in conjunction with the FTPP's fault detection and masking capabilities, this implementation results in a graceful degradation of system performance after faults. Three graceful degradation algorithms have been implemented and are presented. A user interface has been implemented which requires minimal cognitive overhead by the application programmer, masking such complexities as the system's redundancy, distributed nature, variable complement of processing resources, load balancing, fault occurrence and recovery. This user interface is described and its use demonstrated. The applicability of the functional programming style to the Activation Framework, a paradigm for intelligent systems, is then briefly described.

Harper, Richard↗

Applying the Dark Target Aerosol Algorithm with Advanced Himawari Imager Observations During the KORUS-AQ Field Campaign

For nearly 2 decades we have been quantitatively observing the Earth's aerosol system from space at one or two times of the day by applying the Dark Target family of algorithms to polar-orbiting satellite sensors, particularly MODIS and VIIRS. With the launch of the Advanced Himawari Imager (AHI) and the Advanced Baseline Imagers (ABIs) into geosynchronous orbits, we have the new ability to expand temporal coverage of the traditional aerosol optical depth (AOD) to resolve the diurnal signature of aerosol loading during daylight hours. The Korean–United States Air Quality (KORUS-AQ) campaign taking place in and around the Korean peninsula during May–June 2016 initiated a special processing of full-disk AHI observations that allowed us to make a preliminary adoption of Dark Target aerosol algorithms to the wavelengths and resolutions of AHI. Here,we describe the adaptation and show retrieval results from AHI for this 2-month period. The AHI-retrieved AOD is collocated in time and space with existing AErosol RObotic NETwork stations across Asia and with collocated Terra and Aqua MODIS retrievals. The new AHI AOD product matches AERONET, and the standard MODIS product does as well, and the agreement between AHI and MODIS retrieved AOD is excellent, as can be expected by maintaining consistency in algorithm architecture and most algorithm assumptions. Furthermore, we show that the new product approximates the AERONET-observed diurnal signature. Examining the diurnal patterns of the new AHI AOD product we find specific areas over land where the diurnal signal is spatially cohesive. For example, in Bangladesh the AOD in-creases by 0.50 from morning to evening, and in northeast China the AOD decreases by 0.25. However, over open ocean the observed diurnal cycle is driven by two artifacts, one associated with solar zenith angles greater than 70t hat may be caused by a radiative transfer model that does not properly represent the spherical Earth and the other artifact associated with the fringes of the 40 degree glint angle mask. This opportunity during KORUS-AQ provides encouragement to move towards an operational Dark Target algorithm for AHI. Future work will need to re-examine masking including snow mask, reevaluate assumed aerosol models for geosynchronous geometry, address the artifacts over the ocean, and investigate size parameter retrieval from the over-ocean algorithm.

Gupta, Pawan↗

Snow Depth from AMSR-2 Using Multispectral Satellite Data in an Artificial Neural Network

By using diffusion theory and Monte Carlo lidar radiative transfer simulations, Hu et al. (2022b) has derived snow depth from the first-, second- and third-order moments of the lidar backscattering pathlength distribution. Lu et al. (2022) calculated the snow depth by applying the methods to the satellite ICESat-2 lidar measurements over the Arctic sea ice, as well as land surfaces of Northern Hemisphere. In this paper, an artificial neural network (ANN) algorithm, employing several channels from Advanced Microwave Scanning Radiometer 2 (AMSR-2) and the humidity vertical profiles from Global Modeling and Assimilation Office (GMAO) Goddard Earth Observing System for Instrument Teams (GEOS-IT) product, is trained to determine snow depth identified by time and geolocation matched 2019 ICESat-2 snow-depth data during winter months over the Arctic sea ice. The trained ANN snow-depth was applied to 2018 AMSR-2 clear pixel data, although the algorithms perform reasonably well in thinner clouds. The validation data (different from the training set) of ANN snow depth from AMSR-2 showed a good agreement with time matched and co-located snow-depth values from ICESat-2. The bias was near zero, with mean absolute error (MAE) 0.05 cm and a root-mean-square-error (RMSE) 0.08 cm. Prior applying the trained ANN snow depth to AMSR-2 data, a cloud screening algorithm was developed with a similar approach. A separate ANN cloud mask was trained to determine an AMSR-2 pixel is clear or cloudy with time and geolocation matched 2015 CALIOP Vertical Feature Mask (VFM) over Arctic sea ice. The ANN cloud mask from AMSR-2 under-estimated cloud fraction by 3-6% compared to CALIOP . The additional research is needed to conclusively evaluate the ANN cloud mask accuracy. Finally, this paper will lay the foundation for a sustained long-term snowfall and snow-storm monitoring system. The future Cloud Aerosol LIdar for Global scale Observations of the ocean-Land Atmosphere system (CALIGOLA) mission will provide a means to calculate snow depth from the lidar backscattering pathlength distribution, benefiting from the UV, visible and infrared pulses. With the calculated snow depth as the truth one could develop a machine learning algorithm, as it was done in this paper, using a passive microwave instrument available at that time to generate a wide range of snow depth data, covering extensive spatial areas in the cross-orbit direction.

Neural Network↗

TempestExtremes v2.1: a community framework for feature detection, tracking, and analysis in large datasets

TempestExtremes (TE) is a multifaceted framework for feature detection, tracking, and scientific analysis of regional or global Earth system datasets on either rectilinear or unstructured/native grids. Version 2.1 of the TE framework now provides extensive support for examining both nodal (i.e., pointwise) and areal features, including tropical and extratropical cyclones, monsoonal lows and depressions, atmospheric rivers, atmospheric blocking, precipitation clusters, and heat waves. Available operations include nodal and areal thresholding, calculations of quantities related to nodal features such as accumulated cyclone energy and azimuthal wind profiles, filtering data based on the characteristics of nodal features, and stereographic compositing. This paper describes the core algorithms (kernels) that have been added to the TE framework since version 1.0, including algorithms for editing pointwise trajectory files, composition of fields around nodal features, generation of areal masks via thresholding and nodal features, and tracking of areal features in time. Several examples are provided of how these kernels can be combined to produce composite algorithms for evaluating and understanding common atmospheric features and their underlying processes. These examples include analyzing the fraction of precipitation from tropical cyclones, compositing meteorological fields around extratropical cyclones, calculating fractional contribution to poleward vapor transport from atmospheric rivers, and building a climatology of atmospheric blocks.

58 GEOSCIENCES↗

A Cosmic Void Catalog of SDSS DR12 BOSS Galaxies

We present a cosmic void catalog using the large-scale structure galaxy catalog from the Baryon Oscillation Spectroscopic Survey (BOSS). This galaxy catalog is part of the Sloan Digital Sky Survey (SDSS) Data Release 12 and is the final catalog of SDSS-III. We take into account the survey boundaries, masks, and angular and radial selection functions, and apply the ZOBOV void finding algorithm to the Galaxy catalog. We identify a total of 10,643 voids. After making quality cuts to ensure that the voids represent real underdense regions, we obtain 1,228 voids with effective radii spanning the range 20–100 h{sup −1} Mpc and with central densities that are, on average, 30% of the mean sample density. We release versions of the catalogs both with and without quality cuts. We discuss the basic statistics of voids, such as their size and redshift distributions, and measure the radial density profile of the voids via a stacking technique. In addition, we construct mock void catalogs from 1000 mock galaxy catalogs, and find that the properties of BOSS voids are in good agreement with those in the mock catalogs. We compare the stellar mass distribution of galaxies living inside and outside of the voids, and find no large difference. These BOSS and mock void catalogs are useful for a number of cosmological and galaxy environment studies.

79 ASTRONOMY AND ASTROPHYSICS↗

Computer-assisted area detector masking

Area detectors have become the predominant type of detector for the rapid acquisition of X-ray diffraction, small-angle scattering and total scattering. These detectors record the scattering for a large area, giving each shot good statistical significance to the resulting scattered intensity I ( Q ) pattern. However, many of these detectors have pixel level defects, which cause error in the resulting one-dimensional patterns. In this work, new software to automatically find and mask these dead pixels and other defects is presented. This algorithm is benchmarked with both ideal simulated and experimental datasets.

Wright, Christopher J.↗

Sensitive detection of structural dynamics using a statistical framework for comparative crystallography

Chemical and conformational changes are crucial to protein function and its pharmacological control. X-ray crystallography can reveal these changes in atomic detail, but standard analysis methods, which refine separate datasets, often overlook differences that are subtle or arise in only a subset of molecules. Direct comparison of crystallographic datasets is, in principle, more powerful, but systematic errors (“scales”) often mask changes in the crystallographic observables (“structure factors”). Machine learning algorithms that jointly estimate scales and structure factors can address this limitation. Here, we augment this approach with multivariate, structured priors derived from crystallographic theory, implemented in the variational deep learning framework Careless. Doing so strongly improves the detection of protein dynamics, element-specific anomalous signals, and the binding of drug candidates, offering a robust approach to comparative crystallography and, potentially, to detection of protein dynamics by other structure determination methods.

Hekstra, Doeke R. [Harvard Univ., Cambridge, MA (U↗

Spatial and Temporal Varying Thresholds for Cloud Detection in Satellite Imagery

A new cloud detection technique has been developed and applied to both geostationary and polar orbiting satellite imagery having channels in the thermal infrared and short wave infrared spectral regions. The bispectral composite threshold (BCT) technique uses only the 11 micron and 3.9 micron channels, and composite imagery generated from these channels, in a four-step cloud detection procedure to produce a binary cloud mask at single pixel resolution. A unique aspect of this algorithm is the use of 20-day composites of the 11 micron and the 11 - 3.9 micron channel difference imagery to represent spatially and temporally varying clear-sky thresholds for the bispectral cloud tests. The BCT cloud detection algorithm has been applied to GOES and MODIS data over the continental United States over the last three years with good success. The resulting products have been validated against "truth" datasets (generated by the manual determination of the sky conditions from available satellite imagery) for various seasons from the 2003-2005 periods. The day and night algorithm has been shown to determine the correct sky conditions 80-90% of the time (on average) over land and ocean areas. Only a small variation in algorithm performance occurs between day-night, land-ocean, and between seasons. The algorithm performs least well. during he winter season with only 80% of the sky conditions determined correctly. The algorithm was found to under-determine clouds at night and during times of low sun angle (in geostationary satellite data) and tends to over-determine the presence of clouds during the day, particularly in the summertime. Since the spectral tests use only the short- and long-wave channels common to most multispectral scanners; the application of the BCT technique to a variety of satellite sensors including SEVERI should be straightforward and produce similar performance results.

Jedlovec, Gary↗

Injecting Errors for Testing Built-In Test Software

Two algorithms have been conceived to enable automated, thorough testing of Built-in test (BIT) software. The first algorithm applies to BIT routines that define pass/fail criteria based on values of data read from such hardware devices as memories, input ports, or registers. This algorithm simulates effects of errors in a device under test by (1) intercepting data from the device and (2) performing AND operations between the data and the data mask specific to the device. This operation yields values not expected by the BIT routine. This algorithm entails very small, permanent instrumentation of the software under test (SUT) for performing the AND operations. The second algorithm applies to BIT programs that provide services to users application programs via commands or callable interfaces and requires a capability for test-driver software to read and write the memory used in execution of the SUT. This algorithm identifies all SUT code execution addresses where errors are to be injected, then temporarily replaces the code at those addresses with small test code sequences to inject latent severe errors, then determines whether, as desired, the SUT detects the errors and recovers

Gender, Thomas K.↗

TPSAS-NF1676L-32467-DND

With the launch of a new generation of Geostationary satellites (GEO) such as Himawari and GOES-16 & 17, cloud detection using satellite imager data has been greatly enhanced with increased spectral bands, and higher temporal and spatial resolutions. A concern for all geostationary sensors, however, are changes in instrument sensitivity and algorithm performance at different viewing for daytime and nighttime. CALIPSO lidar observations provide a valuable reference for assessing these impacts as the satellite flies in a sun-synchronous orbit and crosses a wide range of GEO viewing angles each day. This paper will present the cloud mask results using the imager data from Himawari (AHI) and GOES-16&17 (ABI). The detection algorithms have been adapted from the Cloud and Earth’s Radiant Energy System (CERES) MODIS Edition 4 cloud mask, and adjusted and tuned to geo-satellites. They are used operationally for the CERES Time and Space Averaging (TISA) gridded cloud products and for near-real-time retrievals for weather and nowcasting applications.

Qing Z. Trepte↗

Evaluation of digital breast tomosynthesis reconstruction algorithms using synchrotron radiation in standard geometry

Purpose: In this article, the image quality of reconstructed volumes by four algorithms for digital tomosynthesis, applied in the case of breast, is investigated using synchrotron radiation. Methods: An angular data set of 21 images of a complex phantom with heterogeneous tissue-mimicking background was obtained using the SYRMEP beamline at ELETTRA Synchrotron Light Laboratory, Trieste, Italy. The irradiated part was reconstructed using the multiple projection algorithm (MPA) and the filtered backprojection with ramp followed by hamming windows (FBR-RH) and filtered backprojection with ramp (FBP-R). Additionally, an algorithm for reducing the noise in reconstructed planes based on noise mask subtraction from the planes of the originally reconstructed volume using MPA (MPA-NM) has been further developed. The reconstruction techniques were evaluated in terms of calculations and comparison of the contrast-to-noise ratio (CNR) and artifact spread function. Results: It was found that the MPA-NM resulted in higher CNR, comparable with the CNR of FBP-RH for high contrast details. Low contrast objects are well visualized and characterized by high CNR using the simple MPA and the MPA-NM. In addition, the image quality of the reconstructed features in terms of CNR and visual appearance as a function of the initial number of projection images and the reconstruction arc was carried out. Slices reconstructed with more input projection images result in less reconstruction artifacts and higher detail CNR, while those reconstructed from projection images acquired in reduced angular range causes pronounced streak artifacts. Conclusions: Of the reconstruction algorithms implemented, the MPA-NM and MPA are a good choice for detecting low contrast objects, while the FBP-RH, FBP-R, and MPA-NM provide high CNR and well outlined edges in case of microcalcifications.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Improvements in Night-Time Low Cloud Detection and MODIS-Style Cloud Optical Properties from MSG SEVIRI

The MODIS cloud optical properties algorithm (MOD06IMYD06 for Terra and Aqua MODIS, respectively) slated for production in Data Collection 6 has been adapted to execute using available channels on MSG SEVIRI. Available MODIS-style retrievals include IR Window-derived cloud top properties, using the new Collection 6 cloud top properties algorithm, cloud optical thickness from VISINIR bands, cloud effective radius from 1.6 and 3.7Jlm and cloud ice/water path. We also provide pixel-level uncertainty estimate for successful retrievals. It was found that at nighttime the SEVIRI cloud mask tends to report unnaturally low cloud fraction for marine stratocumulus clouds. A correction algorithm that improves detection of such clouds has been developed. We will discuss the improvements to nighttime low cloud detection for SEVIRI and show examples and comparisons with MODIS and CALIPSO. We will also show examples of MODIS-style pixel-level (Level-2) cloud retrievals for SEVIRI with comparisons to MODIS.

Wind, Galina (Gala)↗