Search NASA⌕ Search

SEARCH · Search NASA

Results for “data masking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

GPEDIT

GPEDIT compares each character in data record to corresponding character in mask provided by user. Mask indicates that alphabetic or numeric character is allowed or that blank or punctuation mark is anticipated. Mask can also indicate that any data character other than some invalid character is allowed.

Dash, J. B.↗

Systematic errors in Hadamard transform optics

Error sources encountered in Hadamard transform optical instruments are discussed. Such errors are caused by factors including moving masks, incorrect mask alignment, defects in mask fabrication, missing data, drifts in background level, and diffraction. Techniques for error reduction and/or elimination are described for each of the cases considered. It is noted that the errors described occur in singly encoded spectrometers and imagers.

Sloane, N. J. A.↗

Rocket and laboratory studies in astronomy

This report covers the period from September 1, 1992 to August 31, 1993. During the reporting period we launched the Faint Object Telescope to measure absolute fluxes of two hot dwarf stars in the spectral range below 1200 A. Although all systems worked normally, a higher than anticipated pressure in the detector led to ion-feedback that masked the useable data from the source. We have identified the source of the problem and are preparing for a reflight in the Fall of 1993. Our laboratory program for the evaluation of the ultraviolet performance of charge-coupled-detector (CCD) arrays continued with the aim of including a UV-sensitive CCD in a payload to be flown in 1994, and we have begun the assembly of this payload. Work has continued on the analysis of data from previous rocket experiments and from the UVX experiment which flew on STS-61C in January 1986.

Feldman, P. D.↗

Coronal Plumes in the Fast Solar Wind

The expansion of a coronal hole filled with a discrete number of higher density coronal plumes is simulated using a time-dependent two-dimensional code. A solar wind model including an exponential coronal heating function and a flux of Alfven waves propagating both inside and outside the structures is taken as a basic state. Different plasma plume profiles are obtained by using different scale heights for the heating rates. Remote sensing and solar wind in situ observations are used to constrain the parameter range of the study. Time dependence due to plume ignition and disappearance is also discussed. Velocity differences of the order of approximately 50 km/s, such as those found in microstreams in the high-speed solar wind, may be easily explained by slightly different heat deposition profiles in different plumes. Statistical pressure balance in the fast wind data may be masked by the large variety of body and surface waves which the higher density filaments may carry, so the absence of pressure balance in the microstreams should not rule out their interpretation as the extension of coronal plumes into interplanetary space. Mixing of plume-interplume material via the Kelvin-Helmholtz instability seems to be possible within the parameter ranges of the models defined here, only at large di stances from the Sun, beyond 0.2-0.3 AU. Plasma and composition measurements in the inner heliosphere, such as those which will become available with Solar Orbiter and Solar Probe Plus, should therefore definitely be able to identify plume remnants in the solar wind.

Velli, Marco↗

Development of a data management front end for use with a LANDSAT based information system

A user friendly front end was constructed to facilitate access to the LANDSAT mosaic data base supplied by JPL and to process both LANDSAT and ancillary data. Archieval and retrieval techniques were developed to efficiently handle this data base and make it compatible with requirements of the Pennsylvania Bureau of Forestry. Procedures are ready for: (1) forming the forest/nonforest mask in ORSER compressed map format using GSFC-supplied classification procedures; (2) registering data from a new scene (defoliated) to the mask (which may involve mosaicking if the area encompasses two LANDSAT scenes; (3) producing a masked new data set using the MASK program; (4) analyzing this data set to produce a map showing degrees of defoliation, output on the Versatec plotter; and (5) producing color composite maps by a diazo-type process.

Turner, B. J.↗

Automated Detection of Spurious Signals in VLBI Phase Calibration Data

In this memorandum, a set of processing strategies for automatic masking of phase calibration tones is outlined as implemented in the software package PIMA in the task Generate Phase Calibration Mask, or GEPM. The task relies on a robust procedure of cleaning phase calibration data before employing several mathematical strategies designed to selectively identify spurious signals from phase calibration tones. These strategies were derived as more rigorous implementations of heuristics traditionally used by analysts in manually identifying problematic phase calibration data. The task is intended to automate the process of generating a phase calibration mask and in so doing increase the speed and regularity of VLBI analysis. At the outset of the project, a series of goals were identified to evaluate the success of this mask generation. This included the development of an algorithm to identify and mask short-term (defined as less than 10 seconds in length) spurious signals affecting phase calibration data, the development of an algorithm to identify and mask phase calibration tones affected by constant radio-frequency interference, the implementation of a detection scheme for identifying large jumps in phase calibration phase caused by clock breaks, and finally a method of reporting phase calibration health metrics to the user. Processing of over 10 experiments has demonstrated that the final form of the task GEPM as detailed in this technical memorandum satisfies each of these conditions and satisfactorily performs the task of automatic phase calibration data masking, although the wide variety in quality and characteristics of phase calibration data makes a single solution to the problem quite difficult. A series of user inputs have therefore been defined to assist analysts in tailoring automatic masking to specific stations and phase calibration generators. The vast majority of applicable code was written in FORTRAN to increase execution speed and ease of interfacing with the existing code base in PIMA, but a wrapper function in Python was also written to allow for a simpler method of interacting with GEPM and inputting relevant parameters. In addition to this report, thorough documentation was added to the already existing repositories associated with PIMA as a whole.

Geodesy↗

Development of an Operational Land Water Mask for MODIS Collection 6, and Influence on Downstream Data Products

Data from the Moderate Resolution Imaging Spectro-radiometer (MODIS)on-board the Earth Observing System Terra and Aqua satellites are processed using a land water mask to determine when an algorithm no longer needs to be run or when an algorithm needs to follow a different pathway. Entering the fourth reprocessing (Collection 6 (C6)) the MODIS team replaced the 1 km water mask with a 500 m water mask for improved representation of the continental surfaces. The new water mask represents more small water bodies for an overall increase in water surface from 1 to 2 of the continental surface. While this is still a small fraction of the overall global surface area the increase is more dramatic in certain areas such as the Arctic and Boreal regions where there are dramatic increases in water surface area in the new mask. MODIS products generated by the on-going C6 reprocessing using the new land water mask show significant impact in areas with high concentrations of change in the land water mask. Here differences between the Collection 5 (C5) and C6 water masks and the impact of these differences on the MOD04 aerosol product and the MOD11 land surface temperature product are shown.

Carroll, M. L.↗

Progress Towards a Common CERES Cloud Mask Algorithm for MODIS and VIIRS: Evaluation using CALIOP Data

For over two decades The Clouds and the Earth’s Radiant Energy System (CERES) project has endeavored to produce a long-term global climate data record for detecting changes in the Earth’s radiation budget and to improve understanding of how clouds contribute to those changes. CERES incorporates cloud information derived from passive narrowband satellite imaging radiometers, and over the course of the project different instruments have contributed to this effort, namely the Moderate Resolution Imaging Spectroradiometer (MODIS) and the Visible Infrared Imaging Radiometer Suite (VIIRS).Cloud properties have been derived from MODIS on the Aqua satellite for CERES since 2002,and VIIRS on the NOAA-20 satellite launched in 2017 will continue the cloud record once Aqua-MODIS reaches the end of its operational lifetime. However, MODIS and VIIRS have different spectral capabilities and characteristics which complicates our ability to seamlessly transition the record from MODIS to VIIRS. This study evaluates some of the recent algorithm modifications incorporated by the CERES Cloud Working Group towards developing a unified cloud mask algorithm for MODIS and VIIRS that utilizes a set of spectral bands common to both instruments. Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) data products are used to evaluate MODIS and VIIRS regional cloud fraction estimates and identify areas where improvements can be made. The cloud mask algorithm relies on computed estimates of cloud-free top-of-atmosphere radiances to differentiate cloudy and cloud-free imager pixels. The unified cloud mask algorithm currently under development uses a reduced number of spectral bands common to both MODIS and VIIRS and so relies on the accuracy of these simulated cloud-free radiances more heavily than predecessor algorithms, i.e., the CERES Edition 4 cloud mask, which use as much spectral information as available on each imager with less consideration for cross-platform consistency. Our validation strategy using CALIOP data is also described. The CALIOP observations are critical for assessing cloud detection accuracies and for independently confirming cloud-free conditions which enables a more robust evaluation of the simulated cloud-free radiances for biases due to factors such as view angle and the spectral dependence of water vapor absorption. These effects are known to differ for the two satellite instruments. Comparisons of MODIS and VIIRS cloud fractions are presented in context with estimates from CALIOP and from the CERES Edition 4 cloud mask algorithm to gauge current progress in developing accurate and consistent MODIS and VIIRS cloud properties for CERES.

CERES↗

A Cloud Mask for AIRS

With the preliminary release of AIRS Level 1 and 2 data to the scientific community, there is a growing need for an accurate AIRS cloud mask for data assimilation studies and in producing products derived from cloud free radiances. Current cloud information provided with the AIRS data are limited or based on simplified threshold tests. A multispectral cloud detection approach has been developed for AIRS that utilizes the hyper-spectral capabilities to detect clouds based on specific cloud signatures across the short wave and long wave infrared window regions. This new AIRS cloud mask has been validated against the existing AIRS Level 2 cloud product and cloud information derived from MODIS. Preliminary results for both day and night applications over the continental U.S. are encouraging. Details of the cloud detection approach and validation results will be presented at the conference.

Brubaker, N.↗

H31G-1596: DeepSAT's CloudCNN: A Deep Neural Network for Rapid Cloud Detection from Geostationary Satellites

Cloud and cloud shadow detection has important applications in weather and climate studies. It is even more crucial when we introduce geostationary satellites into the field of terrestrial remote sensing. With the challenges associated with data acquired in very high frequency (10-15 mins per scan), the ability to derive an accurate cloud shadow mask from geostationary satellite data is critical. The key to the success for most of the existing algorithms depends on spatially and temporally varying thresholds,which better capture local atmospheric and surface effects.However, the selection of proper threshold is difficult and may lead to erroneous results. In this work, we propose a deep neural network based approach called CloudCNN to classify cloudshadow from Himawari-8 AHI and GOES-16 ABI multispectral data. DeepSAT's CloudCNN consists of an encoderdecoder based architecture for binary-class pixel wise segmentation. We train CloudCNN on multi-GPU Nvidia Devbox cluster, and deploy the prediction pipeline on NASA Earth Exchange (NEX) Pleiades supercomputer. We achieved an overall accuracy of 93.29% on test samples. Since, the predictions take only a few seconds to segment a full multispectral GOES-16 or Himawari-8 Full Disk image, the developed framework can be used for real-time cloud detection, cyclone detection, or extreme weather event predictions.

GOES-1↗

Implementation of an algorithm for cylindrical object identification using range data

One of the problems in 3-D object identification and localization is addressed. In robotic and navigation applications the vision system must be able to distinguish cylindrical or spherical objects as well as those of other geometric shapes. An algorithm was developed to identify cylindrical objects in an image when range data is used. The algorithm incorporates the Hough transform for line detection using edge points which emerge from a Sobel mask. Slices of the data are examined to locate arcs of circles using the normal equations of an over-determined linear system. Current efforts are devoted to testing the computer implementation of the algorithm. Refinements are expected to continue in order to accommodate cylinders in various positions. A technique is sought which is robust in the presence of noise and partial occlusions.

Bozeman, Sylvia T.↗

Lunar Terrain Coverage Analysis Data Delivery Workflow

In this work, we are developing a lunar terrain database to enable fast rendering of sun illumination and earth visibility for a proposed coverage analysis tool. This development will advance lunar mission design and formulation for current and future communications architectures, and will aid in lunar surface mission planning and communications/navigation operations. Our effort can be described in three steps: (1) we parallelize a brute force algorithm, which computes elevation masks from laser altimetry data acquired by the Lunar Reconnaissance Orbiter’s (LRO) Lunar Orbiter Laser Altimeter (LOLA); (2) we investigate parallel I/O methods to store terrain mask information from step (1) into a parallel file system; and (3) we finally deliver data to the terrain coverage analysis tool.

Michels, Dominik↗

Image masking using polygon fills and morphological transformations

Polygon-fill operations and morphological transformations are effective computational tools for the land-masking and coastline-correction preprocessing operations often applied to AVHRR data prior to oceanographic applications. These masking operations, in conjunction with cloud-screening techniques, can be used on such other oceanographically significant remote-sensing data as those of the Coastal Zone Color Scanner, GOES, and Landsat. The sensitivity of the methods to regional variations in atmospheric conditions and land-ocean temperature gradients is assessed for tropical, midlatitude, and high latitude regions.

Simpson, James J.↗

Evaluation of Decision Trees for Cloud Detection from AVHRR Data

Automated cloud detection and tracking is an important step in assessing changes in radiation budgets associated with global climate change via remote sensing. Data products based on satellite imagery are available to the scientific community for studying trends in the Earth's atmosphere. The data products include pixel-based cloud masks that assign cloud-cover classifications to pixels. Many cloud-mask algorithms have the form of decision trees. The decision trees employ sequential tests that scientists designed based on empirical astrophysics studies and simulations. Limitations of existing cloud masks restrict our ability to accurately track changes in cloud patterns over time. In a previous study we compared automatically learned decision trees to cloud masks included in Advanced Very High Resolution Radiometer (AVHRR) data products from the year 2000. In this paper we report the replication of the study for five-year data, and for a gold standard based on surface observations performed by scientists at weather stations in the British Islands. For our sample data, the accuracy of automatically learned decision trees was greater than the accuracy of the cloud masks p < 0.001.

AVHRR (ADVANCED VERY HIGH RESOLUTION RADIOMETER)↗

Flight Schedule and the Circadian Clock Influence on Sleep Loss During Overnight Cargo Operations

Thirty-four flight crew members were monitored before, during, and after two 8-day overnight cargo duty patterns which involved multiple flights at night crossing no more than one time zone per 24 h. Rectal temperature, heart rate, and wrist activity were recorded every 2 min. Sleep quantity and quality, and nap timing, were noted in a logbook. To reduce the masking effects of physical activity on temperature, 0.28 C was added to each subject's raw temperature data whenever he reported being asleep. For both masked and unmasked data, daily temperature minima were estimated from the multiple complex demodulated waveform. The temperature minima did not show a progressive adaptation to night duty, which was interrupted by a night off after 5 nights on one trip pattern and after 3 nights on the other. On duty days, the average temperature minimum delayed by about 3 h, occurring near the end of the duty period. Daytime sleep episodes averaged 2.9 h shorter than nighttime sleep episodes, and were rated as lighter, less restorative, and poorer overall. Fifty-three percent of subjects slept more than once per 24 h while they were on night duty, compared to 17% when able to sleep at night. The total sleep per 24 h on duty days averaged 1.2 h less than pretrip. Twenty-nine percent of subjects lost more than 2 h of sleep per 24 h across the 8-day duty patterns. After night duty, subjects awoke around 1400 local time, even when they had slept 2-3 h less than a normal nocturnal sleep episode. Consequently, the duration of morning sleep episodes was correlated with the off-duty time (multiple r(sup 2)=0.44, F=37.23, p less than 0.0001). Anecdotally, crew members complained of being unable to sleep longer and not feeling well-rested. These wakeups were clustered 6 h after the temperature minimum, which suggests that they may have been a response to the circadian wakeup signal. Daytime layovers in which crew members were able to sleep again in the evening ended later (0200-0300) and were longer (average 19.2 h versus 14.8 h) than those in which they slept only once in the morning. Overnight cargo crew members are working around the time of the circadian nadir with an accumulating sleep debt. Two scheduling factors affect sleep loss during these operations: how long before the circadian wakeup signal crew members come off duty, and whether the layover lasts long enough to permit a second sleep episode in the early evening.

Gander, Philippa H.↗

A Psychoacoustic Test on the Effect of Masking on Annoyance to Urban Air Mobility Vehicle Noise

Urban Air Mobility (UAM) vehicles have a large range of designs and configurations that lead to new noise characteristics and potentially different perceptual responses when compared to traditional aircraft. In addition, UAM vehicles are expected to operate around and within densely populated regions where the presence of ambient background noise is often present. Strategically, this can be leveraged to inform vehicle design and operations to partially or completely mask UAM noise, allowing for mitigation of negative responses and an increased number of allowed operations. A psychoacoustic test was conducted to investigate how masking effects can influence the annoyance response to a low frequency harmonic tone complex (80-320 Hz). To do this, five test subjects compared their annoyance response to the low frequency tonal noise with a higher frequency broadband noise (10dB down bandwidth between 300-2000 Hz), with and without a masking noise present. Detection thresholds were also measured for both sounds to help fit a model to the data. Although the effect of masking on annoyance is complex, results indicate that for some individuals, masking leads to a lower annoyance than the sound level alone would predict.

Matthew Boucher↗

Chapter 10 - Remote Sensing Measurements of Aerosol Properties

Satellite instruments have proven especially capable at monitoring the quantity of airborne particles in columns of atmosphere, globally. This chapter describes the principles of satellite measurements and retrieval algorithms, and surveys current instruments and their capabilities. We outline the issues associated with retrieval algorithms, such as surface characterization and aerosol proximity to clouds, and the challenges with interpretation of the results. The relationship between measured aerosol properties and climate-relevant aerosol properties simulated in models is outlined, as well as how measurements are used to evaluate models. Most space-based aerosol instruments are passive sensors that measure reflected sunlight at multiple wavelengths, some at multiple viewing angles. A few are active sensors that send out their own laser light and measure the returned signal. Except when clouds are present, the excess amount of light scattered back to space, beyond that expected from the surface and atmospheric gas, is attributed to aerosol. Satellite measurements are used in many ways in aerosol research. They often provide the only method for monitoring hazardous phenomena such as major wildfire and volcanic eruption plumes, especially in remote areas. Stable, long-term, near-global-scale satellite data records make it possible to identify regional and global aerosol trends. Aerosol radiative effects on climate can be quantified on a near-global scale and used to estimate the strength of aerosol–radiation and aerosol–cloud interactions as well as to evaluate climate model simulations of these interactions. Aerosol-type mapping from satellite imagery is helpful for source attribution, model validation, and to constrain particle light-absorption properties that are essential for radiative forcing calculations. The range of aerosol properties retrieved from satellite observations has grown considerably since the first global estimates of aerosol optical depth (τ a) over ocean were made in the late 1970s. Methods for retrieving particle size and light-absorption properties were explored in the 1990s using multispectral, multi-angle observations, and polarization in visible and near-infrared wavelengths. Sensitivity to particle light absorption, primarily from black or brown carbon content, improved with the inclusion of UV channels, and sensitivity to very thin aerosol layers in the upper troposphere and lower stratosphere was advanced with the use of limb-sounding instruments and active sensors. There are limitations to every measurement technique, including satellite aerosol remote sensing. For wide-swath, passive instruments, aerosol retrievals near clouds can present substantial challenges as far as 15 km away due to cloud-scattered light contaminating the signal. In nearly all cases, retrievals over bright snow and ice surfaces are precluded because surface reflectance uncertainties can overwhelm the aerosol signal. Similarly, meteorological cloud is identified and masked out where possible. Data from passive sensors also lack vertical resolution except those that view toward the limb or where multi-angle imagery is acquired over plumes from wildfires, erupting volcanoes, and wind-blown dust. Yet, passive sensors provide vastly more coverage than the active instruments that mitigate these issues. Particle microphysical information is qualitative from all remote sensing techniques, relying on proxies to infer particle composition, hygroscopicity, and the amount of light-absorbing material. Further, particles smaller than about 200 nm diameter cannot be distinguished from atmospheric gas molecules with remote sensing, which hinders studies of cloud condensation nuclei and their effects on clouds. Most satellite instruments dedicated to aerosol observations are in low-Earth, near-polar, sun-synchronous orbits, which means they cross the equator at the same local time each day. Most are set on cycles that repeat approximately every 16 days, which makes it difficult to monitor aerosol evolution locally. Geostationary satellites make it possible to observe changes occurring from minutes to hours over regions up to 8000 km in size, but lack coverage of high latitudes, and often provide more limited constraints on aerosol properties. Ground-truth data are vital for satellite aerosol-retrieval validation. The AErosol RObotic NETwork (AERONET) of sun photometers was created in 1993 and has become an established global network of over 350 instruments for validating satellite measurements. The network, as well as global networks of ground-based lidars, solar flux radiometers and other sun photometers, are widely used for evaluating global satellite retrievals and model simulations. NASA's Earth Observing System (EOS) program beginning in 1999 led to improvements in reliability, spatial resolution, and spectral resolution (and hence, to improved particle size discrimination and light absorption properties). Satellite payloads include advanced broad-swath and multi-angle imagers, along with the first space-based active sensor focused largely on long-term aerosol monitoring. Since about 2002, Europe's SENTINEL and operational meteorological satellite fleets are also providing sustained aerosol observations, with planned continuation until at least 2030. Satellite remote sensing instruments offer valuable data for evaluating aerosol representations in global climate models. They have been used to assess aerosol optical and physical properties, trends and distributions, and are applied increasingly as direct model constraints in data assimilation to create global aerosol reanalysis products. Aerosol optical depth is the most common quantity adopted for routine model evaluation, including multiwavelength data to loosely constrain particle-size distributions. These evaluations of multiple models have revealed general biases in their regional aerosol amounts and seasonal patterns of transport and removal. Although satellite measurements have near-global coverage, substantial errors can be introduced into the model observation comparison unless attention is paid to spatial and temporal collocation, cloud screening, subgrid-scale variability, and measurement uncertainties that vary with retrieval conditions.

aerosol properties↗