SEARCH · Search NASA

Results for “Data masking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

NASA NTRS1984

Prescription of land-surface boundary conditions in GISS GCM 2: A simple method based on high-resolution vegetation data bases

A simple method was developed for improved prescription of seasonal surface characteristics and parameterization of land-surface processes in climate models. This method, developed for the Goddard Institute for Space Studies General Circulation Model II (GISS GCM II), maintains the spatial variability of fine-resolution land-cover data while restricting to 8 the number of vegetation types handled in the model. This was achieved by: redefining the large number of vegetation classes in the 1 deg x 1 deg resolution Matthews (1983) vegetation data base as percentages of 8 simple types; deriving roughness length, field capacity, masking depth and seasonal, spectral reflectivity for the 8 types; and aggregating these surface features from the 1 deg x 1 deg resolution to coarser model resolutions, e.g., 8 deg latitude x 10 deg longitude or 4 deg latitude x 5 deg longitude.

Matthews, E.↗

NASA NTRS1993

Automatic array alignment in data-parallel programs

FORTRAN 90 and other data-parallel languages express parallelism in the form of operations on data aggregates such as arrays. Misalignment of the operands of an array operation can reduce program performance on a distributed-memory parallel machine by requiring nonlocal data accesses. Determining array alignments that reduce communication is therefore a key issue in compiling such languages. We present a framework for the automatic determination of array alignments in array-based, data-parallel languages. Our language model handles array sectioning, reductions, spreads, transpositions, and masked operations. We decompose alignment functions into three constituents: axis, stride, and offset. For each of these subproblems, we show how to solve the alignment problem for a basic block of code, possibly containing common subexpressions. Alignments are generated for all array objects in the code, both named program variables and intermediate results. We assign computation to processors by virtue of explicit alignment of all temporaries; the resulting work assignment is in general better than that provided by the 'owner-computes' rule. Finally, we present some ideas for dealing with control flow, replication, and dynamic alignments that depend on loop induction variables.

Chatterjee, Siddhartha↗

NASA NTRS2013

Multi-sensor Cloud Retrieval Simulator and Remote Sensing from Model Parameters : Synthetic Sensor Radiance Formulation - Pt. 1

In this paper we describe a general procedure for calculating synthetic sensor radiances from variable output from a global atmospheric forecast model. In order to take proper account of the discrepancies between model resolution and sensor footprint, the algorithm takes explicit account of the model subgrid variability, in particular its description of the probability density function of total water (vapor and cloud condensate.) The simulated sensor radiances are then substituted into an operational remote sensing algorithm processing chain to produce a variety of remote sensing products that would normally be produced from actual sensor output. This output can then be used for a wide variety of purposes such as model parameter verification, remote sensing algorithm validation, testing of new retrieval methods and future sensor studies.We show a specific implementation using the GEOS-5 model, the MODIS instrument and the MODIS Adaptive Processing System (MODAPS) Data Collection 5.1 operational remote sensing cloud algorithm processing chain (including the cloud mask, cloud top properties and cloud optical and microphysical properties products). We focus on clouds because they are very important to model development and improvement.

Simulations↗

NASA NTRS2013

Equivalent Sensor Radiance Generation and Remote Sensing from Model Parameters: Equivalent Sensor Radiance Formulation - Part 1

In this paper we describe a general procedure for calculating equivalent sensor radiances from variables output from a global atmospheric forecast model. In order to take proper account of the discrepancies between model resolution and sensor footprint the algorithm takes explicit account of the model subgrid variability, in particular its description of the probably density function of total water (vapor and cloud condensate.) The equivalent sensor radiances are then substituted into an operational remote sensing algorithm processing chain to produce a variety of remote sensing products that would normally be produced from actual sensor output. This output can then be used for a wide variety of purposes such as model parameter verification, remote sensing algorithm validation, testing of new retrieval methods and future sensor studies. We show a specific implementation using the GEOS-5 model, the MODIS instrument and the MODIS Adaptive Processing System (MODAPS) Data Collection 5.1 operational remote sensing cloud algorithm processing chain (including the cloud mask, cloud top properties and cloud optical and microphysical properties products.) We focus on clouds and cloud/aerosol interactions, because they are very important to model development and improvement.

Simulations↗

NASA NTRS2018

Disentangling Climate and Disturbance Effects on Regional Vegetation Greening Trends

Productivity of northern latitude forests is an important driver of the terrestrial carbon cycle and is already responding to climate change. Studies ofthe satellite-derived Normalized Difference VegetationIndex (NDVI) for northern latitudes indicate recent changes in plant productivity. These detected greening and browning trends are often attributedto a lengthening of the growing season from warming temperatures. Yet, disturbance-recovery dynamics are strong drivers of productivity and can mask direct effects of climate change. Here, we analyze 1-km resolution NDVI data from 1989to 2014 for the northern latitude forests of the Greater Yellowstone Ecosystem for changes in plant productivity to address the following questions:(1) To what degree has greening taken place in the GYE over the past three decades? and (2) What is the relative importance of disturbance and climate in explaining NDVI trends? We found that the spatial extents of statistically significant productivity trends were limited to local greening and browning areas. Disturbance history, predominately fire disturbance, was a major driver of these detected NDVI trends. After accounting for fire-,insect-, and human-caused disturbances, increasing productivity trends remained. Productivity of northern latitude forests is generally considered temperature-limited; yet, we found that precipitation was a key driver of greening in the GYE.

Disturbance↗

NASA NTRSDate not supplied

Snow Depth from AMSR-2 Using Multispectral Satellite Data in an Artificial Neural Network

By using diffusion theory and Monte Carlo lidar radiative transfer simulations, Hu et al. (2022b) has derived snow depth from the first-, second- and third-order moments of the lidar backscattering pathlength distribution. Lu et al. (2022) calculated the snow depth by applying the methods to the satellite ICESat-2 lidar measurements over the Arctic sea ice, as well as land surfaces of Northern Hemisphere. In this paper, an artificial neural network (ANN) algorithm, employing several channels from Advanced Microwave Scanning Radiometer 2 (AMSR-2) and the humidity vertical profiles from Global Modeling and Assimilation Office (GMAO) Goddard Earth Observing System for Instrument Teams (GEOS-IT) product, is trained to determine snow depth identified by time and geolocation matched 2019 ICESat-2 snow-depth data during winter months over the Arctic sea ice. The trained ANN snow-depth was applied to 2018 AMSR-2 clear pixel data, although the algorithms perform reasonably well in thinner clouds. The validation data (different from the training set) of ANN snow depth from AMSR-2 showed a good agreement with time matched and co-located snow-depth values from ICESat-2. The bias was near zero, with mean absolute error (MAE) 0.05 cm and a root-mean-square-error (RMSE) 0.08 cm. Prior applying the trained ANN snow depth to AMSR-2 data, a cloud screening algorithm was developed with a similar approach. A separate ANN cloud mask was trained to determine an AMSR-2 pixel is clear or cloudy with time and geolocation matched 2015 CALIOP Vertical Feature Mask (VFM) over Arctic sea ice. The ANN cloud mask from AMSR-2 under-estimated cloud fraction by 3-6% compared to CALIOP . The additional research is needed to conclusively evaluate the ANN cloud mask accuracy. Finally, this paper will lay the foundation for a sustained long-term snowfall and snow-storm monitoring system. The future Cloud Aerosol LIdar for Global scale Observations of the ocean-Land Atmosphere system (CALIGOLA) mission will provide a means to calculate snow depth from the lidar backscattering pathlength distribution, benefiting from the UV, visible and infrared pulses. With the calculated snow depth as the truth one could develop a machine learning algorithm, as it was done in this paper, using a passive microwave instrument available at that time to generate a wide range of snow depth data, covering extensive spatial areas in the cross-orbit direction.

Neural Network↗

NASA NTRS1997

Development of a Simulated Data Set for the SeaWiFS Mission

A realistic simulated data set is essential for mission readiness preparations and can potentially assist in all phases of ground support for a future mission. Such a data set was created for the Sea-viewing Wide Field-of-view Sensor (SeaWiFS), a global ocean color mission due for launch in 1997. This data set incorporates a representation of virtually every known aspect of the flight mission. Thus, it provides a high fidelity data set for testing most phases of the ground system, Including data processing, data transfers, calibration and validation, quality control, and mission operations. The data set is constructed for a seven-day period, March 25-31, 1994. Specific features of the data set: it includes Global Area Coverage (GAC), recorded Local Area Coverage (LAC), and real-time High Resolution Picture Transmission (HRFIT) data for the seven-day period; it includes a realistic orbit which is propagated using a Brouwer-Lyddane model with drag; the data correspond to a command schedule based on the orbit for this seven-day period; it includes total (at-satellite) radiances for ocean, land, clouds, and ice; it utilizes a high-resolution land/sea mask; it includes actual SeaWiFS spectral responses; it includes the actual sensor saturation responses; it is formatted according to current onboard data structures; and it includes corresponding telemetry (instrument and spacecraft) data. The methods are described and some examples of the output are given.

Gregg, Watson W.↗

NASA NTRS2012

Science from Kepler Collateral Data: 50 Kilosecond per Year from 13 Million Stars

As each Kepler frame is read out, light from each star in a CCD column accumulates in successive pixels as they wait for the next row to be read out. This accumulation is the same in the masked rows at the start of the readout and virtual rows at the end of the readout as it is in the science data. A range of these "smear" rows are added together for each long cadence and sent to the ground for calibration purposes. We will introduce and describe this smear collateral data, discuss and demonstrate its potential use for scientific studies exclusive of Kepler calibration,[1,2] including global characteristics of stellar variability, which are influenced by parameters of galactic evolution.

Kolodziejczak, J. J.↗

NASA NTRS2011

Science from Kepler Collateral Data: 50 Kilosecond per Year from 13 Million Star?

Kolodziejczak, J. J.↗

NASA NTRS2004

Daytime Cloud Property Retrievals Over the Arctic from Multispectral MODIS Data

Improving climate model predictions over Earth's polar regions requires a complete understanding of polar clouds properties. Passive satellite remote sensing techniques can be used to retrieve macro and microphysical properties of polar cloud systems. However, over the Arctic, there is minimal contrast between clouds and the background snow surface observed in satellite data, especially for visible wavelengths. This makes it difficult to identify clouds and retrieve their properties from space. Variable snow and ice cover, temperature inversions, and the predominance of mixed-phase clouds further complicate cloud property identification. For this study, the operational Clouds and the Earth s Radiant Energy System (CERES) cloud mask is first used to discriminate clouds from the background surface in Terra Moderate Resolution Imaging Spectroradiometer (MODIS) data. A solar-infrared infrared nearinfrared technique (SINT) first used by Platnick et al. (2001) is used here to retrieve cloud properties over snow and ice covered regions.

Spangenberg, Douglas A.↗

NASA NTRS2018

The Harmonized Landsat and Sentinel-2 Surface Reflectance Data Set

The Harmonized Landsat and Sentinel-2 (HLS) project is a NASA initiative aiming to produce a VirtualConstellation (VC) of surface reflectance (SR) data acquired by the Operational Land Imager (OLI) and MultiSpectral Instrument (MSI) aboard Landsat 8 and Sentinel-2 remote sensing satellites, respectively. The HLS products are based on a set of algorithms to obtain seamless products from both sensors (OLI and MSI): atmospheric correction, cloud and cloud-shadow masking, spatial co-registration and common gridding, bidirectional reflectance distribution function normalization and spectral bandpass adjustment. Three products are derivedfrom the HLS processing chain: (i) S10: full resolution MSI SR at 10 m, 20 m and 60 m spatial resolutions; (ii)S30: a 30 m MSI Nadir BRDF (Bidirectional Reflectance Distribution Function)-Adjusted Reflectance (NBAR);(iii) L30: a 30 m OLI NBAR. All three products are processed for every Level-1 input products from Landsat 8/OLI (L1T) and Sentinel-2/MSI (L1C). As of version 1.3, the HLS data set covers 10.35 million km2 and spans from first Landsat 8 data (2013); Sentinel-2 data spans from October 2015. The L30 and S30 show a good consistency with coarse spatial resolution products, in particular MODIS Collection 6 MCD09CMG products (overall deviations do not exceed 11%) that are used as a reference for quality assurance. The spatial co-registration of the HLS is improved compared to original Landsat 8 L1T and Sentinel 2A L1C products, for which misregistration issues between multi-temporal data are known. In particular, the resulting computed circular errors at 90% for the HLS product are 6.2 m and 18.8 m, for S10 and L30 products, respectively. The main known issue of the current data set remains the Sentinel-2 cloud mask with many cloud detection omissions. The cross-comparison with MODIS was used to flag products with most evident non-detected clouds. A time series outlier filtering approach is suggested to detect remaining clouds. Finally, several time series are presented to highlight the high potential of the HLS data set for crop monitoring.

Landsat Sentinel-2↗

NASA NTRS2010

Assessment of Aerosol Distributions from GEOS-5 Using the CALIPSO Feature Mask

A-train sensors such as MODIS, MISR, and CALIPSO are used to determine aerosol properties, and in the process a means of estimating aerosol type (e.g. smoke vs. dust). Correct classification of aerosol type is important for climate assessment, air quality applications, and for comparisons and analysis with aerosol transport models. The Aerosols-Clouds-Ecosystems (ACE) satellite mission proposed in the NRC Decadal Survey describes a next generation aerosol and cloud suite similar to the current A-train, including a lidar. The future ACE lidar must be able to determine aerosol type effectively in conjunction with modeling activities to achieve ACE objectives. Here we examine the current capabilities of CALIPSO and the NASA Goddard Earth Observing System general circulation model and data assimilation system (GEOS-5), to place future ACE needs in context. The CALIPSO level 2 feature mask includes vertical profiles of aerosol layers classified by type. GEOS-5 provides global 3D aerosol mass for sulfate, sea salt, dust, and black and organic carbon. A GEOS aerosol scene classification algorithm has been developed to provide estimates of aerosol mixtures and extinction profiles along the CALIPSO orbit track. In previous work, initial comparisons between GEOS-5 derived aerosol mixtures and CALIPSO derived aerosol types were presented for July 2007. In general, the results showed that model and lidar derived aerosol types did not agree well in the boundary layer. Agreement was poor over Europe, where CALIPSO indicated the presence of dust and pollution mixtures yet GEOS-5 was dominated by pollution with little dust. Over the ocean in the tropics, the model appeared to contain less sea salt than detected by CALIPSO, yet at high latitudes the situation was reserved. Agreement between CALIPSO and GEOS-5, aerosol types improved above the boundary layer, primarily in dust and smoke dominated regions. At higher altitudes (> 5 km), the model contained aerosol layers not detected by CALIPSO. Here we present new results for a full year study using the new Version 3 CALIPSO data and most recent GEOS-5 model results.

Welton, Ellsworth↗

NASA NTRS1994

Reanalysis of Mariner 9 UV Spectrometer Data for Ozone, Cloud, and Dust Abundances, and Their Interaction Over Climate Timescales

Mariner 9 UV spectrometer data have been reinverted for the ozone abundance. The spectra were fit by models which covered the full range in observed solar zenith angle, cloud, dust and ozone amount, ice albedo and look angles. Errors in ozone retrieval with this data are tabulated over a range in theses conditions and are shown graphically. This work shows that significant underestimation of ozone occurred in earlier analysis of Mariner 9 data, and that much of the observed variability in Mars ozone is due to masking of ozone by clouds and dust. An in-situ measurement by balloon is recommended as it is the only technique capable of accurately inferring the ozone abundance in all conditions. Recommendations for future research are also presented. 7 manuscripts have been published in refereed journals, and three are in review. A review of these publications and presentations is in the report.

Lindner, Bernhard Lee↗

NASA NTRS2001

Remote Sensing of Cloud, Aerosol, and Water Vapor Properties from MODIS

MODIS is an earth-viewing cross-track scanning spectroradiometer launched on the Terra satellite in December 1999. MODIS scans a swath width sufficient to provide nearly complete global coverage every two days from a polar orbiting, sun-synchronous, platform at an altitude of 705 kilometers, and provides images in 36 spectral bands between 0.415 and 14.235 micrometers with spatial resolutions of 250 meters (2 bands), 500 meters (5 bands) and 1000 meters (29 bands). These bands have been carefully selected to enable advanced studies of land, ocean, and atmospheric processes. In this presentation we review the comprehensive set of remote sensing algorithms that have been developed for the remote sensing of atmospheric properties using MODIS data, placing primary emphasis on the principal atmospheric applications of (i) developing a cloud mask for distinguishing clear sky from clouds, (ii) retrieving global cloud radiative and microphysical properties, including cloud top pressure and temperature, effective emissivity, cloud optical thickness, thermodynamic phase, and effective radius, (iii) monitoring tropospheric aerosol optical thickness over the land and ocean and aerosol size distribution over the ocean, (iv) determining atmospheric profiles of moisture and temperature, and (v) estimating column water amount. The physical principles behind the determination of each of these atmospheric products will be described, together with an example of their application using MODIS observations. All products are archived into two categories: pixel-level retrievals (referred to as Level-2 products) and global gridded products at a latitude and longitude resolution of 1 degree (Level-3 products). An overview of the MODIS atmosphere algorithms and products, status, validation activities, and early level-2 and -3 results will be presented.

King, Michael D.↗

NASA NTRS2001

Calibration of of Sun Photometers and Sky Radiance Sensors

The main source of error in retrieving aerosol optical thicknesses using sun photometry comes from the determination of the TOA voltages. The degradation of interference filters is the most important source of the long-term changes in the cross-calibrations. Although major improvements have been made in the design of the filters (interference filters fabricated using ion-assisted deposition), the filters remain the principal factor limiting performance of the sun photometers. Degradation of filters necessitates frequent calibration of sun photometers and frequent measurements of the filter transmission or the relative system response. The degradation of the filters mounted on the CIMEL sun photometers have been monitored since 1993 by the Aerosol Robotic Network (AERONET) project. The decay reported by Holben et al. for the first two years of a CIMEL#s operation is between 1 and 5%. Nevertheless, the filters mounted on CIMEL instruments are regularly replaced after two years of use. The cross-calibration technique consists of taking measurements concurrently with the uncalibrated and the reference sun photometers. While analyzing measurements, the quality of the calibration has to be checked, using the following considerations: (1) any cirrus clouds suspected to be masking the sun, during the calibration period, need to be reported and the corresponding data set removed; and (2) the stability of the day needs to be checked. This chapter will describe calibration techniques, facilities, and protocols used for calibrating sun photometers and sky radiometers.

Pietras, Christophe↗

NASA NTRS2001

Remote Sensing of Cloud, Aerosol, and Land Properties from MODIS: Applications to the East Asia Region

MODIS is an earth-viewing cross-track scanning spectroradiometer launched on the Terra satellite in December 1999. MODIS scans a swath width sufficient to provide nearly complete global coverage every two days from a polar-orbiting, sun-synchronous platform at an altitude of 705 km, and provides images in 36 spectral bands between 0.415 and 14.235 microns with spatial resolutions of 250 m (two bands), 500 m (five bands) and 1000 m (29 bands). These bands have been carefully selected to enable advanced studies of land, ocean, and atmospheric processes. In this presentation we review the comprehensive set of remote sensing algorithms that have been developed for the remote sensing of atmospheric properties using MODIS data, placing primary emphasis on the principal atmospheric applications of (i) developing a cloud mask for distinguishing clear sky from clouds, (ii) retrieving global cloud radiative and microphysical properties, including cloud top pressure and temperature, effective emissivity, cloud optical thickness, thermodynamic phase, and effective radius, (iii) monitoring tropospheric aerosol optical thickness over the land and ocean and aerosol size distribution over the ocean, (iv) determining atmospheric profiles of moisture and temperature, and (v) estimating column water amount. The physical principles behind the determination of each of these atmospheric products will be described, together with an example of their application using MODIS observations to the east Asian region in Spring 2001. All products are archived into two categories: pixel-level retrievals (referred to as Level-2 products) and global gridded products at a latitude and longitude resolution of 1 degree (Level-3 products). An overview of the MODIS atmosphere algorithms and products, status, validation activities, and early level-2 and -3 results will be presented.

King, Michael D.↗

NASA NTRS2001

Remote Sensing of Cloud, Aerosol, and Water Vapor Properties from MODIS

MODIS is an earth-viewing cross-track scanning spectroradiometer launched on the Terra satellite in December 1999. MODIS scans a swath width sufficient to provide nearly complete global coverage every two days from a polar-orbiting, sun-synchronous, platform at an altitude of 705 km, and provides images in 36 spectral bands from 0.415 to 14.235 microns with spatial resolutions of 250 m (2 bands), 500 m (5 bands) and 1000 m (29 bands). These bands have been carefully selected to enable advanced studies of land, ocean, and atmospheric processes. In this presentation I will review the comprehensive set of remote sensing algorithms that have been developed for the remote sensing of atmospheric properties using MODIS data, placing primary emphasis on the principal atmospheric applications of: (1) developing a cloud mask for distinguishing clear sky from clouds, (2) retrieving global cloud radiative and microphysical properties, including cloud top pressure and temperature, effective emissivity, cloud optical thickness, thermodynamic phase, and effective radius, (3) monitoring tropospheric aerosol optical thickness over the land and ocean and aerosol size distribution over the ocean, (4) determining atmospheric profiles of moisture and temperature, and (5) estimating column water amount. The physical principles behind the determination of each of these atmospheric products will be described, together with an example of their application using MODIS observations. All products are archived into two categories: pixel-level retrievals (referred to as Level-2 products) and global gridded products at a latitude and longitude resolution of 1 deg (Level-3 products). An overview of the MODIS atmosphere algorithms and products, status, validation activities, and early level-2 and -3 results will be presented. Finally, I will present some highlights from the land and ocean algorithms developed for processing global MODIS observations, including: (1) surface reflectance, (2) vegetation indices, leaf area index, and FPAR, (3) albedo and nadir BRDF-adjusted reflectance, (4) normalized water-leaving radiance, (5) chlorophyll-a concentration, and (6) sea surface temperature.

King, Michael D.↗

NASA NTRS2011

Assessment of Cloud Screening with Apparent Surface Reflectance in Support of the ICESat-2 Mission

The separation of cloud and clear scenes is usually one of the first steps in satellite data analysis. Before deriving a geophysical product, almost every satellite mission requires a cloud mask to label a scene as either clear or cloudy through a cloud detection procedure. For clear scenes, products such as surface properties may be retrieved; for cloudy scenes, scientist can focus on studying the cloud properties. Hence the quality of cloud detection directly affects the quality of most satellite operational and research products. This is certainly true for the Ice, Cloud, and land Elevation Satellite-2 (lCESat-2), which is the successor to the ICESat-l. As a top priority mission, ICESat-2 will continue to provide measurements of ice sheets and sea ice elevation on a global scale. Studies have shown that clouds can significantly affect the accuracy of the retrieved results. For example, some of the photons (a photon is a basic unit of light) in the laser beam will be scattered by cloud particles on its way. So instead of traveling in a straight line, these photons are scattered sideways and have traveled a longer path. This will result in biases in ice sheet elevation measurements. Hence cloud screening must be done and be done accurately before the retrievals.

Yang, Yuekui↗