Search NASA⌕ Search

SEARCH · Search NASA

Results for “data masking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Cloud-Computing and Machine Learning in Support of Country-Level Land Cover and Ecosystem Extent Mapping in Liberia and Gabon

Liberia and Gabon joined the Gaborone Declaration for Sustainability in Africa (GDSA), established in 2012, with the goal of incorporating the value of nature intonational decision making by estimating the multiple services obtained from ecosystems using the natural capital accounting framework. In this study, we produced 30-m resolution 10 classes land cover maps for the 2015 epoch for Liberia and Gabon using the Google Earth Engine (GEE) cloud platform to support the ongoing natural capital accounting efforts in these nations. We pro-pose an integrated method of pixel-based classification using Landsat 8 data, the Random Forest(RF) classifier and ancillary data to produce high quality land cover products to fit abroad range of applications, including natural capital accounting. Our approach focuses on a pre-classification filtering (Masking Phase) based on spectral signature and ancillary data to reduce the number of pixels prone to be misclassified; therefore, increasing the quality of the final product. The proposed approach yields an overall accuracy of 83% and 81% for Liberia and Gabon, respectively, out performing prior land cover products for these countries in both thematic content and accuracy. Our approach, while relatively simple and highly replicable, was able to produce high quality land cover products to fill an observational gap in up to date land cover data at national scale for Liberia and Gabon.

Celio de Sousa↗

Analysis of LANDSAT-4 TM Data for Lithologic and Image Mapping Purpose

Lithologic mapping techniques using the near infrared bands of the Thematic Mapper onboard the LANDSAT 4 satellite are investigated. These methods are coupled with digital masking to test the capability of mapping geologic materials. Data are examined under medium to low Sun angle illumination conditions to determine the detection limits of materials with absorption features. Several detection anomalies are observed and explained.

Podwysocki, M. H.↗

Masking of photovoltaic system performance problems by inverter clipping and other design and operational practices

We describe how performance problems can be “masked,” or not readily evident by several causes: by photovoltaic (PV) system configuration (such as the size of the PV array capacity relative to the size of the inverter and the resultant clipped operating mode); by instrumentation design, installation, and maintenance (such as a misaligned or dirty pyranometer); by contract clauses (when operational availability is transformed to contractual availability, which excludes many factors); and by identified management and operational practices (such as reporting on a portfolio of plants rather than individually). A simple method based on a duration curve is introduced to overcome shortcomings of Performance Ratio based on nameplate capacity and Performance Index based on hourly simulation when quantifying masking effects, and inverter clipping and pyranometer soiling are presented as two examples of the new method. With a better understanding of the non-transparency of masking issues, stakeholders can better interpret performance data and deliver improved AC and DC plant conditions through PV system operation and maintenance (O&M) for improved performance, reduced O&M costs, and a more consistently delivered, and reduced, levelized cost of energy (LCOE).

14 SOLAR ENERGY↗

Exploring Climate-Disease Connections in Geopolitical Versus Ecological Regions: The Case of West Nile Virus in the United States

Many infectious disease forecasting models in the United States (US) are built with data partitioned into geopolitical regions centered on human activity as opposed to regions defined by natural ecosystems; although useful for data collection and intervention, this has the potential to mask biological relationships between the environment and disease. We explored this concept by analyzing the correlations between climate and West Nile virus (WNV) case data aggregated to geopolitical and ecological regions. We compared correlations between minimum, maximum, and mean annual temperature; precipitation; and annual WNV neuroinvasive disease (WNND) case data from 2005 to 2019 when partitioned into (a) climate regions defined by the National Oceanic and Atmospheric Administration (NOAA) and (b) Level I ecoregions defined by the Environmental Protection Agency (EPA). We found that correlations between climate and WNND in NOAA climate regions and EPA ecoregions were often contradictory in both direction and magnitude, with EPA ecoregions more often supporting previously established biological hypotheses and environmental dynamics underlying vector-borne disease transmission. Using ecological regions to examine the relationships between climate and disease cases can enhance the predictive power of forecasts at various scales, motivating a conceptual shift in large-scale analyses from geopolitical frameworks to more ecologically meaningful regions.

60 APPLIED LIFE SCIENCES↗

TPSAS-NF1676L-19259-DND

In climate and Earth energy budget studies, understanding the presence and distribution of clouds is an essential first step. AVHRR measurements comprise the longest record of imager data from a common instrument for remote sensing of cloud and radiation properties. The NASA LaRC AVHRR cloud mask is a global cloud detection algorithm used as part of the Climate Data Record (CDR) project initiated by NOAA's National Climatic Data Center (NCDC). The objective of CDR program is to provide climate information derived from weather satellite data for more than 30 years. Recent improvements in the LaRC AVHRR cloud mask include detecting more daytime small cumulus and thin Cirrus in tropical oceans, especially over Sun Glint regions, better discrimination between polar clouds and snow ice surfaces including nighttime over Antarctica where 3.7 μm signals are noisy, and enhancement of nighttime ocean thin Cirrus and low clouds detection. Monthly averaged global and zonal cloud fractions from improved NOAA 18 AVHRR cloud mask compare well with CERES-MODIS Edition 4 (CM Ed4), MODIS team, and CALIPSO cloud mask. Spatially and temporally matched cloud detection statistics between NOAA 18 AVHRR and CALIPSO cloud mask will also be presented.

Qing Z Trepte↗

CSAPR2 Optimized Convective Cell Tracking Data during TRACER

One of the challenges in analyzing convective cell properties is to observe the quick evolution of individual convective cells. While the operational radar data provide a volumetric data set to analyze radar observables of convective precipitation clouds, previous studies also suggested the quick evolution of cell life cycle that might not be captured by conventional radar volume scan strategies that take ~5-7 minutes. Aiming at enhancing our understanding of the links between convective cloud kinematic and microphysical processes as well as life cycles, the Tracking Aerosol Convection Interactions ExpeRiment (TRACER; Jensen et al. 2019) was conducted at Houston, Texas, in 2022. The TRACER campaign deployed the 2nd generation C-band Scanning ARM Precipitation Radar (CSAPR2), which performed frequent updates of range height indicator (RHI) and sector plan position indicator (PPI) scans to track individual convective cells every < 2 minutes, guided by a new cell tracking framework, Multisensor Agile Adaptive Sampling (MAAS; Kollias et al. 2020). This allows for capturing fast-evolving radar observables. We provide the processed CSAPR2 cell tracking data in CfRadial format collected during the TRACER field campaign from June to September 2022. The data files include processed radar variables: noise-masked reflectivity and differential reflectivity corrected for rain attenuation and systematic biases, noise-masked dealiased radial velocity, specific differential phase, locations of target cells (latitude, longitude, radar range), and radar-echo classification. Figure 1 provides an example of a 3D image of CSAPR2 reflectivity from the lowest PPI scan and an RHI scan after data processing.

54 ENVIRONMENTAL SCIENCES↗

Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models

Abstract We propose masked particle modeling (MPM) as a self-supervised method for learning generic, transferable, and reusable representations on unordered sets of inputs for use in high energy physics (HEP) scientific data. This work provides a novel scheme to perform masked modeling based pre-training to learn permutation invariant functions on sets. More generally, this work provides a step towards building large foundation models for HEP that can be generically pre-trained with self-supervised learning and later fine-tuned for a variety of down-stream tasks. In MPM, particles in a set are masked and the training objective is to recover their identity, as defined by a discretized token representation of a pre-trained vector quantized variational autoencoder. We study the efficacy of the method in samples of high energy jets at collider physics experiments, including studies on the impact of discretization, permutation invariance, and ordering. We also study the fine-tuning capability of the model, showing that it can be adapted to tasks such as supervised and weakly supervised jet classification, and that the model can transfer efficiently with small fine-tuning data sets to new classes and new data domains.

Heinrich, Lukas (ORCID:0000000240487584)↗

Graphical Planning Of Spacecraft Missions

Mission Planning Graphical Tool (MPGT) computer program provides analysts with graphical representations of spacecraft and environmental data used in planning missions. Designed to be generic software tool configured to analyze any specified Earth-orbiting spacecraft mission. Data presented as series of overlays on top of two-dimensional or three-dimensional projection of Earth. Includes spacecraft-orbit tracks, ground-station-antenna masks, solar and lunar ephemerides, and coverage by Tracking Data and Relay Satellite System (TDRSS). From graphical representations, analyst determines such spacecraft-related constraints as communication coverage, infringement upon zones of interference, availability of sunlight, and visibility of targets to instruments.

Jeletic, J. F.↗

A comparison of three SAR interference filters

Three interference filters are discussed and their ability to remove the interference while leaving target signal data is quantified. The filters are adaptive frequency-domain spike filtering; adaptive frequency-domain interference determination and masking; and interference-target correlation masking. Using Jet Propulsion Laboratory Airborne Synthetic Aperture Radar (JPL AIRSAR) data, the algorithms are applied to three data sets. The resultant compressed Stokes matrix data are compared with the normally processed interference-free image in a quantitative sense. The algorithms are evaluated by measuring the polarization signature, SNR, equivalent number of looks, and impulse response of the processed images.

Chapman, B.↗

Mapping Snow Grain Size over Greenland from MODIS

This paper presents a new automatic algorithm to derive optical snow grain size (SGS) at 1 km resolution using Moderate Resolution Imaging Spectroradiometer (MODIS) measurements. Differently from previous approaches, snow grains are not assumed to be spherical but a fractal approach is used to account for their irregular shape. The retrieval is conceptually based on an analytical asymptotic radiative transfer model which predicts spectral bidirectional snow reflectance as a function of the grain size and ice absorption. The analytical form of solution leads to an explicit and fast retrieval algorithm. The time series analysis of derived SGS shows a good sensitivity to snow metamorphism, including melting and snow precipitation events. Preprocessing is performed by a Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm, which includes gridding MODIS data to 1 km resolution, water vapor retrieval, cloud masking and an atmospheric correction. MAIAC cloud mask (CM) is a new algorithm based on a time series of gridded MODIS measurements and an image-based rather than pixel-based processing. Extensive processing of MODIS TERRA data over Greenland shows a robust performance of CM algorithm in discrimination of clouds over bright snow and ice. As part of the validation analysis, SGS derived from MODIS over selected sites in 2004 was compared to the microwave brightness temperature measurements of SSM\I radiometer, which is sensitive to the amount of liquid water in the snowpack. The comparison showed a good qualitative agreement, with both datasets detecting two main periods of snowmelt. Additionally, MODIS SGS was compared with predictions of the snow model CROCUS driven by measurements of the automatic whether stations of the Greenland Climate Network. We found that CROCUS grain size is on average a factor of two larger than MODIS-derived SGS. Overall, the agreement between CROCUS and MODIS results was satisfactory, in particular before and during the first melting period in mid-June. Following detailed time series analysis of SGS for four permanent sites, the paper presents SGS maps over the Greenland ice sheet for the March-September period of 2004.

Lyapustin, Alexei↗

Validation of the DESI 2024 Lyman alpha forest BAL masking strategy

Broad absorption line quasars (BALs) exhibit blueshifted absorption relative to a number of their prominent broad emission features. These absorption features can contribute to quasar redshift errors and add absorption to the Lyman-α (Lyα) forest that is unrelated to large-scale structure. We present a detailed analysis of the impact of BALs on the Baryon Acoustic Oscillation (BAO) results with the Lyα forest from the first year of data from the Dark Energy Spectroscopic Instrument (DESI). The baseline strategy for the first year analysis is to mask all pixels associated with all BAL absorption features that fall within the wavelength region used to measure the forest. We explore a range of alternate masking strategies and demonstrate that these changes have minimal impact on the BAO measurements with both DESI data and synthetic data. This includes when we mask the BAL features associated with emission lines outside of the forest region to minimize their contribution to redshift errors. We identify differences in the properties of BALs in the synthetic datasets relative to the observational data, as well as use the synthetic observations to characterize the completeness of the BAL identification algorithm, and demonstrate that incompleteness and differences in the BALs between real and synthetic data also do not impact the BAO results for the Lyα forest.

Lyman alpha forest↗

Data Product: Ka ARM Zenith Radar (KAZR), in CfRadial format: precipitation mode, corrected

The KAZRCFRCOR Value Added Product (VAP) performs several corrections to the ingested KAZR data and also creates a significant detection mask for each radar mode. The VAP computes gaseous attenuation as a function of time and radial distance from the radar antenna, based on ambient relative humidity, and corrects observed reflectivities for that effect. KAZR reflectivities are also corrected in the antenna ‘nearfield’ range to compensate for the near-field antenna pattern and gain. KAZRCFRCOR also dealiases mean Doppler velocities, to correct velocities whose magnitudes exceed the radar’s Nyquist velocity. This dataset contains the 'kazrpr' (precipitation) mode output from this VAP.

54 ENVIRONMENTAL SCIENCES↗

Data Product: Ka ARM Zenith Radar (KAZR), in CfRadial format: general mode, corrected

The KAZRCFRCOR Value Added Product (VAP) performs several corrections to the ingested KAZR data and also creates a significant detection mask for each radar mode. The VAP computes gaseous attenuation as a function of time and radial distance from the radar antenna, based on ambient relative humidity, and corrects observed reflectivities for that effect. KAZR reflectivities are also corrected in the antenna ‘nearfield’ range to compensate for the near-field antenna pattern and gain. KAZRCFRCOR also dealiases mean Doppler velocities, to correct velocities whose magnitudes exceed the radar’s Nyquist velocity. This dataset contains the 'kazrge' (general) mode output from this VAP.

54 ENVIRONMENTAL SCIENCES↗

Data Product: Ka ARM Zenith Radar (KAZR), in CfRadial format: moderate sensitivity mode, corrected

The KAZRCFRCOR Value Added Product (VAP) performs several corrections to the ingested KAZR data and also creates a significant detection mask for each radar mode. The VAP computes gaseous attenuation as a function of time and radial distance from the radar antenna, based on ambient relative humidity, and corrects observed reflectivities for that effect. KAZR reflectivities are also corrected in the antenna ‘nearfield’ range to compensate for the near-field antenna pattern and gain. KAZRCFRCOR also dealiases mean Doppler velocities, to correct velocities whose magnitudes exceed the radar’s Nyquist velocity. This dataset contains the 'kazrmd' (moderate sensitivity) mode output from this VAP.

54 ENVIRONMENTAL SCIENCES↗

Particle bed reactor modeling

The topics are presented in viewgraph form and include the following: particle bed reactor (PBR) core cross section; PBR bleed cycle; fuel and moderator flow paths; PBR modeling requirements; characteristics of PBR and nuclear thermal propulsion (NTP) modeling; challenges for PBR and NTP modeling; thermal hydraulic computer codes; capabilities for PBR/reactor application; thermal/hydralic codes; limitations; physical correlations; comparison of predicted friction factor and experimental data; frit pressure drop testing; cold frit mask factor; decay heat flow rate; startup transient simulation; and philosophy of systems modeling.

Sapyta, Joe↗

New Multispectral Cloud Retrievals from MODIS

The Moderate Resolution Imaging Spectroradiometer (MODIS) was developed by NASA and launched onboard the Terra spacecraft on December 18, 1999. It achieved its final orbit and began Earth observations on February 24, 2000. MODIS scans a swath width sufficient to provide nearly complete global coverage every two days from a polar-orbiting, sun-synchronous, platform at an altitude of 705 km, and provides images in 36 spectral bands between 0.415 and 14.235 micrometers with spatial resolutions of 250 m (2 bands), 500 m (5 bands) and 1000 m (29 bands). These bands have been carefully selected to enable advanced studies of land, ocean, and atmospheric processes. In this paper I will describe the various methods being used for the remote sensing of cloud properties using MODIS data, focusing primarily on the MODIS cloud mask used to distinguish clouds, clear sky, heavy aerosol, and shadows on the ground, and on the remote sensing of cloud optical properties, especially cloud optical thickness and effective radius of cloud drops and ice crystals. Results will be presented of MODIS cloud properties both over the land and over the ocean, showing the consistency in cloud retrievals over various ecosystems used in the retrievals. The implications of this new observing system on global analysis of the Earth's environment will be discussed.

Platnick, Steven↗

New Multispectral Cloud Retrievals from MODIS

The Moderate Resolution Imaging Spectroradiometer (MODIS) was developed by NASA and launched onboard the Terra spacecraft on December 18, 1999. It achieved its final orbit and began Earth observations on February 24, 2000. MODIS scans a swath width sufficient to provide nearly complete global coverage every two days from a polar-orbiting, sun- synchronous, platform at an altitude of 705 km, and provides images in 36 spectral bands between 0.415 and 14.235 microns with spatial resolutions of 250 m (two bands), 500 m (five bands) and 1000 m (29 bands). In this paper we will describe the various methods being used for the remote sensing of cloud properties using MODIS data, focusing primarily on the MODIS cloud mask used to distinguish clouds, clear sky, heavy aerosol, and shadows on the ground, and on the remote sensing of cloud optical properties, especially cloud optical thickness and effective radius of water drops and ice crystals. Additional properties of clouds derived from multispectral thermal infrared measurements, especially cloud top pressure and emissivity, will also be described. Results will be presented of MODIS cloud properties both over the land and over the ocean, showing the consistency in cloud retrievals over various ecosystems used in the retrievals. The implications of this new observing system on global analysis of the Earth's environment will be discussed.

King, Michael D.↗

Multispectral Cloud Retrievals from MODIS on Terra and Aqua

The Moderate Resolution Imaging Spectroradiometer (MODIS) was developed by NASA and launched onboard the Terra spacecraft on December 18, 1999 and the Aqua spacecraft on April 26, 2002. MODIS scans a swath width sufficient to provide nearly complete global coverage every two days from each polar-orbiting, sun-synchronous, platform at an altitude of 705 km, and provides images in 36 spectral bands between 0.415 and 14.235 microns with spatial resolutions of 250 m (2 bands), 500 m (5 bands) and 1000 m (29 bands). In this paper we will describe the various methods being used for the remote sensing of cloud properties using MODIS data, focusing primarily on the MODIS cloud mask used to distinguish clouds, clear sky, heavy aerosol, and shadows on the ground, and on the remote sensing of cloud optical properties, especially cloud optical thickness and effective radius of water drops and ice crystals. Additional properties of clouds derived from multispectral thermal infrared measurements, especially cloud top pressure and emissivity, will also be described. Results will be presented of MODIS cloud properties both over the land and over the ocean, showing the consistency in cloud retrievals over various ecosystems used in the retrievals. The implications of this new observing system on global analysis of the Earth's environment will be discussed.

King, Michael D.↗