SEARCH · Search NASA

Results for “Data masking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

NASA NTRS2023

Overview and Statistical Analysis of Boundary Layer Clouds and Precipitation Over the Western North Atlantic Ocean

Due to their fast evolution and large natural variability in macro- and microphysical properties, the accurate representation of boundary layer clouds in current climate models remains a challenge. One of the regions with large intermodel spread in the Coupled Model Intercomparison Project Phase 6 ensemble is the western North Atlantic Ocean. Here, statistically representative in situ measurements can help to develop and constrain the parameterization of clouds in global models. To this end, we performed comprehensive measurements of boundary layer clouds, aerosol, trace gases, and radiation in the western North Atlantic Ocean during the NASA Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE) mission. In total, 174 research flights with 574 flight hours for cloud and precipitation measurements were performed with the HU-25 Falcon during three winter (February–March 2020, January–April 2021, and November 2021–March 2022) and three summer seasons (August–September 2020, May–June 2021, and May–June 2022). Here we present a statistical evaluation of 16 140 individual cloud events probed by the fast cloud droplet probe and the two-dimensional stereo cloud probe during 155 research flights in a representative and repetitive flight strategy allowing for robust statistical data analyses. We show that the vertical profiles of distributions of the liquid water content and the cloud droplet effective diameter (ED) increase with altitude in the marine boundary layer. Due to higher updraft speeds, higher cloud droplet number concentrations (N liquid ) were measured in winter compared to summer despite lower cloud condensation nucleus abundance. Flight cloud cover derived from statistical analysis of in situ data is reduced in summer and shows large variability. This seasonal contrast in cloud coverage is consistent with a dominance of a synoptic pattern in winter that favors conditions for the formation of stratiform clouds at the western edge of cyclones (post-cyclonic). In contrast, a dominant summer anticyclone is concomitant with the occurrence of shallow cumulus clouds and lower cloud coverage. The evaluation of boundary layer clouds and precipitation in the N liquid ED phase space sheds light on liquid, mixed-phase, and ice cloud properties and helps to categorize the cloud data. Ice and liquid precipitation, often masked in cloud statistics by a high abundance of liquid clouds, is often observed throughout the cloud. The ACTIVATE in situ cloud measurements provide a wealth of cloud information useful for assessing airborne and satellite remote-sensing products, for global climate and weather model evaluations, and for dedicated process studies that address precipitation and aerosol–cloud interactions.

Aerosol↗

NASA NTRSDate not supplied

Wildfire Segmentation From Remotely Sensed Data Using Quantum-Compatible Conditional Vector Quantized-Variational Autoencoders

Wildfires represent a critical environmental hazard with multifaceted implications for ecosystems, communities, and public health [1]. The escalating frequency and intensity of wildfires globally have intensified the urgency for robust segmentation methodologies to facilitate effective mitigation, response, and recovery strategies [2]. Accurate wildfire segmentation is pivotal for delineating fire boundaries, assessing progression patterns, and prioritizing resource allocation during emergency scenarios. Furthermore, precise segmentation enables stakeholders, including policymakers, environmental scientists, and emergency responders, to formulate evidence-based strategies, thereby minimizing socio-economic disruptions and ecological degradation. Consequently, advancing wildfire segmentation techniques through innovative technological interventions remains a paramount research imperative. Although foundational in wildfire segmentation, traditional deterministic models exhibit inherent limitations that compromise their efficacy in dynamic and uncertain environments. These models often operate on rigid algorithms prioritizing deterministic classifications, thereby overlooking the inherent complexities and uncertainties associated with wildfire behavior and satellite data variability. Such deterministic frameworks tend to produce oversimplified representations that fail to capture the intricate nuances of evolving fire dynamics, spatial heterogeneity, and environmental interactions [1]. Consequently, the deterministic approach’s propensity for uncertainty collapsing [1, 3] hampers the accuracy, reliability, and applicability of segmentation outcomes in real-world scenarios. Contrastingly, stochastic models offer a more nuanced and adaptable framework for wildfire segmentation. By integrating probabilistic elements into the modeling paradigm, stochastic approaches, particularly probabilistic approaches such as variational auto encoders (VAEs) [4], facilitate comprehensive uncertainty assessment, enabling researchers to quantify and incorporate uncertainties into segmentation outcomes effectively. This probabilistic nature empowers stochastic models to encapsulate variability, account for data inconsistencies, and adapt to evolving environmental conditions, enhancing segmentation accuracy, reliability, and robustness. Embracing stochastic methodologies thus catalyzes advancements in wildfire science by fostering a more holistic, adaptive, and resilient segmentation framework. Despite VAEs demonstrating significant promise in various applications, they come with inherent limitations that have garnered attention within the machine learning community. One of the primary drawbacks lies in their reliance on static priors, which essentially assume a fixed distribution for latent variables, thereby limiting the model’s flexibility to capture complex data structures effectively [5]. This static nature leads to suboptimal representations, especially when dealing with complex and high-dimensional data. Additionally, VAEs often struggle with generating sharp and realistic samples, a phenomenon commonly referred to as mode collapse [5, 7, 6]. Furthermore, the optimization process in VAEs, which involves balancing the reconstruction loss and the regularization term, can sometimes be challenging to fine-tune [7]. In recent efforts to address these shortcomings, alternative approaches like Vector Quantized Variational Auto encoders(VQ-VAEs) [7], address the challenges by incorporating discrete latent variables and leveraging techniques that enhance the quality and diversity of generated samples while maintaining efficient training dynamics. VQ-VAEs propose a dynamic prior distribution generation mechanism that diverges from the static priors commonly associated with traditional VAEs. This dynamic approach allows for more adaptive and context-aware latent variable representations, thereby potentially capturing complex data structures more effectively. Unlike autoregressive prior models such as PixelCNN, which, despite their ability to model dependencies across data dimensions, suffer from significant computational inefficiencies and lack flexibility in handling diverse datasets. In our work, we propose to use a generative quantum-compatible approach to help alleviate the shortcomings of autoregressive prior model in VQ-VAEs. Restricted Boltzmann Machines (RBMs) are a viable alternative prior model that can learn prior distributions in a faster and more flexible manner. In this research endeavor, we meticulously curate a state-of-the-art dataset leveraging satellite MODIS data in conjunction with VIIRS fire masks, derived from Fire Radiative Power (FRP), thereby encapsulating diverse wildfire scenarios and environmental contexts. We developed a conditional VQ-VAE architecture with the RBM prior model that is trained in a supervised manner for segmenting wildfire masks. This innovative approach synergistically harnesses deep learning capabilities, enabling the generation of segmentation maps characterized by heightened precision, granularity, and contextual relevance. Furthermore, replacing the autoregressive prior learning method proposed by the original VQ-VAE with a prior density approximation via quantum-compatible RBM facilitates expedited inference processes, augments flexibility in prior sampling, optimizes computational efficiency and establishes a groundbreaking benchmark in wildfire segmentation methodologies.

quantum machine learning↗

DOE OSTI2022

Masked fault detection for reliable low voltage cache operation

Systems, apparatuses, and methods for implementing masked fault detection for reliable low voltage cache operation are disclosed. A processor includes a cache that can operate at a relatively low voltage level to conserve power. However, at low voltage levels, the cache is more likely to suffer from bit errors. To mitigate the bit errors occurring in cache lines at low voltage levels, the cache employs a strategy to uncover masked faults during runtime accesses to data by actual software applications. For example, on the first read of a given cache line, the data of the given cache line is inverted and written back to the same data array entry. Also, the error correction bits are regenerated for the inverted data. On a second read of the given cache line, if the fault population of the given cache line changes, then the given cache line's error protection level is updated.

Ganapathy, Shrikanth↗

DOE OSTI2025

A Representation Fusion Framework for Decoupling Diagnostic Information in Multimodal Learning

Modern medicine increasingly relies on multimodal data, ranging from clinical notes to imaging and genomics, to guide diagnosis and treatment. However, integrating these heterogeneous data sources in a principled and interpretable manner remains a major challenge. We present MODES (Multi-mOdal Disentangled Embedding Space), a representation fusion framework that explicitly separates shared and modality-specific factors of variation, offering a structured latent space for multimodal information that improves both prediction and interpretability. By leveraging pre-trained unimodal foundation models, MODES mitigates the dependency on extensive paired datasets, crucial in data-scarce clinical settings. We introduce a masking strategy that optimizes representation dimensionality by eliminating low-information dimensions, to achieve compact, information-rich representations. Our framework demonstrates superior performance in predicting diagnoses and phenotypes compared to unimodal and conventional fusion models. MODES also enables robust diagnostic inference in missing data scenarios, offering an opportunity toward interpretable and efficient multimodal diagnostics in personalized healthcare.

60 APPLIED LIFE SCIENCES↗

NASA NTRS1977

Atmospheric model development in support of SEASAT. Volume 4: Forecast model sensitivity study

Atmospheric analysis and prediction models of varying (grid) resolution were developed. The models were tested using real observational data for the purpose of assessing the impact of grid resolution on short range numerical weather prediction. The work statement was amended to include the performance of sensitivity tests using a coarse mesh (63 x 63 x 5 level) prediction model in order to identify and order factors which might mask or impair the utility of SEASAT data on short range weather prediction. Such factors included: initial conditions; topography; surface friction; latent heating; diffusion of momentum and temperature; and computational devices such as tendency truncators, pressure smoothers, and temporal filters.

Lewit, H. L.↗

NASA NTRS2020

Cloud-Computing and Machine Learning in Support of Country-Level Land Cover and Ecosystem Extent Mapping in Liberia and Gabon

Liberia and Gabon joined the Gaborone Declaration for Sustainability in Africa (GDSA), established in 2012, with the goal of incorporating the value of nature intonational decision making by estimating the multiple services obtained from ecosystems using the natural capital accounting framework. In this study, we produced 30-m resolution 10 classes land cover maps for the 2015 epoch for Liberia and Gabon using the Google Earth Engine (GEE) cloud platform to support the ongoing natural capital accounting efforts in these nations. We pro-pose an integrated method of pixel-based classification using Landsat 8 data, the Random Forest(RF) classifier and ancillary data to produce high quality land cover products to fit abroad range of applications, including natural capital accounting. Our approach focuses on a pre-classification filtering (Masking Phase) based on spectral signature and ancillary data to reduce the number of pixels prone to be misclassified; therefore, increasing the quality of the final product. The proposed approach yields an overall accuracy of 83% and 81% for Liberia and Gabon, respectively, out performing prior land cover products for these countries in both thematic content and accuracy. Our approach, while relatively simple and highly replicable, was able to produce high quality land cover products to fill an observational gap in up to date land cover data at national scale for Liberia and Gabon.

Celio de Sousa↗

NASA NTRS1984

Analysis of LANDSAT-4 TM Data for Lithologic and Image Mapping Purpose

Lithologic mapping techniques using the near infrared bands of the Thematic Mapper onboard the LANDSAT 4 satellite are investigated. These methods are coupled with digital masking to test the capability of mapping geologic materials. Data are examined under medium to low Sun angle illumination conditions to determine the detection limits of materials with absorption features. Several detection anomalies are observed and explained.

Podwysocki, M. H.↗

DOE OSTI2021

Masking of photovoltaic system performance problems by inverter clipping and other design and operational practices

We describe how performance problems can be “masked,” or not readily evident by several causes: by photovoltaic (PV) system configuration (such as the size of the PV array capacity relative to the size of the inverter and the resultant clipped operating mode); by instrumentation design, installation, and maintenance (such as a misaligned or dirty pyranometer); by contract clauses (when operational availability is transformed to contractual availability, which excludes many factors); and by identified management and operational practices (such as reporting on a portfolio of plants rather than individually). A simple method based on a duration curve is introduced to overcome shortcomings of Performance Ratio based on nameplate capacity and Performance Index based on hourly simulation when quantifying masking effects, and inverter clipping and pyranometer soiling are presented as two examples of the new method. With a better understanding of the non-transparency of masking issues, stakeholders can better interpret performance data and deliver improved AC and DC plant conditions through PV system operation and maintenance (O&M) for improved performance, reduced O&M costs, and a more consistently delivered, and reduced, levelized cost of energy (LCOE).

14 SOLAR ENERGY↗

DOE OSTI2024

Exploring Climate-Disease Connections in Geopolitical Versus Ecological Regions: The Case of West Nile Virus in the United States

Many infectious disease forecasting models in the United States (US) are built with data partitioned into geopolitical regions centered on human activity as opposed to regions defined by natural ecosystems; although useful for data collection and intervention, this has the potential to mask biological relationships between the environment and disease. We explored this concept by analyzing the correlations between climate and West Nile virus (WNV) case data aggregated to geopolitical and ecological regions. We compared correlations between minimum, maximum, and mean annual temperature; precipitation; and annual WNV neuroinvasive disease (WNND) case data from 2005 to 2019 when partitioned into (a) climate regions defined by the National Oceanic and Atmospheric Administration (NOAA) and (b) Level I ecoregions defined by the Environmental Protection Agency (EPA). We found that correlations between climate and WNND in NOAA climate regions and EPA ecoregions were often contradictory in both direction and magnitude, with EPA ecoregions more often supporting previously established biological hypotheses and environmental dynamics underlying vector-borne disease transmission. Using ecological regions to examine the relationships between climate and disease cases can enhance the predictive power of forecasts at various scales, motivating a conceptual shift in large-scale analyses from geopolitical frameworks to more ecologically meaningful regions.

60 APPLIED LIFE SCIENCES↗

NASA NTRS2014

TPSAS-NF1676L-19259-DND

In climate and Earth energy budget studies, understanding the presence and distribution of clouds is an essential first step. AVHRR measurements comprise the longest record of imager data from a common instrument for remote sensing of cloud and radiation properties. The NASA LaRC AVHRR cloud mask is a global cloud detection algorithm used as part of the Climate Data Record (CDR) project initiated by NOAA's National Climatic Data Center (NCDC). The objective of CDR program is to provide climate information derived from weather satellite data for more than 30 years. Recent improvements in the LaRC AVHRR cloud mask include detecting more daytime small cumulus and thin Cirrus in tropical oceans, especially over Sun Glint regions, better discrimination between polar clouds and snow ice surfaces including nighttime over Antarctica where 3.7 μm signals are noisy, and enhancement of nighttime ocean thin Cirrus and low clouds detection. Monthly averaged global and zonal cloud fractions from improved NOAA 18 AVHRR cloud mask compare well with CERES-MODIS Edition 4 (CM Ed4), MODIS team, and CALIPSO cloud mask. Spatially and temporally matched cloud detection statistics between NOAA 18 AVHRR and CALIPSO cloud mask will also be presented.

Qing Z Trepte↗

DOE OSTI2023

CSAPR2 Optimized Convective Cell Tracking Data during TRACER

One of the challenges in analyzing convective cell properties is to observe the quick evolution of individual convective cells. While the operational radar data provide a volumetric data set to analyze radar observables of convective precipitation clouds, previous studies also suggested the quick evolution of cell life cycle that might not be captured by conventional radar volume scan strategies that take ~5-7 minutes. Aiming at enhancing our understanding of the links between convective cloud kinematic and microphysical processes as well as life cycles, the Tracking Aerosol Convection Interactions ExpeRiment (TRACER; Jensen et al. 2019) was conducted at Houston, Texas, in 2022. The TRACER campaign deployed the 2nd generation C-band Scanning ARM Precipitation Radar (CSAPR2), which performed frequent updates of range height indicator (RHI) and sector plan position indicator (PPI) scans to track individual convective cells every < 2 minutes, guided by a new cell tracking framework, Multisensor Agile Adaptive Sampling (MAAS; Kollias et al. 2020). This allows for capturing fast-evolving radar observables. We provide the processed CSAPR2 cell tracking data in CfRadial format collected during the TRACER field campaign from June to September 2022. The data files include processed radar variables: noise-masked reflectivity and differential reflectivity corrected for rain attenuation and systematic biases, noise-masked dealiased radial velocity, specific differential phase, locations of target cells (latitude, longitude, radar range), and radar-echo classification. Figure 1 provides an example of a 3D image of CSAPR2 reflectivity from the lowest PPI scan and an RHI scan after data processing.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models

Abstract We propose masked particle modeling (MPM) as a self-supervised method for learning generic, transferable, and reusable representations on unordered sets of inputs for use in high energy physics (HEP) scientific data. This work provides a novel scheme to perform masked modeling based pre-training to learn permutation invariant functions on sets. More generally, this work provides a step towards building large foundation models for HEP that can be generically pre-trained with self-supervised learning and later fine-tuned for a variety of down-stream tasks. In MPM, particles in a set are masked and the training objective is to recover their identity, as defined by a discretized token representation of a pre-trained vector quantized variational autoencoder. We study the efficacy of the method in samples of high energy jets at collider physics experiments, including studies on the impact of discretization, permutation invariance, and ordering. We also study the fine-tuning capability of the model, showing that it can be adapted to tasks such as supervised and weakly supervised jet classification, and that the model can transfer efficiently with small fine-tuning data sets to new classes and new data domains.

Heinrich, Lukas (ORCID:0000000240487584)↗

NASA NTRS1991

Graphical Planning Of Spacecraft Missions

Mission Planning Graphical Tool (MPGT) computer program provides analysts with graphical representations of spacecraft and environmental data used in planning missions. Designed to be generic software tool configured to analyze any specified Earth-orbiting spacecraft mission. Data presented as series of overlays on top of two-dimensional or three-dimensional projection of Earth. Includes spacecraft-orbit tracks, ground-station-antenna masks, solar and lunar ephemerides, and coverage by Tracking Data and Relay Satellite System (TDRSS). From graphical representations, analyst determines such spacecraft-related constraints as communication coverage, infringement upon zones of interference, availability of sunlight, and visibility of targets to instruments.

Jeletic, J. F.↗

NASA NTRS1992

A comparison of three SAR interference filters

Three interference filters are discussed and their ability to remove the interference while leaving target signal data is quantified. The filters are adaptive frequency-domain spike filtering; adaptive frequency-domain interference determination and masking; and interference-target correlation masking. Using Jet Propulsion Laboratory Airborne Synthetic Aperture Radar (JPL AIRSAR) data, the algorithms are applied to three data sets. The resultant compressed Stokes matrix data are compared with the normally processed interference-free image in a quantitative sense. The algorithms are evaluated by measuring the polarization signature, SNR, equivalent number of looks, and impulse response of the processed images.

Chapman, B.↗

NASA NTRS2008

Mapping Snow Grain Size over Greenland from MODIS

This paper presents a new automatic algorithm to derive optical snow grain size (SGS) at 1 km resolution using Moderate Resolution Imaging Spectroradiometer (MODIS) measurements. Differently from previous approaches, snow grains are not assumed to be spherical but a fractal approach is used to account for their irregular shape. The retrieval is conceptually based on an analytical asymptotic radiative transfer model which predicts spectral bidirectional snow reflectance as a function of the grain size and ice absorption. The analytical form of solution leads to an explicit and fast retrieval algorithm. The time series analysis of derived SGS shows a good sensitivity to snow metamorphism, including melting and snow precipitation events. Preprocessing is performed by a Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm, which includes gridding MODIS data to 1 km resolution, water vapor retrieval, cloud masking and an atmospheric correction. MAIAC cloud mask (CM) is a new algorithm based on a time series of gridded MODIS measurements and an image-based rather than pixel-based processing. Extensive processing of MODIS TERRA data over Greenland shows a robust performance of CM algorithm in discrimination of clouds over bright snow and ice. As part of the validation analysis, SGS derived from MODIS over selected sites in 2004 was compared to the microwave brightness temperature measurements of SSM\I radiometer, which is sensitive to the amount of liquid water in the snowpack. The comparison showed a good qualitative agreement, with both datasets detecting two main periods of snowmelt. Additionally, MODIS SGS was compared with predictions of the snow model CROCUS driven by measurements of the automatic whether stations of the Greenland Climate Network. We found that CROCUS grain size is on average a factor of two larger than MODIS-derived SGS. Overall, the agreement between CROCUS and MODIS results was satisfactory, in particular before and during the first melting period in mid-June. Following detailed time series analysis of SGS for four permanent sites, the paper presents SGS maps over the Greenland ice sheet for the March-September period of 2004.

Lyapustin, Alexei↗

DOE OSTI2025

Validation of the DESI 2024 Lyman alpha forest BAL masking strategy

Broad absorption line quasars (BALs) exhibit blueshifted absorption relative to a number of their prominent broad emission features. These absorption features can contribute to quasar redshift errors and add absorption to the Lyman-α (Lyα) forest that is unrelated to large-scale structure. We present a detailed analysis of the impact of BALs on the Baryon Acoustic Oscillation (BAO) results with the Lyα forest from the first year of data from the Dark Energy Spectroscopic Instrument (DESI). The baseline strategy for the first year analysis is to mask all pixels associated with all BAL absorption features that fall within the wavelength region used to measure the forest. We explore a range of alternate masking strategies and demonstrate that these changes have minimal impact on the BAO measurements with both DESI data and synthetic data. This includes when we mask the BAL features associated with emission lines outside of the forest region to minimize their contribution to redshift errors. We identify differences in the properties of BALs in the synthetic datasets relative to the observational data, as well as use the synthetic observations to characterize the completeness of the BAL identification algorithm, and demonstrate that incompleteness and differences in the BALs between real and synthetic data also do not impact the BAO results for the Lyα forest.

Lyman alpha forest↗

DOE OSTI2021

Data Product: Ka ARM Zenith Radar (KAZR), in CfRadial format: precipitation mode, corrected

The KAZRCFRCOR Value Added Product (VAP) performs several corrections to the ingested KAZR data and also creates a significant detection mask for each radar mode. The VAP computes gaseous attenuation as a function of time and radial distance from the radar antenna, based on ambient relative humidity, and corrects observed reflectivities for that effect. KAZR reflectivities are also corrected in the antenna ‘nearfield’ range to compensate for the near-field antenna pattern and gain. KAZRCFRCOR also dealiases mean Doppler velocities, to correct velocities whose magnitudes exceed the radar’s Nyquist velocity. This dataset contains the 'kazrpr' (precipitation) mode output from this VAP.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Data Product: Ka ARM Zenith Radar (KAZR), in CfRadial format: general mode, corrected

54 ENVIRONMENTAL SCIENCES↗