Search NASA⌕ Search

SEARCH · Search NASA

Results for “data masking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Particle trajectory representation learning with masked point modeling

Liquid argon time projection chambers (LArTPCs) offer millimeter-scale 3D images of particle trajectories, enabling precision studies of neutrino oscillation, detection of supernova and solar neutrinos, searches for exotic dark matter, and proton decay. Current approaches utilize supervised machine learning models, requiring extensive simulations of particle physics and detector response that can introduce bias. Self-supervised learning (SSL), a machine learning approach that learns useful representations of unlabeled data from the data itself, has significantly advanced how large datasets are utilized for representation learning; however, its potential for applications to sensory data in high precision particle physics experiments remains largely unexplored. We introduce the Point-based liquid argon masked autoencoder (PoLAr-MAE), a self-supervised framework that learns physically meaningful representations directly from unlabeled LArTPC images. PoLAr-MAE achieves remarkable data efficiency for a point-level segmentation task, outperforming fully supervised methods in low data regimes. Linear classifiers on model outputs demonstrate robust performance across multiple downstream tasks. Our results position sensor-level SSL as a practical foundation model strategy for LArTPCs.

Young, Samuel [Stanford Univ., CA (United States)]↗

Implementing Connected Component Labeling as a User Defined Operator for SciDB

We have implemented a flexible User Defined Operator (UDO) for labeling connected components of a binary mask expressed as an array in SciDB, a parallel distributed database management system based on the array data model. This UDO is able to process very large multidimensional arrays by exploiting SciDB's memory management mechanism that efficiently manipulates arrays whose memory requirements far exceed available physical memory. The UDO takes as primary inputs a binary mask array and a binary stencil array that specifies the connectivity of a given cell to its neighbors. The UDO returns an array of the same shape as the input mask array with each foreground cell containing the label of the component it belongs to. By default, dimensions are treated as non-periodic, but the UDO also accepts optional input parameters to specify periodicity in any of the array dimensions. The UDO requires four stages to completely label connected components. In the first stage, labels are computed for each subarray or chunk of the mask array in parallel across SciDB instances using the weighted quick union (WQU) with half-path compression algorithm. In the second stage, labels around chunk boundaries from the first stage are stored in a temporary SciDB array that is then replicated across all SciDB instances. Equivalences are resolved by again applying the WQU algorithm to these boundary labels. In the third stage, relabeling is done for each chunk using the resolved equivalences. In the fourth stage, the resolved labels, which so far are "flattened" coordinates of the original binary mask array, are renamed with sequential integers for legibility. The UDO is demonstrated on a 3-D mask of O(1011) elements, with O(108) foreground cells and O(106) connected components. The operator completes in 19 minutes using 84 SciDB instances.

UDO↗

A global gridded dataset for cloud vertical structure from combined CloudSat and CALIPSO observations

Abstract. The vertical structure of clouds has a profound effect on the global energy budget, the global circulation, and the atmospheric hydrological cycle. The CloudSat and Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) missions have taken complementary, colocated observations of cloud vertical structure for over a decade. However, no globally gridded dataset is available to the public for the full length of this unique combined data record. Here we present the 3S-GEOPROF-COMB product (Bertrand et al. 2023, https://doi.org/10.5281/zenodo.8057791), a globally gridded (level 3S) community data product summarizing geometrical profiles (GEOPROF) of hydrometeor occurrence from combined (COMB) CloudSat and CALIPSO data. Our product is calculated from the latest release (R05) of per-orbit (level-2) combined cloud mask profiles. We process a set of cloud cover, vertical cloud fraction, and sampling variables at 2.5, 5, and 10° spatial resolutions and monthly and seasonal temporal resolutions. We address the 2011 reduction in CloudSat data collection with Daylight-Only Operations (DO-Op) mode by subsampling pre-2011 data to mimic DO-Op collection patterns, thereby allowing users to evaluate the impact of the reduced sampling on their analyses. We evaluate our data product against CloudSat-only and CALIPSO-only global-gridded data products as well as four comparable surface-based sites, underscoring the added value of the combined product. Interest in the product is anticipated for the study of cloud processes, cloud–climate interactions, and as a candidate baseline climate data record for comparison to follow-up satellite missions, among other uses.

Bertrand, Leah (ORCID:0009000001607558)↗

BeyondPlanck: VII. Bayesian estimation of gain and absolute calibration for cosmic microwave background experiments

We present a Bayesian calibration algorithm for cosmic microwave background (CMB) observations as implemented within the global end-to-end BEYONDPLANCK framework and applied to the Planck Low Frequency Instrument (LFI) data. Following the most recent Planck analysis, we decomposed the full time-dependent gain into a sum of three nearly orthogonal components: one absolute calibration term, common to all detectors, one time-independent term that can vary between detectors, and one time-dependent component that was allowed to vary between one-hour pointing periods. Each term was then sampled conditionally on all other parameters in the global signal model through Gibbs sampling. The absolute calibration is sampled using only the orbital dipole as a reference source, while the two relative gain components were sampled using the full sky signal, including the orbital and Solar CMB dipoles, CMB fluctuations, and foreground contributions. We discuss various aspects of the data that influence gain estimation, including the dipole-polarization quadrupole degeneracy and processing masks. Comparing our solution to previous pipelines, we find good agreement in general, with relative deviations of -0.67% (-0.84%) for 30 GHz, 0.12% (-0.04%) for 44 GHz and -0.03% (-0.64%) for 70 GHz, compared to Planck PR4 and Planck 2018, respectively. We note that the BEYONDPLANCK calibration was performed globally, which results in better inter-frequency consistency than previous estimates. Additionally, WMAP observations were used actively in the BEYONDPLANCK analysis, which both breaks internal degeneracies in the Planck data set and results in an overall better agreement with WMAP. Finally, we used a Wiener filtering approach to smoothing the gain estimates. We show that this method avoids artifacts in the correlated noise maps as a result of oversmoothing the gain solution, which is difficult to avoid with methods like boxcar smoothing, as Wiener filtering by construction maintains a balance between data fidelity and prior knowledge. Although our presentation and algorithm are currently oriented toward LFI processing, the general procedure is fully generalizable to other experiments, as long as the Solar dipole signal is available to be used for calibration.

79 ASTRONOMY AND ASTROPHYSICS↗

Generating Land Surface Reflectance for the New Generation of Geostationary Satellite Sensors with the MAIAC Algorithm

The latest generation of geostationary satellite sensors, including the GOES-16/ABI and the Himawari 8/AHI, provide exciting capability to monitor land surface at very high temporal resolutions (5-15 minute intervals) and with spatial and spectral characteristics that mimic the Earth Observing System flagship MODIS. However, geostationary data feature changing sun angles at constant view geometry, which is almost reciprocal to sun-synchronous observations. Such a challenge needs to be carefully addressed before one can exploit the full potential of the new sources of data. Here we take on this challenge with Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm, recently developed for accurate and globally robust applications like the MODIS Collection 6 re-processing. MAIAC first grids the top-of- atmosphere measurements to a fixed grid so that the spectral and physical signatures of each grid cell are stacked (“remembered”) over time and used to dramatically improve cloud/shadow/snow detection, which is by far the dominant error source in the remote sensing. It also exploits the changing sun-view geometry of the geostationary sensor to characterize surface BRDF with augmented angular resolution for accurate aerosol retrievals and atmospheric correction. The high temporal resolutions of the geostationary data indeed make the BRDF retrieval much simpler and more robust as compared with sun-synchronous sensors such as MODIS. As a prototype test for the geostationary-data processing pipeline on NASA Earth Exchange (GEONEX), we apply MAIAC to process 18 months of data from Himawari 8/AHI over Australia. We generate a suite of test results, including the input TOA reflectance and the output cloud mask, aerosol optical depth (AOD), and the atmospherically-corrected surface reflectance for a variety of geographic locations, terrain, and land cover types. Comparison with MODIS data indicates a general agreement between the retrieved surface reflectance products. Furthermore, the geostationary results satisfactorily capture the movement of clouds and variations in atmospheric dust/aerosol concentrations, suggesting that high quality land surface and vegetation datasets from the advanced geostationary sensors can help complement and improve the corresponding EOS products.

geostationary satellite sensors↗

Aspen ploidy level and cover maps from NEON Airborne Observation Platform, 2018, Crested Butte, Colorado

Maps of aspen ploidy (diploid or triploid) developed using National Ecological Observatory Network (NEON) Airborne Observation Platform visible to shortwave infrared imaging spectroscopy data that were acquired over the Upper East River, Colorado in 2018. Maps of aspen distribution, as well as other land cover types that were used to screen for aspen dominated pixels are also provided. Each image file is provided as a GeoTiff with internal tiling and LZW compression. For use of ploidy maps, it is necessary to mask out non-aspen and shaded pixels. Shaded pixels are provided in an associated data package. For full details, please see associated publication and methods description. This dataset is associated with the publication in Ecological Applications.

54 ENVIRONMENTAL SCIENCES↗

Ka-Band ARM Zenith Radar Corrections (KAZRCOR, KAZRCFRCOR) Value-Added Products

The Ka-Band Atmospheric Radiation Measurement (ARM) Zenith Radar Corrections (KAZRCOR) and KA-Band ARM Zenith Radar CF-Radial, Corrected (KAZRCFRCOR) value-added products (VAPs) perform several corrections to the ingested KAZR moments and also create a significant detection mask for each radar mode. The VAPs compute gaseous attenuation as a function of time and radial distance from the radar antenna, based on ambient meteorological observations, and correct observed reflectivities for that effect. Mean Doppler velocities are dealiased to correct velocities whose magnitudes exceed the radar’s Nyquist velocity. Input KAZR data fields are passed through to the KAZRCOR or KAZRCFRCOR output files, in their native time and range coordinates. Complementary corrected reflectivity and velocity fields are provided, along with a mask of significant detections and a number of data quality flags. This report covers the KAZRCOR VAP as applied to the original KAZR radars and the upgraded KAZR2 radars. Originally, prior to late 2019, there were two separate code bases for the different radar versions. Following the harmonization of KAZR and KAZR2 data formats in 2019, only a single code base is required. The new combined KAZR and KAZR2 code base is called the KAZRCFRCOR VAP. The ‘cfr portion of the VAP name refers to the Radial Climate and Forecasting data format standards that are used in these data sets. Throughout this report, references to ‘KAZRCOR’ should be taken to apply to the ‘KAZRCFRCOR’ VAP as well unless there is an explicit statement to the contrary.

54 ENVIRONMENTAL SCIENCES↗

Deep-learning-based workflow for boundary and small target segmentation in digital rock images using UNet++ and IK-EBM

We report three-dimensional (3D) X-ray micro-computed tomography (μCT) has been widely used in petroleum engineering because it can provide detailed pore structural information for a reservoir rock, which can be imported into a pore-scale numerical model to simulate the transport and distribution of multiple fluids in the pore space. The partial volume blurring (PVB) problem is a major challenge in segmenting raw μCT images of rock samples, which impacts boundaries and small targets near the resolution limit. We developed a deep-learning (DL)-based workflow for accurate and fast partial volume segmentation. The DL model's performance depends primarily on the training data quality and model architecture. This study employed the entropy-based-masking indicator kriging (IK-EBM) to segment 3D Berea sandstone images as training datasets. The comparison between IK-EBM and manual segmentation using a 3D synthetic sphere pack, which had a known ground truth, showed that IK-EBM had higher accuracy on partial volume segmentation. We then trained and tested the UNet++ model, a state-of-the-art supervised encoder-decoder model, for binary (i.e., void and solid) and four-class segmentation. We compared the UNet++ with the commonly used U-Net and wide U-Net models and showed that the UNet++ had the best performance in terms of pixel-wise and physics-based evaluation metrics. Specifically, boundary-scaled accuracy demonstrated that the UNet++ architecture outperformed the regular U-Net architecture in the segmentation of pixels near boundaries and small targets, which were subjected to the PVB effect. Feature map visualization illustrated that the UNet++ bridged the semantic gaps between the feature maps extracted at different depths of the network, thereby enabling faster convergence and more accurate extraction of fine-scale features. The developed workflow significantly enhances the performance of supervised encoder-decoder models in partial volume segmentation, which has extensive applications in fundamental studies of subsurface energy, water, and environmental systems.

02 PETROLEUM↗

Observation of a single protein by ultrafast X-ray diffraction

* runs/ - The raw data from the pnCCD * histograms.h5 - Histogram of the values recorded by each pixel throughout the data acquisition. Used for pedestal and gain correction. * mask.h5 - Detector bad pixels mask. * 1SS8.pdb - PDB model of the assembled GroEL 14-mer, from the 1SS8 PDB entry. * 1SS8_H2O.pdb - Hydrated version of the assembled GroEL 14-mer, derived from the 1SS8 PDB entry. The various hydrated models are created by removing water from this initial model. * rotations.h5 - Quaternions of the rotations used for template matching

European XFEL↗

The Atacama Cosmology Telescope: DR6 Sunyaev-Zel'dovich Selected Galaxy Clusters Catalog

We present the results of a search for galaxy clusters in the Atacama Cosmology Telescope (ACT) Data Release 6 (DR6) microwave sky maps covering 16293 square degrees in three frequency bands, using data obtained over the lifetime of the project (2008-2022). We report redshifts and mass estimates for 10040 clusters detected via their Sunyaev-Zel'dovich (SZ) effect with signal-to-noise greater than 4 at a 2.4 arcminute filter scale. The catalog includes 1180 clusters at redshifts greater than 1, and 124 clusters at redshifts greater than 1.5. Using a relation between cluster SZ signal and mass that is consistent with recent weak-lensing measurements, we estimate that clusters detected with signal-to-noise greater than 5 form a sample which is 90% complete for clusters with masses greater than $5 \times 10^{14}$ MSun (measured within a spherical volume with mean density 500 times the critical density). El Gordo, a cluster found in an initial ACT survey of 755 square degrees, remains the most extreme cluster in mass and redshift; we find no cluster with a mass and redshift combination high enough to falsify the standard LCDM cosmology with Gaussian initial perturbations. We make public a variety of data products, including the full cluster candidate list, noise maps, and sky masks, along with our software for cluster detection and instructions for reproducing our cluster catalogs from the public ACT maps.

Aguena, M. [Trieste Observ.; LIneA, Rio de Janeiro↗

Octofitter: Fast, Flexible, and Accurate Orbit Modeling to Detect Exoplanets

As next-generation imaging instruments and interferometers search for planets closer to their stars, they must contend with increasing orbital motion and longer integration times. These compounding effects make it difficult to detect faint planets but also present an opportunity. Increased orbital motion makes it possible to move the search for planets into the orbital domain, where direct images can be freely combined with the radial velocity and proper motion anomaly, even without a confirmed detection in any single epoch. In this paper, we present a fast and differentiable multimethod orbit-modeling and planet detection code called Octofitter. This code is designed to be highly modular and allows users to easily adjust priors, change parameterizations, and specify arbitrary function relations between the parameters of one or more planets. Octofitter further supplies tools for examining model outputs including prior and posterior predictive checks and simulation-based calibration. We demonstrate the capabilities of Octofitter on real and simulated data from different instruments and methods, including HD 91312, simulated JWST/NIRISS aperture masking interferometry observations, radial velocity curves, and grids of images from the Gemini Planet Imager. We show that Octofitter can reliably recover faint planets in long sequences of images with arbitrary orbital motion. This publicly available tool will enable the broad application of multiepoch and multimethod exoplanet detection, which could improve how future targeted ground- and space-based surveys are performed. Finally, its rapid convergence makes it a useful addition to the existing ecosystem of tools for modeling the orbits of directly imaged planets.

79 ASTRONOMY AND ASTROPHYSICS↗

Diagnostic capability added to digital events evaluator

Digital events evaluator reviews events preceding system malfunction and automatically prints out most probable cause of problem. Analysis is performed by comparing input data with nominal values stored in tables. Each table has associated system mask to restrict comparison to preselected critical parameters within a given system.

Frasketi, A. S.↗

Snowcover influence on backscattering from terrain

The effects of snowcover on the microwave backscattering from terrain in the 8-35 GHz region are examined through the analysis of experimental data and by application of a semiempirical model. The model accounts for surface backscattering contributions by the snow-air and snow-soil interfaces, and for volume backscattering contributions by the snow layer. Through comparisons of backscattering data for different terrain surfaces measured both with and without snowcover, the masking effects of snow are evaluated as a function of snow water equivalent and liquid water content. The results indicate that with dry snowcover it is not possible to discriminate between different types of ground surface (concrete, asphalt, grass, and bare ground) if the snow water equivalent is greater than about 20 cm (or a depth greater than 60 cm for a snow density of 0.3 g/cu cm). For the same density, however, if the snow is wet, a depth of 10 cm is sufficient to mask the underlying surface.

Ulaby, F. T.↗

Settlement patterns, GIS, remote sensing, and the late prehistory of the Black Prairie in east central Mississippi

Data recovered as the result of a recent field project designed to test a model of the distribution of protohistoric settlement in an unusual physiographic zone in eastern Mississippi are examined using GIS based techniques to manipulate soil and stream distance information. Significant patterning is derived. The generally thin soils and uniform substratum of the Black Prairie in combination with a distinctive settlement pattern offer a promising opportunity for the search for site specific characteristics within airborne imagery. Landsat TM data provide information on modern ground cover which is used as a mask to select areas in which a multivariate search for archaeological site signatures within a TIMS image is most likely to prove fruitful.

Johnson, Jay K.↗

Investigation of cloud properties and atmospheric stability with MODIS

The last half year was spent in preparing Version 1 software for delivery, and culminated in transfer of the Level 2 cloud mask production software to the SDST in April. A simulated MODIS test data set with good radiometric integrity was produced using MAS data for a clear ocean scene. ER-2 flight support and MAS data processing were provided by CIMSS personnel during the Apr-May 96 SUCCESS field campaign in Salina, Kansas. Improvements have been made in the absolute calibration of the MAS, including better characterization of the spectral response for all 50 channels. Plans were laid out for validating and testing the MODIS calibration techniques; these plans were further refined during a UW calibration meeting with MCST.

Menzel, P.↗

A Digital Solar Aspect Sensor

The solar aspect sensor described herein performs the analog-to-digital conversion of data optically. To accomplish this, it uses a binary "Gray code" light mask to produce a digital indication, in vehicle-fixed coordinates, of the elevation and azimuth angles of incident light from the sun. This digital solar aspect sensor system, in Explorer X, provided measurements of both elevation and azimuth angles to +/- 2 degrees at a distance of over 140,000 statute miles.

Albus, James S.↗

Optial Experiments and Model Validation of Perturbed Starshade Designs

Starshades are a leading technology to enable the direct detection and spectroscopic characterization of Earth- like exoplanets. Critical starshade technologies are currently being advanced through the S5 Project and at the Princeton starshade testbed. We report on the status of Milestone 2 of the S5 Project, optical model validation. We present results from optical experiments of starshades with intentional perturbations built into their design. These perturbations are representative of the type of perturbations possible in a flight design and serve as points of validation for dffraction models and error budgets. We show experimental results for two perturbed shapes, a mask with all petals shifted radially outward by 5 um and a mask with shallow sine waves built into two petals. We compare these data to outputs of the optical model and demonstrate better than 25% agreement. We also present images taken in crossed polarized light and use those data to constrain physical parameters of the optical edge. Bringing in previously obtained results for other perturbed shapes, we show an agreement between experiment and model of better than 25% and argue that this satisfies the Milestone 2 criteria.

Galvin, Michael↗