Search NASA⌕ Search

SEARCH · Search NASA

Results for “data masking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A Weakly-Supervised, Multitask Deep Learning Framework for Shadow Mitigation in Remote Sensing Imagery

We propose a weakly-supervised, multitask framework for training a convolutional neural network to solve the problem of cloud shadow mitigation given only cloud and shadow masks as labels. The network minimizes the Wasserstein distance between shadows and their proximal sunlit neighborhoods, generating a supervisory signal directly from within the input image. We extract further utility from the shadow mask through multitask learning by introducing an auxiliary task of shadow segmentation. Our approach is advantageous since it performs mitigation in an end-to-end framework which requires only a shadowed image for inference. We apply this process to the Landsat 8 OLI SPARCS validation data set and demonstrate plausible results.

Couwenhoven, Scott↗
DOE OSTI2023

Accurate estimation of angular power spectra for maps with correlated masks

A common procedure when analyzing maps of the cosmic microwave background (CMB) or other cosmological signals is the need to remove ("mask") regions of the maps that are heavily contaminated, e.g., by non-cosmological foreground emission. After applying such a mask, one must account for its effect when inferring statistical properties of interest, such as the angular power spectrum of the field in the original map. A widely used approach to correct for such mask-induced effects was presented by Hivon et al. (2002), now widely known as the "MASTER" formalism. However, it is often the case that the map and mask are correlated in some way, such as point source masks used in CMB analyses, which have nonzero correlation with CMB secondary anisotropy fields and other mm-wave sky signals. In such situations, the MASTER approach gives biased results, as it assumes that the unmasked map and mask have zero correlation. While such effects have been discussed before with regard to specific physical models, here we derive a completely general formalism for any case where the map and mask are correlated. We show that our result ("reMASTERed") reconstructs ensemble-averaged angular power spectra to effectively exact precision, with significant improvements over traditional estimators for cases where the map and mask are correlated. An important consequence of our result is that for maps with correlated masks, it is no longer possible to invert a simple equation to obtain the true power spectrum from the observed (masked) power spectrum. Instead, our result necessitates the use of forward modeling from theory space into the observable domain of the masked power spectrum. We publicly release our software implementation of these results.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Photometry, Centroid and Point-spread Function Measurements in the LSST Camera Focal Plane Using Artificial Stars

Abstract The Vera C. Rubin Observatory’s LSST Camera (LSSTCam) pixel response has been characterized using laboratory measurements with a grid of artificial stars. We quantify the contributions to photometry, centroid, point-spread function size, and shape measurement errors due to small anomalies in the LSSTCam CCDs. The main sources of those anomalies are quantum efficiency variations and pixel area variations induced by the amplifier segmentation boundaries and “tree-rings”—circular variations in silicon doping concentration. This laboratory study using artificial stars projected on the sensors shows overall small effects. The residual effects on point-spread function (PSF) size and shape are below 0.1%, meeting the ten-year LSST survey science requirements. However, the CCD mid-line presents distortions that can have a moderate impact on PSF measurements. This feature can be avoided by masking the affected regions. Effects of tree-rings are observed on centroids and PSFs of the artificial stars and the nature of the effect is confirmed by a study of the flat-field response. Nevertheless, further studies of the full-focal plane with stellar data should more completely probe variations and might reveal new features, e.g., wavelength-dependent effects. The results of this study can be used as a guide for the on-sky operation of LSSTCam.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

The growth of intracluster light in XCS-HSC galaxy clusters from 0.1 < z < 0.5

ABSTRACT We estimate the intracluster light (ICL) component within a sample of 18 clusters detected in the XMM Cluster Survey (XCS) data using the deep (∼26.8 mag) Hyper Suprime-Cam Subaru Strategic Programme data release 1 i-band data. We apply a rest-frame μB = 25 mag arcsec−2 isophotal threshold to our clusters, below which we define light as the ICL within an aperture of RX,500 (X-ray estimate of R500) centred on the brightest cluster galaxy (BCG). After applying careful masking and corrections for flux losses from background subtraction, we recover ∼20 per cent of the ICL flux, approximately four times our estimate of the typical background at the same isophotal level (${\sim}5{{\ \rm per\ cent}}$). We find that the ICL makes up about ${\sim}24{{\ \rm per\ cent}}$ of the total cluster stellar mass on average (∼41 per cent including the flux contained in the BCG within 50 kpc); this value is well matched with other observational studies and semi-analytic/numerical simulations, but is significantly smaller than results from recent hydrodynamical simulations (even when measured in an observationally consistent way). We find no evidence for any links between the amount of ICL flux with cluster mass, but find a growth rate of 2–4 for the ICL between 0.1 < z < 0.5. We conclude that the ICL is the dominant evolutionary component of stellar mass in clusters from z ∼ 1. Our work highlights the need for a consistent approach when measuring ICL alongside the need for deeper imaging, in order to unambiguously measure the ICL across as broad a redshift range as possible (e.g. 10-yr stacked imaging from the Vera C. Rubin Observatory).

Furnell, Kate E.↗
DOE OSTI2025

Balancing Trade-offs: Adaptive Differential Privacy in Interpretable Machine Learning Models

In the advancing field of machine learning, balancing accuracy, interpretability, and privacy represents a significant challenge. The problem is exacerbated by the widespread deployment of pre-trained models locally in diverse applications, which could lead to various amounts of privacy leakage. Conventional Differential Privacy strategies, in which uniform noises are applied to model gradients, guarantee data privacy at the expense of accuracy and interpretability. This paper introduces a Feature-Sensitive Adaptive Differential Privacy (FADP) framework with a unique noise-adding strategy. Noises are adaptively added based on feature importance clustering, where important features are considered for interpretability. By employing a unique masking technique, FADP selectively preserves crucial features with minimal noise interference, maintaining accuracy while enhancing interpretability. The FADP framework addresses the limitations of traditional DP methods by preserving critical channels and improving interpretability — a vital requirement in machine learning applications that demand transparency in model decisions. Through comprehensive testing, FADP is shown to balance the trade-offs among accuracy, privacy, and interpretability, marking a substantial advancement in the field of privacy-preserving machine learning.

Farhad Riya, Farhin [University of Tennessee, Knox↗
DOE OSTI2025

Effective Defect Detection Using Instance Segmentation for NDI

Ultrasonic testing is a common Non-Destructive Inspection (NDI) method used in aerospace manufacturing. However, the complexity and size of the ultrasonic scans make it challenging to identify defects through visual inspection or machine learning models. Using computer vision techniques to identify defects from ultrasonic scans is an evolving research area. In this study, we used instance segmentation to identify the presence of defects in the ultrasonic scan images of composite panels that are representative of real components manufactured in aerospace. We used two models based on Mask- RCNN (Detectron 2) and YOLO 11 respectively. Additionally, we implemented a simple statistical pre-processing technique that reduces the burden of requiring custom-tailored pre-processing techniques. Our study demonstrates the feasibility and effectiveness of using instance segmentation in the NDI pipeline by significantly reducing data pre-processing time, inspection time, and overall costs.

computer vision techniques↗
DOE OSTI2021

Dark Energy Survey year 3 results: covariance modelling and its impact on parameter estimation and quality of fit

ABSTRACT We describe and test the fiducial covariance matrix model for the combined two-point function analysis of the Dark Energy Survey Year 3 (DES-Y3) data set. Using a variety of new ansatzes for covariance modelling and testing, we validate the assumptions and approximations of this model. These include the assumption of Gaussian likelihood, the trispectrum contribution to the covariance, the impact of evaluating the model at a wrong set of parameters, the impact of masking and survey geometry, deviations from Poissonian shot noise, galaxy weighting schemes, and other sub-dominant effects. We find that our covariance model is robust and that its approximations have little impact on goodness of fit and parameter estimation. The largest impact on best-fitting figure-of-merit arises from the so-called fsky approximation for dealing with finite survey area, which on average increases the χ2 between maximum posterior model and measurement by $3.7{{\ \rm per\ cent}}$ (Δχ2 ≈ 18.9). Standard methods to go beyond this approximation fail for DES-Y3, but we derive an approximate scheme to deal with these features. For parameter estimation, our ignorance of the exact parameters at which to evaluate our covariance model causes the dominant effect. We find that it increases the scatter of maximum posterior values for Ωm and σ8 by about $3{{\ \rm per\ cent}}$ and for the dark energy equation-of-state parameter by about $5{{\ \rm per\ cent}}$.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Energy Adequacy Studies: Nodal vs Zonal and Ramp-Rate Representation

This work investigates limitations in current energy adequacy studies, particularly concerning the representation of grid complexities. We highlight how traditional zonal modeling approaches, which simplify large geographic areas and generator capabilities, can mask critical transmission constraints and localized resource shortfalls. By analyzing nodal versus zonal pricing differences and the empirical distribution of generator ramp-rates, we demonstrate that these simplified assumptions may misrepresent system flexibility and deliverability. Our findings underscore the need for more granular, nodal-level analyses and data-driven characterizations of generation assets to provide a more accurate and robust assessment of energy reliability and adequacy, ultimately supporting a more resilient and efficient energy infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

River bank erosion and accretion rates, and planform metrics of the East River, downstream of Gothic Colorado over intervals between 1955 and 2015

This dataset provides the tabular summary of analysis of an alluvial floodplain reach of the East River, downstream of Gothic, CO near Crested Butte. The measurements include bank erosion and accretion rates, channel width, bank curvature, and the aspect/orientation of the river banks. The measurements were derived from binary masks of the location of the river channel from aerial and satellite imagery collected on seven dates over a sixty-year timespan: 1955, 1973, 1983, 1990, 2001, 2011, and 2015. The masks were analyzed using the Spatially Continuous Riverbank Erosion and Accretion Measurements (SCREAM) software detailed in Rowland et al. 2016. The masks used in this analysis can be found an accompanying dataset (DOI: ). Rates of change along the East River were measured over a total of 8-time intervals: 1955-1973; 1955-2015; 1973-1983; 1983-1990; 1990-2001; 2001-2011; 2001-2015; and 2011-2015.In files with “summary” in the name, the data is provided at a pixel level, where each mapped bank pixel has an associated erosion or accretion value, a channel width, a curvature value, and an aspect each river and time period will have an individual file. Files with “Segments” in name provide data that is averaged along segments of the rivers. These segments are approximately 10 channel widths in length. In addition to erosion and accretion rates, the segment-based results include area measurements of erosion and accretion, islands, and channels. The number of islands is also included.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Deep Learning Denoising Applied to Regional Distance Seismic Data in Utah

Seismic waveform data are generally contaminated by noise from various sources. Suppressing this noise effectively so that the remaining signal of interest can be successfully exploited remains a fundamental problem for the seismological community. To date, the most common noise suppression methods have been based on frequency filtering. These methods, however, are less effective when the signal of interest and noise share similar frequency bands. Inspired by source separation studies in the field of music information retrieval (Jansson et al., 2017) and a recent study in seismology (Zhu et al., 2019), we implemented a seismic denoising method that uses a trained deep convolutional neural network (CNN) model to decompose an input waveform into a signal of interest and noise. In our approach, the CNN provides a signal mask and a noise mask for an input signal. The short-time Fourier transform (STFT) of the estimated signal is obtained by multiplying the signal mask with the STFT of the input signal. To build and test the denoiser, we used carefully compiled signal and noise datasets of seismograms recorded by the University of Utah Seismograph Stations network. Results of test runs involving more than 9000 constructed waveforms suggest that on average the denoiser improves the signal-to-noise ratios (SNRs) by ~5 db, and that most of the recovered signal waveforms have high similarity with respect to the target waveforms (average correlation coefficient of ~0.80) and suffer little distortion. Application to real data suggests that our denoiser achieves on average a factor of up to ~2-5 improvement in SNR over band-pass filtering and can suppress many types of noise that band-pass filtering cannot. For individual waveforms, the improvement can be as high as ~15 db.

58 GEOSCIENCES↗
DOE OSTI2025

Radiative impact of record-breaking wildfires from integrated ground-based data

The radiative effects of wildfires have been traditionally estimated by models using radiative transfer calculations. Assessment of model-predicted radiative effects commonly involves information on observation-based aerosol optical properties. However, lack or incompleteness of this information for dense plumes generated by intense wildfires reduces substantially the applicability of this assessment. Here we introduce a novel method that provides additional observational constraints for such assessments using widely available ground-based measurements of shortwave and spectrally resolved irradiances and aerosol optical depth (AOD) in the visible and near-infrared spectral ranges. We apply our method to quantify the radiative impact of the record-breaking wildfires that occurred in the Western US in September 2020. For our quantification we use integrated ground-based data collected at the Atmospheric Measurements Laboratory in Richland, Washington, USA with a location frequently downwind of wildfires in the Western US. We demonstrate that remarkably dense plumes generated by these wildfires strongly reduced the solar surface irradiance (up to 70% or 450 Wm -2 for total shortwave flux) and almost completely masked the sun from view due to extremely large AOD (above 10 at 500 nm wavelength). We also demonstrate that the plume-induced radiative impact is comparable in magnitude with those produced by a violent volcano eruption occurred in the Western US in 1980 and continental cumuli.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Identifying mitigation strategies for $\mathrm{COVID}$-$\mathrm{19}$ superspreading on flights using models that account for passenger movement

Despite commercial airlines mandating masks, there have been multiple documented events of COVID-19 superspreading on flights. Conventional models do not adequately explain superspreading patterns on flights, with infection spread wider than expected from proximity based on passenger seating. An important reason for this is that models typically do not consider the movement of passengers during the flight, boarding, or deplaning. Understanding the risks for each of these aspects could provide insight into effective mitigation measures. We modeled infection risk from seating and fine-grained movement patterns – boarding, deplaning, and inflight movement. We estimated infection model parameters from a prior superspreading event. We validated the model and the impact of interventions using available data from three flights, including cabin layout and seat locations of infected and uninfected passengers, to suggest interventions to mitigate COVID-19 superspreading events during air travel. Specifically, we studied: 1) London to Hanoi with 201 passengers, including 13 secondary infections among passengers; 2) Singapore to Hangzhou with 321 passengers, including 12 to 14 secondary infections; 3) a non-superspreading event on a private jet in Japan with 9 passengers and no secondary infections. Here our results show that the inclusion of passenger movement better explains the infection spread patterns than conventional models do. We also found that FFP2/N95 mask usage would have reduced infection by 95–100%, while cloth masks would have reduced it by only 40–80%. Results indicate that leaving the middle seat vacant is effective in reducing infection, and the effectiveness increases when combined with good quality masks. However, with a good mask, the risk is quite low even without the middle seats being empty. Our results suggest the need for more stringent guidelines to reduce aviation-related superspreading events of COVID-19.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Current loss analysis in photoelectrochemical devices

Ongoing efforts to stabilize the operation of photoelectrochemical (PEC) devices remain critical for achieving economically viable solar fuel production, as devices with lifetimes on the order of 10 to 30 years are projected requirements for utility-scale, PEC device implementation. However, insight into the causes of device degradation and activity losses is generally provided by monitoring the device current, a quantity which masks the relative contributions of photovoltaic component degradation and electrocatalyst activity drops to overall performance losses. In this study, an approach for deconvoluting the various contributors to PEC device losses is described. In particular, the causes for observed fluctuations in device performance are determined through the collection of real-time, current–voltage data, paired with an analytical method that enables the decomposition of drops in device current into its constituent photovoltaic- and catalyst-driven performance losses. We test the validity of this approach by applying it to the data collected for a PEC hydrogen evolution test-bed.

14 SOLAR ENERGY↗
DOE OSTI2026

High-speed quantitative X-ray multi-contrast imaging with deep learning based modulated pattern analysis

The advent of X-ray multi-contrast imaging methods, providing absorption, phase, and dark-field images, holds tremendous promise for complementary and non-destructive visualization of inner structures within materials and bio-samples. However, the low efficiency in measuring and analyzing X-ray modulated patterns has hindered their application in high-resolution in situ imaging. In this work, the Enhanced Scanning Pattern-based Imaging Neural Network (ESPINNet) is introduced as a powerful tool for achieving high-speed, high-resolution quantitative imaging. ESPINNet is faster than correlation-based speckle tracking methods such as XSVT and UMPA, and provides a balanced performance in terms of resolution and speed for data collection by using fewer scanning images. In comparison with our previously developed neural network, ESPINNet introduces the capability to generate dark-field images, further enhancing its versatility. By leveraging scanning patterns, ESPINNet significantly improves resolution and measurement precision. Furthermore, its adaptability to various modulation patterns, including those produced by sandpaper, coded masks, or gratings, ensures broad applicability. These features enable real-time 2D and 3D multi-contrast imaging, positioning ESPINNet as a transformative solution for applications in materials science and biomedical research, particularly for high-speed and in situ measurements.

X-ray at-wavelength metrology↗
DOE OSTI2023

Analysis of Needlet Internal Linear Combination performance on B -mode data from sub-orbital experiments

The observation of primordial B modes in cosmic microwave background (CMB) polarisation data represents the main scientific goal of most of the future CMB experiments. This signal is predicted to be much lower than polarised Galactic emission (foregrounds) in any region of the sky, pointing to the need for effective component separation methods. Aims. Among all the techniques, the blind Needlet Internal Linear Combination (NILC) is of great relevance given our current limited knowledge of the B-mode foregrounds. In this work, we explore the possibility of employing NILC for the analysis of B modes reconstructed from partial-sky data, specifically addressing the complications that such an application yields such as E–B leakage, needlet filtering, and beam convolution. We consider two complementary simulated datasets of future experiments: the balloon-borne Short Wavelength Instrument for the Polarisation Explorer (SWIPE) of the Large Scale Polarisation Explorer, which targets the observation of both reionisation and recombination peaks of the primordial CMB B-mode angular power spectrum, and the ground-based Small Aperture Telescope of Simons Observatory, which, instead, is designed to observe only the recombination bump at ℓ ~ 80. We assessed the performance of the following two alternative techniques to correct for the CMB E–B leakage: the recycling technique and the Zhao-Baskaran method. We find that both techniques reduce the E–B leakage residuals at a negligible level given the sensitivity of the considered experiments, except for the recycling method in the SWIPE footprint at ℓ < 20. Thus, we implemented two extensions of the pipeline, the iterative B decomposition and the diffusive inpainting, which enabled us to recover the input CMB B-mode power for ℓ ≥ 5. For the considered experiments, we demonstrate that needlet filtering and beam convolution do not affect the CMB B-mode reconstruction. Finally, with an appropriate masking strategy, we find that NILC foregrounds subtraction allows one to achieve sensitivities on the tensor-to-scalar ratio in agreement with the targets of the considered CMB experiments.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Is tokenization needed for masked particle modeling?

In this work, we significantly enhance masked particle modeling (MPM), a self-supervised learning scheme for constructing highly expressive representations of unordered sets relevant to developing foundation models for high-energy physics. In MPM, a model is trained to recover the missing elements of a set, a learning objective that requires no labels and can be applied directly to experimental data. We achieve significant performance improvements over previous work on MPM by addressing inefficiencies in the implementation and incorporating a more powerful decoder. We compare several pre-training tasks and introduce new reconstruction methods that utilize conditional generative models without data tokenization or discretization. We show that these new methods outperform the tokenized learning objective from the original MPM on a new test bed for foundation models for jets, which includes using a wide variety of downstream tasks relevant to jet physics, such as classification, secondary vertex finding, and track identification.

conditional generative models↗
DOE OSTI2025

Microscopic Characterization of Pb 10−x Cu x (PO 4 ) 6 O by 31 P and 63/65 Cu NMR Measurements

The report of the first room-temperature, ambient-pressure superconductivity in copper-doped lead apatite Pb 10−x Cu x (PO 4 ) 6 O has attracted lots of attention. However, subsequent studies revealed the presence of numerous impurity phases in the polycrystalline sample, and the sharp superconducting-like transition is not due to a superconducting transition but most likely due to a reduction in resistivity caused by the first-order structural phase transition of Cu 2 S at around 385 K from the β phase at high temperature to the γ phase at low temperature. Before now, only bulk measurements have been performed on a Pb 10−x Cu x (PO 4 ) 6 O powder sample, which could be affected by the impurity phases, masking the intrinsic properties of Pb 10−x Cu x (PO 4 ) 6 O. In this study, 31 P and 63/65 Cu nuclear magnetic resonance (NMR) measurements have been performed on a Pb 10−x Cu x (PO 4 ) 6 O powder sample to investigate its physical properties from a microscopic point of view. Our NMR data evidence the non-magnetic insulating nature of Pb 10−x Cu x (PO 4 ) 6 O without any trace of electron correlation effects. Furthermore, the 63/65 Cu NMR results suggest that no copper or very little copper is substituted for Pb in Pb 10 (PO 4 ) 6 O prepared by sintering Pb 2 SO 5 and Cu 3 P.

lead apatite↗
DOE OSTI2022

Functional Data Analysis for Extracting the Intrinsic Dimensionality of Spectra: Application to Chemical Homogeneity in the Open Cluster M67

High-resolution spectroscopic surveys of the Milky Way have entered the Big Data regime and have opened avenues for solving outstanding questions in Galactic archeology. However, exploiting their full potential is limited by complex systematics, whose characterization has not received much attention in modern spectroscopic analyses. In this work, we present a novel method to disentangle the component of spectral data space intrinsic to the stars from that due to systematics. Using functional principal component analysis on a sample of 18,933 giant spectra from APOGEE, we find that the intrinsic structure above the level of observational uncertainties requires ≈10 functional principal components (FPCs). Our FPCs can reduce the dimensionality of spectra, remove systematics, and impute masked wavelengths, thereby enabling accurate studies of stellar populations. To demonstrate the applicability of our FPCs, we use them to infer stellar parameters and abundances of 28 giants in the open cluster M67. We employ Sequential Neural Likelihood, a simulation-based Bayesian inference method that learns likelihood functions using neural density estimators, to incorporate non-Gaussian effects in spectral likelihoods. By hierarchically combining the inferred abundances, we limit the spread of the following elements in M67: Fe ≲ 0.02 dex; C ≲ 0.03 dex; O, Mg, Si, Ni ≲ 0.04 dex; Ca ≲ 0.05 dex; N, Al ≲ 0.07 dex (at 68% confidence). Our constraints suggest a lack of self-pollution by core-collapse supernovae in M67, which has promising implications for the future of chemical tagging to understand the star formation history and dynamical evolution of the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗