Search NASA⌕ Search

SEARCH · Search NASA

Results for “data masking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Evaluating the Use of Foundational Chemical Language Models in Multimodal Graph Fusion

Rapid and accurate prediction of the physicochemical properties of molecules given their structures remains a key challenge in cheminformatics. Machine learning approaches offer high-throughput options, but the optimality of inductive biases and data representations are up for debate. For example, BERT-based masked language models (MLMs) can be trained in a self-supervised way on hundreds of millions to billions of readily available SMILES strings. Another option is graph neural networks (GNNs), which can operate directly on molecular structures. Yet, generating accurate molecular geometry is computationally expensive, leading to a relative scarcity in data compared to SMILES strings. It is attractive to combine these two paradigms by pre-training an LM on a large corpus of SMILES strings and embedding these representation into a geometric graph neural network. Despite the promise of such an approach, and contrary to previous studies, we find mixed results with the combination of the LMs and GNNs on several molecule datasets. In particular, we found evidence for improvement on the FreeSolv and QM7 benchmarks, but degraded performance on the ESOL, LIPO and QM9 datasets compared to a GNN baseline.

Francel, Collin [University of Alabama]↗
DOE OSTI2025

Mathematical Morphological Filtering with a Self-Adaptive Reconstruction Technique and Application to Local Seismic Data

Recorded seismic data are generally contaminated by noise from different sources, which masks the signals of interest. In the seismology community, frequency filtering (FF) is the standard method for noise suppression. However, when the signal of interest and noise share the same frequency band, the latter cannot be filtered out without infringing on the former. We implemented a noise suppression approach based on the mathematical morphology theorem. The method involves compound operations of dilation and erosion using structuring elements of varying lengths and decomposes an input noisy waveform into several time functions with differing characteristics. Further, the filtered waveform is constructed from the time functions using a self-adaptive reconstruction technique. Application to a data set of >4700 local waveforms suggests that the implemented mathematical morphological filtering (MMF) approach is efficient for data with low signal-to-noise ratio (SNR) and significantly outperforms FF in that SNR range. For most of the dataset, FF, machine learning (ML) denoising, and continuous wavelet transform (CWT) thresholding result in higher SNR values compared with the MMF method. However, for ~42% of the waveforms, MMF outperforms FF, and the SNR gain achieved with MMF is as large as ~23 dB. Compared to ML denoising and CWT thresholding, this proportion drops to only ~10%–14%. Our results suggests that in an operational setting, MMF cannot replace the other noise suppression methods; however, signal detection can be improved if MMF is used to supplement them in some scenarios. MMF could help detect signals in problematic low-SNR data, which are currently being missed particularly when using FF alone.

58 GEOSCIENCES↗
DOE OSTI2021

DMTN-197: Streak Masking in DM Image Processing

Streaks caused by satellites are a persistent problem in optical images, and their occurrence will likely increase in the coming years. Many Hyper Suprime-Cam images are already affected by streaks, and the same is expected for Rubin Observatory data. In the LSST Data Release Production (DRP), most streaks and other artifacts are already detected and masked by the algorithm CompareWarpAssembleCoadd. However, some streaks are not caught at this stage and can contaminate the final coadds and detection catalogs. To find and mask these, we adopt a morphologically-based method for detecting streaks, which uses the Kernel-Based Hough Transform to detect straight lines. Once the lines are detected, the streak profile is fit and the affected portion of the image is masked out. This algorithm, maskStreaks, is included in the meas_algorithms package and is used in CompareWarpAssembleCoadd to remove streaks from coadds. Similar implementation in the Alert Production Pipeline is possible but has not been implemented.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

MAD: Self-Supervised Masked Anomaly Detection Task for Multivariate Time Series

In this paper, we introduce Masked Anomaly Detection (MAD), a general self-supervised learning task for multivariate time series anomaly detection. With the increasing availability of sensor data from industrial systems, being able to detecting anomalies from streams of multivariate time series data is of significant importance. Given the scarcity of anomalies in real-world applications, the majority of literature has been focusing on modeling normality. The learned normal representations can empower anomaly detection as the model has learned to capture certain key underlying data regularities. A typical formulation is to learn a predictive model, i.e., use a window of time series data to predict future data values. In this paper, we propose an alternative self-supervised learning task. By randomly masking a portion of the inputs and training a model to estimate them using the remaining ones, MAD is an improvement over the traditional left-to-right next step prediction (NSP) task. Our experimental results demonstrate that MAD can achieve better anomaly detection rates over traditional NSP approaches when using exactly the same neural network (NN) base models, and can be modified to run as fast as NSP models during test time on the same hardware, thus making it an ideal upgrade for many existing NSP-based NN anomaly detection models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Pseudonymization at Scale: OLCF’s Summit Usage Data Case Study

The analysis of vast amounts of data and the processing of complex computational jobs have traditionally relied upon high performance computing (HPC) systems, which offer reliable and efficient management of large-scale computational and data resources. Understanding these analyses’ needs is paramount for designing solutions that can lead to better science, and similarly, understanding the characteristics of the user behavior on those systems is important for improving user experiences on HPC systems. A common approach to gathering data about user behavior is to extract workload characteristics from system log data available only to system administrators. Recently at Oak Ridge Leadership Computing Facility (OLCF), however, we unveiled user behavior about the Summit supercomputer by collecting data from a user’s point of view with ordinary Unix commands.In this paper, we discuss the process, challenges, and lessons learned while preparing this dataset for publication and submission to an open data challenge. The original dataset contains personal identifiable information (PII) about the users of OLCF which needed be masked prior to publication, and we determined that anonymization, which scrubs PII completely, destroyed too much of the structure of the data to be interesting for the data challenge. We instead chose to pseudonymize the dataset, which reduced the linkability of the dataset to the users’ identities. Pseudonymization is significantly more computationally expensive than anonymization, and the size of our dataset, which is approximately 175 million lines of raw text, necessitated the development of a parallelized workflow that could be reused on different HPC machines. We demonstrate the scaling behavior of the workflow on two leadership class HPC systems at OLCF, and we show that we were able to bring the overall makespan time from an impractical 20+ hours on a single node down to around 2 hours. As a result of this work, we release the entire pseudonymized dataset and make the workflows and source code publicly available.

Maheshwari, Ketan↗
DOE OSTI2021

Electronic Coherence and Coherent Dephasing in the Optical Control of Electrons in Graphene

Electronic coherence is of utmost importance for the access and control of quantum-mechanical solid-state properties. Using a purely electronic observable, the photocurrent, we measure a lower bound of the electronic coherence time of 22 ± 4 fs in graphene. The photocurrent is ideally suited to measure electronic coherence, as it is a direct result of coherent quantum-path interference, controlled by the delay between two ultrashort two-color laser pulses. The maximum delay for which interference between the population amplitude injected by the first pulse interferes with that generated by the second pulse determines the electronic coherence time. In particular, numerical simulations reveal that the experimental data yields a lower bound on the electronic coherence time, masked by coherent dephasing due to the broadband absorption in graphene. Overall, we expect that our results will significantly advance the understanding of coherent quantum control in solid-state systems ranging from excitation with weak fields to strongly driven systems.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2020

Expectation-propagation for weak radionuclide identification at radiation portal monitors

We propose a sparsity-promoting Bayesian algorithm capable of identifying radionuclide signatures from weak sources in the presence of a high radiation background. The proposed method is relevant to radiation identification for security applications. In such scenarios, the background typically consists of terrestrial, cosmic, and cosmogenic radiation that may cause false positive responses. We evaluate the new Bayesian approach using gamma-ray data and are able to identify weapons-grade plutonium, masked by naturally-occurring radioactive material (NORM), in a measurement time of a few seconds. We demonstrate this identification capability using organic scintillators (stilbene crystals and EJ-309 liquid scintillators), which do not provide direct, high-resolution, source spectroscopic information. Compared to the EJ-309 detector, the stilbene-based detector exhibits a lower identification error, on average, owing to its better energy resolution. Organic scintillators are used within radiation portal monitors to detect gamma rays emitted from conveyances crossing ports of entry. The described method is therefore applicable to radiation portal monitors deployed in the field and could improve their threat discrimination capability by minimizing “nuisance” alarms produced either by NORM-bearing materials found in shipped cargoes, such as ceramics and fertilizers, or radionuclides in recently treated nuclear medicine patients.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2021

The TELPERION survey for distant [O iii ] clouds around luminous and hibernating AGN

ABSTRACT We present a narrow-band [O iii] imaging survey of 111 active galactic nucleus (AGN) hosts and 17 merging-galaxy systems, in search of distant extended emission-line regions (EELRs) around AGNs (either extant or faded). Our data reach deeper than detection from the broad-band SDSS data and cover a wider field than some early emission-line surveys used to study extended structure around AGNs. Spectroscopic follow-up confirms two new distant AGN-ionized clouds, in the merging systems NGC 235 and NGC 5514, projected at 26 and 75 kpc from the nuclei (respectively). We also recover the previously known region in NGC 7252. These results strengthen the connection between EELRs and tidal features; kinematically quiescent distant EELRs are virtually always photoionized tidal debris. We see them in ≈10 per cent of the galaxies in our sample with tidal tails. Energy budgets suggest that the AGN in NGC 5514 has faded by >3 times during the extra light traveltime ≈250 000 yr from the nucleus to the cloud and then to the observer; strong shock emission in outflows masks the optical signature of the AGN. For NGC 235 our data are consistent with but do not unequivocally require variation over ≈85 000 yr. In addition to these very distant ionized clouds, we find luminous and extensive line emission within four galaxies – IC 1481, ESO 362-G08, NGC 5514, and NGC 7679. Among these, IC 1481 shows apparent ionization cones, a rare combination with its LINER AGN spectrum. In NGC 5514, we measure a 7-kpc shell expanding at ≈370 km s−1 west of the nucleus.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Identifying a regional aerosol baseline in the eastern North Atlantic using collocated measurements and a mathematical algorithm to mask high-submicron-number-concentration aerosol events

Abstract. High-time-resolution measurements of in situ aerosol and cloud properties provide the ability to study regional atmospheric processes that occur on timescales of minutes to hours. However, one limitation to this approach is that continuous measurements often include periods when the data collected are not representative of the regional aerosol. Even at remote locations, submicron aerosols are pervasive in the ambient atmosphere with many sources. Therefore, periods dominated by local aerosol should be identified before conducting subsequent analyses to understand aerosol regional processes and aerosol–cloud interactions. Here, we present a novel method to validate the identification of regional baseline aerosol data by applying a mathematical algorithm to the data collected at the U.S. Department of Energy's (DOE) Atmospheric Radiation Measurement (ARM) user facility in the eastern North Atlantic (ENA). The ENA central facility (C1) includes an aerosol observing system (AOS) for the measurement of aerosol physical, optical, and chemical properties at time resolutions from seconds to minutes. A second temporary supplementary facility (S1), located ∼0.75 km from C1, was deployed for ∼1 year during the Aerosol and Cloud Experiments (ACE-ENA) campaign in 2017. First, we investigate the local aerosol at both locations. We associate periods of high submicron number concentration (Ntot) in the fine-mode condensation particle counter (CPC) and size distributions from the Ultra-High Sensitivity Aerosol Spectrometer (UHSAS) as a function of wind direction using a meteorology sensor with local sources. Elevated concentrations of Aitken-mode (< 100 nm diameter) particles were observed in correspondence with the wind directions associated with airport operations. At ENA, the Graciosa Airport and its associated activities were found to be the main sources of high-concentration aerosol events at ENA, causing peaks in 1 min Ntot that exceeded 8000 and 10 000 cm−3 at C1, in summer and winter, respectively, and 5000 cm−3 at S1 in summer. Periods with high Ntot not associated with these wind directions were also observed. As a result, the diverse local sources at ENA yielded a poor relationship between Ntot measurements collected at C1 and S1 (R2=0.03 with a slope =0.05±0.001). As a first approach to mask these events, the time periods when the wind direction was associated with the airport operations (west to northwest and southeast to south at C1 and east to south at S1) were applied. The meteorological masks removed 38.9 % of the data at C1 and 43.4 % at S1, and they did not significantly improve the relationship between the two sites (R2=0.18 with a slope =0.06±0.001). Due to the complexity of high-Ntot events observed at ENA, we develop and validate a mathematical ENA Aerosol Mask (ENA-AM) to identify high-Ntot events using 1 min resolution data from the AOS CPC at C1 and S1. After its parameterization and application, ENA-AM generated a high correlation between Ntot in the summer at C1 and S1 (R2=0.87 with a slope =0.84±0.001). We identified the regional baseline at ENA to be 428±228 cm−3 in the summer and 346±223 cm−3 in the winter. Lastly, we compared masked measurements from the AOS with the ARM Aerial Facility (AAF) during flights over C1 in the summer to understand submicron aerosol vertical mixing over C1. The high correlation (R2=0.71 with a slope of 1.04±0.01) observed between C1 and the AAF Ntot collected within an area of 10 km surrounding ENA and at altitudes < 500 m indicated that the submicron aerosol at ENA was well mixed within the first 500 m of the marine boundary layer during the month of July during ACE-ENA. Our novel method for determining a regional aerosol baseline at ENA can be applied to other time periods and at other locations with validation by a secondary site or additional collocated measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

CACTI CSAPR2 Taranis Retrievals

Taranis is an end-to-end processing chain for radar data written in Python with C extension for computation performance. Features include: masking for quality control, specific differential phase (Kdp), attenuation correction for reflectivity factor (Z) and differential reflectivity (Zdr) in rain, and additional geophysical retrievals. Retrievals are mostly drawn from literature or open-source software when appropriate, and have been tested, tuned, and modified to work with one another cohesively rather than using isolated off-the-shelf algorithms. Incorporated algorithms include hydrometeor (echo) identification, rain water content, raindrop mass-weighted mean diameter (gamma size distribution assumption), and rainfall rate (QPE). Taranis data sets exist for CSAPR2 PPI, HSRHI, and sector RHI scans. Cartesian-gridded data sets were also produced as well as a near-surface rain rate retrieval. More details can be found in the README.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Real time monitoring of COVID-19 intervention effectiveness through contact tracing data

Communities worldwide have used vaccines and facemasks to mitigate the COVID-19 pandemic. When an individual opts to vaccinate or wear a mask, they may lower their own risk of becoming infected as well as the risk that they pose to others while infected. The first benefit–reducing susceptibility–has been established across multiple studies, while the second–reducing infectivity–is less well understood. Using a new statistical method, we estimate the efficacy of vaccines and facemasks at reducing both types of risks from contact tracing data collected in an urban setting. We find that vaccination reduced the risk of onward transmission by 40.7% [95% CI 25.8–53.2%] during the Delta wave and 31.0% [95% CI 19.4–40.9%] during the Omicron wave and that mask wearing reduced the risk of infection by 64.2% [95% CI 5.8–77.3%] during the Omicron wave. By harnessing commonly-collected contact tracing data, the approach can broadly provide timely and actionable estimates of intervention efficacy against a rapidly evolving pathogen.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Enhancing Nanoparticle Detection in Interferometric Scattering (iSCAT) Microscopy Using a Mask R-CNN

Interferometric scattering microscopy (iSCAT) is a label-free optical microscopy technique that enables imaging of individual nano-objects such as nanoparticles, viruses, and proteins. Essential to this technique is the suppression of background scattering and identification of signals from nano-objects. In the presence of substrates with high roughness, scattering heterogeneities in the background, when coupled with tiny stage movements, cause features in the background to be manifested in background-suppressed iSCAT images. Traditional computer vision algorithms detect these background features as particles, limiting the accuracy of object detection in iSCAT experiments. Here, in this paper, we present a pathway to improve particle detection in such situations using supervised machine learning via a mask region-based convolutional neural network (mask R-CNN). Using a model iSCAT experiment of 19.2 nm gold nanoparticles adsorbing to a rough layer-by-layer polyelectrolyte film, we develop a method to generate labeled datasets using experimental background images and simulated particle signals and train the mask R-CNN using limited computational resources via transfer learning. We then compare the performance of the mask R-CNN trained with and without inclusion of experimental backgrounds in the dataset against that of a traditional computer vision object detection algorithm, Haar-like feature detection, by analyzing data from the model experiment. Results demonstrate that including representative backgrounds in training datasets improved the mask R-CNN in differentiating between background and particle signals and elevated performance by markedly reducing false positives. The methodology for creating a labeled dataset with representative experimental backgrounds and simulated signals facilitates the application of machine learning in iSCAT experiments with strong background scattering and thus provides a useful workflow for future researchers to improve their image processing capabilities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Deep learning for morphological identification of extended radio galaxies using weak labels

Abstract The present work discusses the use of a weakly-supervised deep learning algorithm that reduces the cost of labelling pixel-level masks for complex radio galaxies with multiple components. The algorithm is trained on weak class-level labels of radio galaxies to get class activation maps (CAMs). The CAMs are further refined using an inter-pixel relations network (IRNet) to get instance segmentation masks over radio galaxies and the positions of their infrared hosts. We use data from the Australian Square Kilometre Array Pathfinder (ASKAP) telescope, specifically the Evolutionary Map of the Universe (EMU) Pilot Survey, which covered a sky area of 270 square degrees with an RMS sensitivity of 25–35 $\mu$ Jy beam $^{-1}$ . We demonstrate that weakly-supervised deep learning algorithms can achieve high accuracy in predicting pixel-level information, including masks for the extended radio emission encapsulating all galaxy components and the positions of the infrared host galaxies. We evaluate the performance of our method using mean Average Precision (mAP) across multiple classes at a standard intersection over union (IoU) threshold of 0.5. We show that the model achieves a mAP $_{50}$ of 67.5% and 76.8% for radio masks and infrared host positions, respectively. The network architecture can be found at the following link: https://github.com/Nikhel1/Gal-CAM

Astronomy & Astrophysics↗
DOE OSTI2023

Optimizing Seasonal‐To‐Decadal Analog Forecasts With a Learned Spatially‐Weighted Mask

Abstract Seasonal‐to‐decadal climate prediction is crucial for decision‐making in a number of industries, but forecasts on these timescales have limited skill. Here, we develop a data‐driven method for selecting optimal analogs for seasonal‐to‐decadal analog forecasting. Using an interpretable neural network, we learn a spatially‐weighted mask that quantifies how important each grid point is for determining whether two climate states will evolve similarly. We show that analogs selected using this weighted mask provide more skillful forecasts than analogs that are selected using traditional spatially‐uniform methods. This method is tested on two prediction problems using the Max Planck Institute for Meteorology Grand Ensemble: multi‐year prediction of North Atlantic sea surface temperatures, and seasonal prediction of El Niño Southern Oscillation. This work demonstrates a methodical approach to selecting analogs that may be useful for improving seasonal‐to‐decadal forecasts and understanding their sources of skill.

Geology↗
DOE OSTI2025

SITCOMTN-164: AnaCal Shear Profile of Abell 360 in LSSTComCam Data Preview 1

This technote presents the measurement of the weak-lensing shear profile for the Abell 360 galaxy cluster using LSSTComCam data processed with the AnaCal pipeline. We detail the procedures involved in bright-star masking, source selection, and the estimation of tangential and cross shear around the cluster center. The resulting shear profiles provide key insights into the mass distribution of Abell 360 and demonstrate the capabilities of AnaCal in processing early LSST data, with the tangential shear profile detected at 5σ significance.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Supercritical CO2 sterilization of N95 Masks

A preliminary investigation of the use of supercritical carbon dioxide for treating of 3M 1860 N95 masks was undertaken to evaluate a potential route to low-cost, scalable, sterilization of personal protective equipment for multiple reuse in hospital settings. Upon entering the supercritical regime, the normally distinct liquid and gaseous phases of CO 2 merge into a single homogeneous phase that has density, short-range order, and solvation capacity of a liquid, but the volume-filling and permeation properties that of a gas. This enables supercritical CO2 to function as a vehicle for delivery of biocidal agents such peracetic acid into microporous structures. The potentially adverse effect of a liquid-to-gas phase transition on mask filter media is avoided by conducting cleaning operations above 31 C, the critical temperature for carbon dioxide. A sample of fifteen 3M 1860 N95 masks was subjected to ten consecutive cycles of supercritical CO 2 cleaning to determine its effect on mask performance. These 15 masks, along with 5 control samples then underwent a battery of standardized tests at the CDC NIOSH NPPTL research facility in Pittsburgh, PA. The data from these tests strongly suggest (but do not prove) that supercritical carbon dioxide do not damage 3M 1860 N95 masks. Additional tests conducted during this project confirmed the compatibility of supercritical CO 2 with ventilator tubing that, like N95 masks, has been in short supply during portions of the COVID-19 pandemic and cannot be sterilized by conventional means. Finally, a control experiment was also conducted to examine the effect of supercritical CO 2 on a BSL-2 surrogate virus, vesicular stomatitis virus (VSV), Indiana serotype strain. In the absence of biocidal additives, supercritical CO 2 exhibited no measurable lethality against VSV. This surrogate virus experiment suggests that a biocidal additive such as peracetic acid will be necessary to achieve required sterilization metrics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Tracking blobs in the turbulent edge plasma of a tokamak fusion device

Abstract The analysis of turbulence in plasmas is fundamental in fusion research. Despite extensive progress in theoretical modeling in the past 15 years, we still lack a complete and consistent understanding of turbulence in magnetic confinement devices, such as tokamaks. Experimental studies are challenging due to the diverse processes that drive the high-speed dynamics of turbulent phenomena. This work presents a novel application of motion tracking to identify and track turbulent filaments in fusion plasmas, called blobs, in a high-frequency video obtained from Gas Puff Imaging diagnostics. We compare four baseline methods (RAFT, Mask R-CNN, GMA, and Flow Walk) trained on synthetic data and then test on synthetic and real-world data obtained from plasmas in the Tokamak à Configuration Variable (TCV). The blob regime identified from an analysis of blob trajectories agrees with state-of-the-art conditional averaging methods for each of the baseline methods employed, giving confidence in the accuracy of these techniques. By making a dataset and benchmark publicly available, we aim to lower the entry barrier to tokamak plasma research, thereby greatly broadening the community of scientists and engineers who might apply their talents to this endeavor.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗