SEARCH · Search NASA
Results for “data masking”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
KAZRCORGE-c0
For the Ka ARM Zenith Radar (KAZR) data stream, kazrcorge.c1 (ge=general sensitivity), produces significant detection mask, corrects reflectivity for gaseous attenuation, and dealiases mean Doppler velocity. Note that reflectivity in this product is not calibrated.
KAZRCORHI-c0
For the Ka ARM Zenith Radar (KAZR) data stream, kazrcorhi.c1 (hi=high sensitivity), produces significant detection mask, corrects reflectivity for gaseous attenuation, and dealiases mean Doppler velocity. Note that reflectivity in this product is not calibrated.
KAZRCORMD-c0
For the Ka ARM Zenith Radar (KAZR) data stream, kazrcorge.c1 (ge=general sensitivity), produces significant detection mask, corrects reflectivity for gaseous attenuation, and dealiases mean Doppler velocity. Note that reflectivity in this product is not calibrated.
CSAPR2 cell-tracking data collected during TRACER
One of the challenges of analyzing convective cell properties is quick evolution of the individual convective cells. While the operational radar data provide great a data set to analyze the evolution of radar observables of convective precipitation clouds statistically, previous studies also suggested that, because of the quick evolution of cell life cycle, conventional radar volume scan strategies taking ~5-7 minutes might not capture the detailed evolution. The TRACER campaign deployed CSAPR2, which performed frequent update of RHI and sector PPI scans to track convective cells every < 2 minutes guided by a new cell-tracking framework, Multisensor Agile Adaptive Sampling (MAAS; Kollias et al. 2020). This allows for capturing fast-evolving radar observables. The submitted data files are CSAPR2 data in CfRadial format collected during the TRACER field campaign from June to September 2020. The data files include processed radar variables including: noise-masked reflectivity and differential reflectivity corrected for rain attenuation and systematic biases, noise-masked dealiased radial velocity, specific differential phase, locations of target cells (latitude, longitude, radar range), and radar-echo classification.
Some observations on spin detector response during Galileo high gain antenna deployment
This paper summarizes a dynamic analysis conducted in support of the investigation of the anomalous deployment of the Galileo High Gain Antenna on April 11, 1991. The work was focused on modeling the spacecraft spin dynamics to predict and compare the spin detector telemetry during the antenna deployment for possible cause scenarios. The effects of analog and digital low-pass filtering, digitization, and telemetry on the reported spin rate were studied as well. The high frequency phenomena in the spin detector response are masked by the filtering and sampling of the telemetry data. However, the observed spin detector telemetery is consistent with a single rib popping free, and is most likely associated with a rib near the spin detector, or 180 deg opposite.
'Intermittent' solar periodicities
The signal from a stable periodicity can seem to be intermittent when it is partially masked by an unmodelled window function or when the data set is too short to resolve closely spaced periodicities. By taking this into account, short-lived periodicities in solar data can be reinterpreted as evidence for continuously periodic behavior. The periodic sources are located in the solar interior and caused by global oscillation modes. The convective envelope acts as the window for these sources. Recent reports of seven periodicities from 100 to 1000 days are compared with this model. Precise long-term values for the periodicities are predicted and they agree closely with observations. Some elements are suggested that might explain the well-documented 155-day periodicity. Conventional filtering methods to suppress effects of the 11-year cycle are criticized as inadequate.
Technologies for automating rotorcraft nap-of-the-earth flight
This paper discusses the technologies required for automating rotorcraft nap-of-the-earth flight, where the use of natural obstacles for masking from the enemy is intentional and the danger of undesirable obstacles such as enemy traps is real. Specifically, the automatic guidance structure is modeled by three decision-making levels: the far-field mission planning and the mid-field terrain-masking trajectory shaping are both driven by prestored terrain data, whereas the nearfield obstacle detection/avoidance is driven by real-time on-board sensor data. This paper summarizes the far-field and mid-field accomplishments, and reports on the status of the more-recent efforts in obstacle detection and avoidance development. Obstacle detection is based primarily on passive imaging sensors for the desirable properties of covertness and wide field of view, although active sensors are included in the structure to provide the much needed high resolution for thin-wire detection.
Discrimination of Biomass Burning Smoke and Clouds in MAIAC Algorithm
The multi-angle implementation of atmospheric correction (MAIAC) algorithm makes aerosol retrievals from MODIS data at 1 km resolution providing information about the fine scale aerosol variability. This information is required in different applications such as urban air quality analysis, aerosol source identification etc. The quality of high resolution aerosol data is directly linked to the quality of cloud mask, in particular detection of small (sub-pixel) and low clouds. This work continues research in this direction, describing a technique to detect small clouds and introducing the smoke test to discriminate the biomass burning smoke from the clouds. The smoke test relies on a relative increase of aerosol absorption at MODIS wavelength 0.412 micrometers as compared to 0.47-0.67 micrometers due to multiple scattering and enhanced absorption by organic carbon released during combustion. This general principle has been successfully used in the OMI detection of absorbing aerosols based on UV measurements. This paper provides the algorithm detail and illustrates its performance on two examples of wildfires in US Pacific North-West and in Georgia/Florida of 2007.
Automated Assembly Progress Monitoring in Modular Construction Factories Using Computer Vision-Based Instance Segmentation
Modular construction has recently gained interest as a transformative construction method. In this method, a large portion of the construction is performed inside factories, where processes are fast-paced and interdependent; therefore, any deviation from the schedule can delay the production. Such deviations are frequent in modular factories due to the labor-intensive nature of the tasks. This propagation of delays can be mitigated by continuously monitoring each process; however, current manual monitoring methods are laborious, and recently proposed contact sensor-based methods are intrusive to the work. In addition, recent computer vision-based monitoring methods inside factories are limited to detection algorithms that fail to provide the pixel-level accuracy required for assembly progress monitoring in highly occluded factory scenes, and they require a large number of manual annotations. Therefore, this paper proposes a method to monitor the installation of subassemblies in modular construction factories using mask R-CNN instance segmentation and improves the data efficiency of the model using a copy-paste augmentation method. This method was validated on the CCTV videos captured from a modular construction factory in the US, resulting in a 9% mAP improvement in segmentation.
CHESS 2025: Spectrometer orthorectified at-sensor radiance from NEON AOP imaging spectroscopy surveys
This dataset provides Level 1 (L1) orthorectified at-sensor radiance derived from measurements collected by the Imaging Spectrometer-1 (NIS-1) onboard the NEON (National Ecological Observatory Network) Airborne Observation Platform (AOP) for the 2025 Colorado Headwaters Ecological Spectroscopy Study (CHESS). NIS-1 captures light reflected from the Earth’s surface in 426 discrete wavelength bands as raw digital numbers (DNs; Level 0). These data are then calibrated to physical units (uW/cm²·sr·nm) following the processing steps described in the NEON Imaging Spectrometer Level 1B Calibrated Radiance Algorithm Theoretical Basis Document (ATBD; Gallery 2022). The data delivered here are the primary inputs for the surface reflectance product in “Custom surface reflectance, shade masks, and equivalent water thickness maps for the Colorado Headwaters Ecological Spectroscopy Study” (Carroll et al. 2026). For intertemporal comparison, the radiance data here are most directly relatable to the v2 radiance data in “NEON AOP Imaging Spectroscopy Survey of Upper East River Colorado Watersheds: Raw-Space Radiance and Observational Variable Dataset” (Goulden et al. 2018), to which the same processing methodology was applied. Together, the radiance and reflectance data enable users to exploit the unique reflection signatures of different surface objects for land cover classification, foliar trait mapping, plant vigor assessment, water content estimation, trace-element identification, and other scientific applications. The data were acquired over three study domains in the Upper Gunnison river basin: the upper East River watershed (CRBU); Almont Triangle and Taylor Canyon (ALMO); and Upper Taylor River watershed (UPTA) between 2025-06-13 and 2025-07-15. Within each domain, data are delivered by flightline as orthorectified and calibrated hyperspectral rasters in Hierarchical Data Format version 5 (HDF5) format, with radiance values provided in uW/cm²·sr·nm on a fixed, uniform Universal Transverse Mercator (UTM) grid at 1 meter spatial resolution. The radiance rasters include all 426 NIS-1 spectral bands, along with associated quality-assurance (QA) and diagnostic and ancillary layers needed for atmospheric correction workflows. Orthorectified radiance is produced from pushbroom spectrometer observations by applying NEON’s radiometric calibration (including bad pixel masking, dark subtract, dark pedestal shift correction, electronic panel ghost correction, grating ghost correction, deblur correction and flat-fielding) and spectral calibration (using spectral response function band centers and full-width at half-maximum intensity), followed by geolocation and regridding to the fixed grid. CHESS Project Description: The Colorado Headwaters Ecological Spectroscopy Study (CHESS) comprised a multi-week airborne remote sensing and field observation campaign in the Upper Gunnison Basin, Colorado, conducted in June and July of 2025. Airborne remote sensing was conducted by the National Ecological Observatory Network Airborne Observation Platform (NEON AOP), concurrent with a field campaign run by the Rocky Mountain Biological Laboratory (RMBL), the Lawrence Berkeley National Laboratory (LBNL) and SLAC National Accelerator Laboratory Watershed Function Science Focus Area (SFA), and NASA-JPL (Jet Propulsion Laboratory) Earth Surface Mineral Dust Source Investigation (EMIT) program. Between June 10 and July 18, 2025, the NEON AOP flight team collected high-resolution aerial imaging spectroscopy and Light Detection and Ranging (LiDAR) data over three domains: the Upper East River (CRBU), Almont Triangle (ALMO), and the Upper Taylor Basin (UPTA). In coordination with the flights, a field campaign acquired ground-truth observations, including observations of vegetation composition, foliar traits, forest demography, and subsurface properties in 18 core sampling areas within the domains. Additional surface water observations were taken at over 380 point locations. All CHESS campaign datasets can be found within the CHESS ESS-DIVE data portal: https://data.ess-dive.lbl.gov/portals/chess. Funding Acknowledgement: Field and remote-sensing data acquisition was performed under a grant from the National Aeronautics and Space Administration (80NSSC24K1005). This work was also supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.
A New ML-Based Adaptive Thinning Methodology to Improve the Impact of AIRS and CrIS Assimilation on Global Tropical Cyclone Forecasts
This work builds on previous research performed by this team to improve the forecast of Tropical Cyclones (TCs) by assimilating AIRS and CrIS radiances into the NASA Global Earth Observing System (GEOS). Past published work demonstrated that the assimilation of radiances with variable density was beneficial to TC forecasting in the GEOS. In the previous setup, a fixed-size moving square named 'TC domain' was activated by the so-called TC-vitals, an international real-time message accessible to all NWP forecasting centers, that documents the existence of a TC, its estimated position, and its size. The information from TC-vitals activated a switch in the GEOS, which allowed to reduce the distance used for thinning AIRS and CrIS data inside a 15 degrees by 15 degrees moving TC domain centered on the storm, so that more data were assimilated in the vicinity of the TC during its lifetime. The methodology produced improved TC analyses and led to better forecasts, particularly related to intensity, without damaging the global forecast skill. In the new version, the adaptive thinning methodology is based on a machine-learning technique. The technique searches for TCs and creates TC masks by using cloud-top temperatures from all geostationary satellites without the need for additional information. It is being trained against the International Best Track Archive for Climate Stewardship (IBTrACS) data base. Once a TC mask is created, a switch identical to the one used in the previous adaptive thinning method is activated, allowing the GEOS to ingest more data in the TC-shaped size-changing domain that follows the storm. As of today, the team has been able to successfully assimilate data inside the ML-detected TC domains. Future work includes an improved capability of reducing false alarm rates (i.e., cloud systems that are erroneously labeled as TCs).
Spatial-frequency response of the limb infrared monitor of the stratosphere
Measurements from the Limb Infrared Monitor of the stratosphere (LIMS) are presented and discussed. From the LIMS design model data, the modulation transfer function (MTF) was calculated for the optical system, the detector field mask, the electronics, and the overall system for each channel. The signal output performance of the instrument was predicted from the system MTF data and model input radiance data for each channel. The MTF measurements made on the flight sensor confirmed the analytical results.
Evaluating the Use of Foundational Chemical Language Models in Multimodal Graph Fusion
Rapid and accurate prediction of the physicochemical properties of molecules given their structures remains a key challenge in cheminformatics. Machine learning approaches offer high-throughput options, but the optimality of inductive biases and data representations are up for debate. For example, BERT-based masked language models (MLMs) can be trained in a self-supervised way on hundreds of millions to billions of readily available SMILES strings. Another option is graph neural networks (GNNs), which can operate directly on molecular structures. Yet, generating accurate molecular geometry is computationally expensive, leading to a relative scarcity in data compared to SMILES strings. It is attractive to combine these two paradigms by pre-training an LM on a large corpus of SMILES strings and embedding these representation into a geometric graph neural network. Despite the promise of such an approach, and contrary to previous studies, we find mixed results with the combination of the LMs and GNNs on several molecule datasets. In particular, we found evidence for improvement on the FreeSolv and QM7 benchmarks, but degraded performance on the ESOL, LIPO and QM9 datasets compared to a GNN baseline.
Snow and Ice Mask for the MODIS Aerosol Products
The atmospheric products have been derived operationally from multichannel imaging data collected with the Moderate Resolution Imaging SpectroRadiometers (MODIS) on board the NASA Terra and Aqua spacecrafts. Preliminary validations of the products were previously reported. Through analysis of more extensive time-series of MODIS aerosol products (Collection 4), we have found that the aerosol products over land areas are slightly contaminated by snow and ice during the springtime snow-melting season. We have developed an empirical technique using MODIS near-IR channels centered near 0.86 and 1.24 pm and a thermal emission channel near 11 pm to mask out these snow-contaminated pixels over land. Improved aerosol retrievals over land have been obtained. Sample results from application of the technique to MODIS data acquired over North America, northern Europe, and northeastern Asia are presented. The technique has been implemented into the MODIS Collection 5 operational algorithm for retrieving aerosols over land from MODIS data.
Mathematical Morphological Filtering with a Self-Adaptive Reconstruction Technique and Application to Local Seismic Data
Recorded seismic data are generally contaminated by noise from different sources, which masks the signals of interest. In the seismology community, frequency filtering (FF) is the standard method for noise suppression. However, when the signal of interest and noise share the same frequency band, the latter cannot be filtered out without infringing on the former. We implemented a noise suppression approach based on the mathematical morphology theorem. The method involves compound operations of dilation and erosion using structuring elements of varying lengths and decomposes an input noisy waveform into several time functions with differing characteristics. Further, the filtered waveform is constructed from the time functions using a self-adaptive reconstruction technique. Application to a data set of >4700 local waveforms suggests that the implemented mathematical morphological filtering (MMF) approach is efficient for data with low signal-to-noise ratio (SNR) and significantly outperforms FF in that SNR range. For most of the dataset, FF, machine learning (ML) denoising, and continuous wavelet transform (CWT) thresholding result in higher SNR values compared with the MMF method. However, for ~42% of the waveforms, MMF outperforms FF, and the SNR gain achieved with MMF is as large as ~23 dB. Compared to ML denoising and CWT thresholding, this proportion drops to only ~10%–14%. Our results suggests that in an operational setting, MMF cannot replace the other noise suppression methods; however, signal detection can be improved if MMF is used to supplement them in some scenarios. MMF could help detect signals in problematic low-SNR data, which are currently being missed particularly when using FF alone.
DMTN-197: Streak Masking in DM Image Processing
Streaks caused by satellites are a persistent problem in optical images, and their occurrence will likely increase in the coming years. Many Hyper Suprime-Cam images are already affected by streaks, and the same is expected for Rubin Observatory data. In the LSST Data Release Production (DRP), most streaks and other artifacts are already detected and masked by the algorithm CompareWarpAssembleCoadd. However, some streaks are not caught at this stage and can contaminate the final coadds and detection catalogs. To find and mask these, we adopt a morphologically-based method for detecting streaks, which uses the Kernel-Based Hough Transform to detect straight lines. Once the lines are detected, the streak profile is fit and the affected portion of the image is masked out. This algorithm, maskStreaks, is included in the meas_algorithms package and is used in CompareWarpAssembleCoadd to remove streaks from coadds. Similar implementation in the Alert Production Pipeline is possible but has not been implemented.
The solar wind interaction with Mars as seen by the Viking retarding potential analyzers
Both energy spectra and continuous monitoring periods of the total flux above 15 eV are available, from Viking retarding potential analyzer measurements of electron fluxes not exceeding 75 eV out to 16,000 km above the Mars surface. Although the mean electron current at energies above 15 eV increases monotonically by almost two orders of magnitude from 9000 to 700 km in Viking 1 data, no clear signature of the bow shock is seen. Total current wave power shows a peak near 1700 km altitude. It is suggested that there may be a highly turbulent shock structure masking a clear signature of the bow shock in the time-averaged data, and it is concluded that the interaction model consistent with the bow shock at 1700 km, together with ionosphere measurements, indicates a permanent magnetic field able to stand off the solar wind during the Viking 1 entry.