Search NASA⌕ Search

SEARCH · Search NASA

Results for “Gap Filling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

The CACAO Method for Smoothing, Gap Filling, and Characterizing Seasonal Anomalies in Satellite Time Series

Consistent, continuous, and long time series of global biophysical variables derived from satellite data are required for global change research. A novel climatology fitting approach called CACAO (Consistent Adjustment of the Climatology to Actual Observations) is proposed to reduce noise and fill gaps in time series by scaling and shifting the seasonal climatological patterns to the actual observations. The shift and scale CACAO parameters adjusted for each season allow quantifying shifts in the timing of seasonal phenology and inter-annual variations in magnitude as compared to the average climatology. CACAO was assessed first over simulated daily Leaf Area Index (LAI) time series with varying fractions of missing data and noise. Then, performances were analyzed over actual satellite LAI products derived from AVHRR Long-Term Data Record for the 1981-2000 period over the BELMANIP2 globally representative sample of sites. Comparison with two widely used temporal filtering methods-the asymmetric Gaussian (AG) model and the Savitzky-Golay (SG) filter as implemented in TIMESAT-revealed that CACAO achieved better performances for smoothing AVHRR time series characterized by high level of noise and frequent missing observations. The resulting smoothed time series captures well the vegetation dynamics and shows no gaps as compared to the 50-60% of still missing data after AG or SG reconstructions. Results of simulation experiments as well as confrontation with actual AVHRR time series indicate that the proposed CACAO method is more robust to noise and missing data than AG and SG methods for phenology extraction.

LAI↗

Climate Forcing Datasets for Agricultural Modeling: Merged Products for Gap-Filling and Historical Climate Series Estimation

The AgMERRA and AgCFSR climate forcing datasets provide daily, high-resolution, continuous, meteorological series over the 1980-2010 period designed for applications examining the agricultural impacts of climate variability and climate change. These datasets combine daily resolution data from retrospective analyses (the Modern-Era Retrospective Analysis for Research and Applications, MERRA, and the Climate Forecast System Reanalysis, CFSR) with in situ and remotely-sensed observational datasets for temperature, precipitation, and solar radiation, leading to substantial reductions in bias in comparison to a network of 2324 agricultural-region stations from the Hadley Integrated Surface Dataset (HadISD). Results compare favorably against the original reanalyses as well as the leading climate forcing datasets (Princeton, WFD, WFD-EI, and GRASP), and AgMERRA distinguishes itself with substantially improved representation of daily precipitation distributions and extreme events owing to its use of the MERRA-Land dataset. These datasets also peg relative humidity to the maximum temperature time of day, allowing for more accurate representation of the diurnal cycle of near-surface moisture in agricultural models. AgMERRA and AgCFSR enable a number of ongoing investigations in the Agricultural Model Intercomparison and Improvement Project (AgMIP) and related research networks, and may be used to fill gaps in historical observations as well as a basis for the generation of future climate scenarios.

Climate Forcing Data↗

Spectral Gap Filling Method Using the Spectral Information from CLARREO-Pathfinder Measured Earth-Reflected Solar Spectra to Support CPF-CERES Intercalibration

The high-accuracy Earth-reflected solar spectral radiances from CLARREO Pathfinder (CPF) will serve as in-orbit benchmark measurements for intercalibrating other satellite imagers. The CPF team is developing a state-of-the-art intercalibration method to calibrate the shortwave channel (300-5000 nm) of the CERES instrument against the CPF reference with an uncertainty of 0.3%. Because the CPF instrument only covers spectral range from 350 nm to 2300 nm, the team has developed a spectral extension method to fill in the gaps between the spectral domains of CPF and the CERES shortwave channel. The method solely relies on using the hyperspectral information from the CPF wavelengths to predict the radiances below 350 nm and above 2300 nm. To quantify the relationship between the CPF spectrum and the non-overlapping portions of the spectrum between CPF and CERES, the team has simulated a large ensemble of spectra that cover the spectral range for both CPF and CERES. A hyperspectral bidirectional reflectance model for land surface based on thousands of measured land surface reflectance has been developed. This land surface model as well as the Cox-Munk model for ocean surface are used in the spectral gap filling. Various water/ice clouds, aerosols, atmosphere profiles and surfaces were used to simulate Earth-reflected radiances from 200 nm to 15 um under different solar and sensor geometries. The targeted uncertainty for the CPF-extended broadband CERES radiances is less than 0.1%. The previously derived training spectra were updated to replace the Kurucz solar irradiance model with the TSIS-1 Hybrid Solar Reference Spectrum. The influence of the scalar assumption in radiative transfer model equations on the uncertainty in estimating the broadband radiances was also investigated.

Hyperspectral↗

Vegetation Phenology Metrics Derived from Temporally Smoothed and Gap-filled MODIS Data

Smoothed and gap-filled VI provides a good base for estimating vegetation phenology metrics. The TIMESAT software was improved by incorporating the ancillary information from MODIS products. A simple assessment of the association between retrieved greenup dates and ground observations indicates satisfactory result from improved TIMESAT software. One application example shows that mapping Nectar Flow Phenology is tractable on a continental scale using hive weight and satellite vegetation data. The phenology data product is supporting more researches in ecology, climate change fields.

Tan, Bin↗

Principal Component and Machine Learning Approach to Gap Fill Hyperspectral Ocean Color Satellite Retrievals

Retrievals of ocean color properties from space are important for monitoring the health of the ocean ecosystem but such retrievals can be limited spatially due to conditions such as clouds, aerosols, and sun glint. Gap filling of ocean color retrievals is typically performed by combining retrievals from multiple satellites or temporally averaging multiple days of retrievals. Despite these techniques large gaps still exist posing challenges for near real time monitoring of events like harmful algae blooms. To address these limitations, we developed a spatial gap filling approach applying machine learning approach to hyperspectral instruments to learn how to perform an atmospheric correction under challenging retrieval conditions. In this approach a principal component analysis is used to decompose the hyperspectral measurements into spectral components that describe the scattering and absorption of the atmosphere mixed with the surface spectral signatures. The coefficients of the principal components are used to train a neural network to predict ocean color properties derived from a standard MODIS ocean color algorithm. We apply the approach to two hyperspectral UV/VIS sensors, the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can be used to estimate ocean color properties such as chlorophyll, remote sensing reflectance, and fluorescence line height. This method could be used as a gap-filling technique for the future Ocean Color Instrument (OCI) onboard upcoming NASA's Plankton, Aerosol Cloud, ocean Ecosystem (PACE) satellite to provide additional information for monitoring the health of our global oceans. Additionally, it could be applied to the first NASA and Smithsonian geostationary Tropospheric Emissions: Monitoring of Pollution (TEMPO) spectrometer to better understand diurnal variability in inland and coastal ocean ecology.

Zachary Fasnacht↗

A Principal Component and Machine Learning Approach to Spatially Gap Fill Hyperspectral Ocean Color Satellite Retrievals

Retrievals of ocean color properties from space are important for monitoring the health of the ocean ecosystem but such retrievals tend to be limited in spatial coverage due to conditions such as clouds, aerosols, and sun glint. Gap filling of ocean color retrievals is typically performed by combining retrievals from multiple satellites or temporally averaging multiple days of retrievals but despite these techniques large gaps still exist posing challenges for near real time monitoring of events like harmful algae blooms. To address these limitations, we propose a spatial gap filling approach using machine learning to learn how to perform an atmospheric correction under challenging retrieval conditions. In this approach a principal component analysis is used to decompose the hyperspectral measurements into spectral features that describe the scattering and absorption of the atmosphere as well as the underlying surface. The coefficients of the principal components are then used to train a neural network to predict ocean color properties derived from a standard ocean color algorithm such as the MODIS atmospheric correction algorithm. This machine learning approach is independent of a priori information and does not rely on any radiative transfer modeling. We apply the approach to two hyperspectral UV/VIS instruments, the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) to show that it can be used to estimate ocean color properties such as chlorophyll, remote sensing reflectance, and fluorescence line height. This method could be used as a gap-filling technique for the future Ocean Color Instrument (OCI) which will be onboard NASA's Plankton, Aerosol Cloud, ocean Ecosystem (PACE) ocean color satellite to provide additional information for monitoring the health of our global oceans. Additionally, it could be applied to the geostationary satellite Tropospheric Emissions: Monitoring of Pollution (TEMPO) to better understand diurnal variability in ocean ecology.

MODIS atmospheric correction algorithm↗

A Novel Machine Learning-Based Gap-Filling of Fine-Resolution Remotely Sensed Snow Cover Fraction Data By Combining Downscaling and Regression

Satellite-based remotely sensed observations of snow cover fraction (SCF) can have data gaps in spatially distributed coverage from sensor and orbital limitations. We mitigate these limitations in the example fine-resolution Moderate Resolution Imaging Spectroradiometer (MODIS) data by gap-filling using auxiliary 1-km datasets that either aid in downscaling from coarser-resolution (5 km) MODIS SCF wherever not fully covered by clouds, or else by themselves via regression wherever fully cloud covered. This study’s prototype predicts a 1-km version of the 500-m MOD10A1 SCF target. Due to noncollocatedness of spatial gaps even across input and auxiliary datasets, we consider a recent gap-agnostic advancement of partial convolution in computer vision for both training and predictive gap-filling. Partial convolution accommodates spatially consistent gaps across the input images, effectively implementing a two-dimensional masking. To overcome reduced usable data from noncollocated spatial gaps across inputs, we innovate a fully generalized three-dimensional masking in this partial convolution. This enables a valid output value at a pixel even if only a single valid input variable and its value exist in the neighborhood covered by the convolutional filter zone centered around that pixel. Thus, our gap-agnostic technique can use significantly more examples for training (∼67%) and prediction (∼100%), instead of only less than 10% for the previous partial convolution. We train an example simple three-layer legacy super-resolution convolutional neural network (SRCNN) to obtain downscaling and regression component performances that are better than baseline values of either climatology or MOD10C1 SCF as relevant. Our generalized partial convolution can enable multiple Earth science applications like downscaling, regression, classification, and segmentation that were hindered by data gaps.

Soni Yatheendradas↗

Development and Evaluation of a Cloud-Gap-Filled MODIS Daily Snow-Cover Product

The utility of the Moderate Resolution Imaging Spectroradiometer (MODIS) snow-cover products is limited by cloud cover which causes gaps in the daily snow-cover map products. We describe a cloud-gap-filled (CGF) daily snowcover map using a simple algorithm to track cloud persistence, to account for the uncertainty created by the age of the snow observation. Developed from the 0.050 resolution climate-modeling grid daily snow-cover product, MOD10C1, each grid cell of the CGF map provides a cloud-persistence count (CPC) that tells whether the current or a prior day was used to make the snow decision. Percentage of grid cells "observable" is shown to increase dramatically when prior days are considered. The effectiveness of the CGF product is evaluated by conducting a suite of data assimilation experiments using the community Noah land surface model in the NASA Land Information System (LIS) framework. The Noah model forecasts of snow conditions, such as snow-water equivalent (SWE), are updated based on the observations of snow cover which are obtained either from the MOD1 OC1 standard product or the new CGF product. The assimilation integrations using the CGF maps provide domain averaged bias improvement of -11 %, whereas such improvement using the standard MOD1 OC1 maps is -3%. These improvements suggest that the Noah model underestimates SWE and snow depth fields, and that the assimilation integrations contribute to correcting this systematic error. We conclude that the gap-filling strategy is an effective approach for increasing cloud-free observations of snow cover.

Hall, Dorothy K.↗

Evaluation of MODIS and VIIRS Cloud-Gap-Filled Snow-Cover Products for Production of an Earth Science Data Record

MODerate resolution Imaging Spectroradiometer (MODIS) cryosphere products have been available since 2000 – following the 1999 launch of the Terra MODIS and the 2002 launch of the Aqua MODIS – and include global snow-cover extent (SCE) (swath, daily, and 8 d composites) at 500 m and ∼5 km spatial resolutions. These products are used extensively in hydrological modeling and climate studies. Reprocessing of the complete snow-cover data record, from Collection 5 (C5) to Collection 6 (C6) and Collection 6.1 (C6.1), has provided improvements in the MODIS product suite. Suomi National Polar-orbiting Partnership (S-NPP) Visible Infrared Imaging Radiometer Suite (VIIRS) Collection 1 (C1) snow-cover products at a 375 m spatial resolution have been available since 2011 and are currently being reprocessed for Collection 2 (C2). Both the MODIS C6.1 and the VIIRS C2 products will be available for download from the National Snow and Ice Data Center beginning in early 2020 with the complete time series available in 2020. To address the need for a cloud-reduced or cloud-free daily SCE product for both MODIS and VIIRS, a daily cloud-gap-filled (CGF) snow-cover algorithm was developed for MODIS C6.1 and VIIRS C2 processing. MOD10A1F (Terra) and MYD10A1F (Aqua) are daily, 500 m resolution CGF SCE map products from MODIS. VNP10A1F is the daily, 375 m resolution CGF SCE map product from VIIRS. These CGF products include quality-assurance data such as cloud-persistence statistics showing the age of the observation in each pixel. The objective of this paper is to introduce the new MODIS and VIIRS standard CGF daily SCE products and to provide a preliminary evaluation of uncertainties in the gap-filling methodology so that the products can be used as the basis for a moderate-resolution Earth science data record (ESDR) of SCE. Time series of the MODIS and VIIRS CGF products have been developed and evaluated at selected study sites in the US and southern Canada. Observed differences, although small, are largely attributed to cloud masking and differences in the time of day of image acquisition. A nearly 3-month time-series comparison of Terra MODIS and S-NPP VIIRS CGF snow-cover maps for a large study area covering all or parts of 11 states in the western US and part of southwestern Canada reveals excellent correspondence between the Terra MODIS and S-NPP VIIRS products, with a mean difference of 11 070 sqkm, which is ∼0.45 % of the study area. According to our preliminary validation of the Terra and Aqua MODIS CGF SCE products in the western US study area, we found higher accuracy of the Terra product compared with the Aqua product. The MODIS CGF SCE data record beginning in 2000 has been extended into the VIIRS era, which should last at least through the early 2030s.

Hall, Dorothy K.↗

One-Dimensional Model for the Ultrasonic Response of Resin-Filled Gaps in Automated Tape Layup Composites

Automated tow placement has become a widely used fabrication technique, especially for large aerospace structures. Robotic heads lay down strips (tows) of preimpregnated fiber along programmed paths. The intention is to lay adjacent tows abutted to one another, but sometimes a gap is left between a tow and the previously-placed tow. If a tow gap exists, it fills with resin during cure, forming a fiber-free volume. In immersion ultrasonic pulse-echo measurements of a cured laminate, the gap can be observed to produce a noticeable echo, without significantly attenuating the back-wall reflection of the laminate. To understand this behavior, we considered a one dimensional model of the composite laminate, with a thin layer having the ultrasonic sound speed and density of neat resin, sandwiched between two layers of material having the sound speed and density of fiber-reinforced composite and surrounded on both sides by water. Neglecting attenuation, we considered the transmission and reflection coefficients of each interface, as well as that of the thin resin layer. Using the initial water/composite reflection as a reference, we computed the relative magnitude of the back surface/water reflection in the presence and in the absence of a resin-only layer, as well as the relative magnitude of the reflection arising from a thin resin layer in composite. While the one-dimensional model did not fully match the measurements, it did qualitatively explain the observed behavior.

Johnston, Patrick H.↗

Short Data Gap Filling Algorithm Prototype

This design note describes an algorithm to fill short data gaps encountered in pixel or flux time series using auto-regressive modeling techniques.

Chandrasekaran, Hema↗

Training and Validation of Spectral Gap Filling Algorithm for Cpf-Ceres Intercalibration

The Climate Absolute Radiance and Refractivity Observatory (CLARREO) Pathfinder (CPF) mission is set to launch an SI-traceable reflective solar (RS) spectrometer aboard the International Space Station to measure Earth-reflected solar radiation with a radiometric uncertainty of 0.3% (k=1). The CPF intercalibration team has devised a cutting-edge methodology to accurately transfer the benchmark CPF calibration reference to the shortwave (SW) channel (200-5000 nm) of the Clouds and the Earth’s Radiant Energy System (CERES) instrument. The spectral range of CPF measurements spans from 350-2300 nm, while the CERES SW channel measures the Earth-reflected broadband solar radiances between 200 nm to 5 μm. To conduct precise CPF-CERES intercalibration analysis, the CPF-like spectral radiances outside the CPF spectral range need to be estimated to match the CERES SW spectral range. In response, the team has developed a fast algorithm that leverages spectrally redundant information within the CPF-measured portion through principal component analysis (PCA) and utilizes pre-established spectral correlation relationships among wavelengths to extend the CPF spectrum below 350 nm and above 2300 nm. Our results show that the algorithm achieves excellent accuracy in generating the missing energy in the UV and IR portions. The RMS error in the UV region is less than 4.5x10-3 W/m2/sr/nm, while in the IR region, it is smaller than 8x10-5 W/m2/sr/nm. Our methodology was validated using measured EMIT radiance data, which covers the spectral range from 0.381 μm to 2.493 μm. We employed EMIT radiances within the wavelength range of 0.43 – 2.25 μm to generate radiances for both the shorter wavelength range (0.381 – 0.43 μm) and longer wavelength range (2.25 – 2.493 μm). The generated radiances agree very well with the measured EMIT radiances. The standard deviation in the integrated broadband radiances was about 0.1%, and the bias is less than 0.004% for over 1.5 million EMIT measured samples. These statistics show that the spectral gap filling algorithm is robust and effective in substantially reducing the spectral difference-induced uncertainty in the CPF-CERES intercalibration samples.

Qiguang Yang↗

Thermoplastic Ribbon-Ply Bonding Model

The aim of the present work was to identify key variables in rapid weldbonding of thermoplastic tow (ribbon) and their relationship to matrix polymer properties and to ribbon microstructure. Theoretical models for viscosity, establishment of ply-ply contact, instantaneous (Velcro) bonding, molecular interdiffusion (healing), void growth suppression, and gap filling were reviewed and synthesized. Consideration of the theoretical bonding mechanisms and length scales and of the experimental weld/peel data allow the prediction of such quantities as the time and pressure required to achieve good contact between a ribbon and a flat substrate, the time dependence of bond strength, pressures needed to prevent void growth from dissolved moisture and conditions for filling gaps and smoothing overlaps.

Hinkley, Jeffrey A.↗

The 0.5-2.22 micrometer Scattered Light Spectrum of the Disk around TW Hya: Detection of a Partially Filled Disk Gap at 80 AU*

We present a 0.5-2.2 micrometer scattered light spectrum of the circumstellar disk around TW Hya from a combination of spatially resolved Hubble Space Telescope STIS spectroscopy and NICMOS coronagraphic images of the disk. We investigate the morphology of the disk at distances greater than 40 AU over this wide range of wavelengths, and identify the presence of a depression in surface brightness at approximately 80 AU that could be caused by a gap in the disk. Additionally, we quantify the surface brightness, azimuthal symmetry, and spectral character of the disk as a function of radius. Our analysis shows that the scattering efficiency of the dust is largely neutral to blue over the observed wavelengths. We model the disk as a steady α-disk with an ad hoc gap structure. The thermal properties of the disk are selfconsistently calculated using a three-dimensional radiative transfer code that uses ray tracing to model the heating of the disk interior and scattered light images. We find a good fit to the data over a wide range of distances from the star if we use a model disk with a partially filled gap of 30% depth at 80 AU and with a self-similar truncation knee at 100 AU. The origin of the gap is unclear, but it could arise from a transition in the nature of the disk's dust composition or the presence of a planetary companion. Based on scalings to previous hydrodynamic simulations of gap-opening criteria for embedded proto-planets, we estimate that a planetary companion forming the gap could have a mass between 6 and 28 solar mass.

radiative transfer↗

Filling the Gaps in Understanding Solar Flares

Solar flares provide a laboratory for plasma physics and magnetohydrodynamic processes. While the mechanism of transferring magnetic flux between topological domains via reconnection is accepted in a general sense, some of the finer details remain to be worked out: What elusive thresholds, pertaining to which physical quantities, determine the initiation of flux transfer that cascades into the energy release observed in the impulsive phase of a flare? What role does turbulence play in accelerating or prolonging magnetic reconnection? To what degree do magnetic waves contribute to the transport of energy, or to the acceleration of particles in the impulsive phase? While our innate human curiosity and our instinctive impulse to explore compel us to investigate these intricacies of million-degree magnetized plasmas, the impacts of space weather on our technology-dependent society and economy obligate us to pursue a quantitative understanding, with the ultimate goal being trustworthy predictive capabilities. In this presentation, I will touch upon a few aspects of solar flares where improvements in observational and analytical capabilities can be expected to help us fill gaps in our understanding, as well as some of the recent, current, and near-term developments that are carrying the field forward.

David E. McKenzie↗

Feasibility Assessment of Thermal Barrier Seals for Extreme Transient Temperatures

The assembly joints of modem solid rocket motor cases are generally sealed using conventional O-ring type seals. The 5500+ F combustion gases produced by rocket motors are kept a safe distance away from the seals by thick layers of phenolic insulation. Special compounds are used to fill insulation gaps leading up to the seals to prevent a direct flowpath to them. Design criteria require that the seals should not experience torching or charring during operation, or their sealing ability would be compromised. On limited occasions, NASA has observed charring of the primary O-rings of the Space Shuttle solid rocket nozzle assembly joints due to parasitic leakage paths opening up in the gap-fill compounds during rocket operation. NASA is investigating different approaches for preventing torching or charring of the primary O-rings. One approach is to implement a braided rope seal upstream of the primary O-ring to serve as a thermal barrier that prevents the hot gases from impinging on the O-ring seals. This paper presents flow, resiliency, and thermal resistance for several types of NASA rope seals braided out of carbon fibers. Burn tests were performed to determine the time to burn through each of the seals when exposed to the flame of an oxyacetylene torch (5500 F), representative of the 5500 F solid rocket motor combustion temperatures. Rope seals braided out of carbon fibers endured the flame for over six minutes, three times longer than solid rocket motor burn time. Room and high temperature flow tests are presented for the carbon seals for different amounts of linear compression. Room temperature compression tests were performed to assess seal resiliency and unit preloads as a function of compression. The thermal barrier seal was tested in a subscale "char" motor test in which the seal sealed an intentional defect in the gap insulation. Temperature measurements indicated that the seal blocked 2500 F combustion gases on the upstream side with very little temperature rise on the downstream side.

Steinetz, Bruce M.↗