SEARCH · Search NASA

Results for “Erroneous measurements filter”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

18 records

All sources NASA NTRS DOE OSTI

NASA NTRS2023

The Historical Greenland Climate Network (GC-Net) Curated and Augmented Level-1 Dataset

The Greenland Climate Network (GC-Net) consists of 31 automatic weather stations (AWSs) at 30 sites across the Greenland Ice Sheet. The first site was initiated in 1990, and the project has operated almost continuously since 1995 under the leadership of the late Konrad Steffen. The GC-Net AWS measured air temperature, relative humidity, wind speed, atmospheric pressure, downward and reflected shortwave irradiance, net radiation, and ice and firn temperatures. The majority of the GC-Net sites were located in the ice sheet accumulation area (17 AWSs), while 11 AWSs were located in the ablation area, and two sites (three AWSs) were located close to the equilibrium line altitude. Additionally, three AWSs of similar design to the GC-Net AWS were installed by Konrad Steffen's team on the Larsen C ice shelf, Antarctica. After more than 3 decades of operation, the GC-Net AWSs are being decommissioned and replaced by new AWSs operated by the Geological Survey of Denmark and Greenland (GEUS). Therefore, making a reassessment of the historical GC-Net AWS data is necessary. We present a full reprocessing of the historical GC-Net AWS dataset with increased attention to the filtering of erroneous measurements, data correction and derivation of additional variables: continuous surface height, instrument heights, surface albedo, turbulent heat fluxes, and 10 m ice and firn temperatures. This new augmented GC-Net level-1 (L1) AWS dataset is now available at https://doi.org/10.22008/FK2/VVXGUT (Steffen et al., 2023) and will continue to be refined. The processing scripts, latest data and a data user forum are available at https://github.com/GEUS-Glaciology-and-Climate/GC-Net-level-1-data-processing (last access: 30 November 2023). In addition to the AWS data, a comprehensive compilation of valuable metadata is provided: maintenance reports, yearly pictures of the stations and the station positions through time. This unique dataset provides more than 320 station years of high-quality atmospheric data and is available following FAIR (findable, accessible, interoperable, reusable) data and code practices.

Greenland Climate Network↗

DOE OSTI2022

Nanoindentation mapping defects filtration for heterogeneous materials using generative adversarial networks

Advanced composite materials with multiple phases and heterogeneous microstructure necessitate spatial mapping characterization of elastic modulus to develop constitutive relations and overall mechanical response. Such modulus mapping can be obtained using the nanoindentation technique, where the indenter tip raster over the selected microstructure region. Typically, a surface preparation procedure is done in the specimens to ensure proper contact between the indenter tip and sample surface. However, a near-perfect surface finish is unachievable in heterogeneous materials, primarily with ceramic reinforcements, due to the differential material removal rate during polishing. Thus, the nanoindenter records localized erroneous measurements due to differences in surface roughness and corresponding force response. This study establishes a novel deep learning-based strategy to rectify incorrect experimental spatial measurements acquire during nanoindentation modulus mapping. Here, the integrated bicubic interpolation and generative adversarial networks (GANs) model was trained using 14 ceramic and 18 metallic data sets, each comprising 65,536 measurements. The developed algorithm was validated against experimental measurements on four unknown specimens. The standard deviation in measured elastic modulus reduces by ~50% in ceramics and ~72% in metallic samples. This computational framework proposes a novel approach to reducing uncertainty in materials’ properties using state-of-the-art computer vision techniques.

36 MATERIALS SCIENCE↗

NASA NTRS2000

Calibration of a Spacecraft Gyro Quadruplet

This work presents a new approach to gyro calibration where, in addition to being used for computing attitude that is needed in the calibration process, the gyro outputs are also used as measurements in a Kalman filter. Gyro calibration as well as calibration of other instruments occurs in two steps. In the first step, the instrument error parameters are estimated. During the second stage, those errors are continuously removed from the gyro readings. In the classical approach to gyro calibration, the gyro outputs are used to maintain or compute body orientation rather than being used as measurements in the context of filtering. In inertial navigation, for example, gyro errors cause erroneous computation of velocity and position, and then when the latter are compared to measured velocity and position, a great portion of the computed velocity and position errors can be determined. The latter errors are then fed into a Kalman filter (KF) that uses the INS error model to infer on the gyro errors. Similarly, when applying the classical approach to spacecraft (SC) altitude determination, the gyro outputs are used to compute the attitude and then attitude measurements are used to determine the attitude errors, which again using a KF, indicates what the gyro errors are. In the approach adopted in this work the gyro outputs are used as angular rate measurements and are compared to estimated angular rate measurements. However, this approach requires the knowledge of the angular rate. In the past, the estimated angular rate was computed in a rather simplistic way assuming that the rate was constant. In the present work, the estimated angular rate is derived using a KF whose input can be any kind of attitude measurement, therefore the angular rate experienced by the SC can be continuously changing, and yet a good estimate of the rate, necessary for calibration, can be obtained.

Harman, Richard R.↗

NASA NTRS2005

Hubble Space Telescope Angular Velocity Estimation During the Robotic Servicing Mission

In 2004 NASA began investigation of a robotic servicing mission for the Hubble Space Telescope (HST). Such a mission would require estimates of the HST attitude and rates in order to achieve a capture by the proposed Hubble robotic vehicle (HRV). HRV was to be equipped with vision-based sensors, capable of estimating the relative attitude between HST and HRV. The inertial HST attitude is derived from the measured relative attitude and the HRV computed inertial attitude. However, the relative rate between HST and HRV cannot be measured directly. Therefore, the HST rate with respect to inertial space is not known. Two approaches are developed to estimate the HST rates. Both methods utilize the measured relative attitude and the HRV inertial attitude and rates. First, a nonlinear estimator is developed. The nonlinear approach estimates the HST rate through an estimation of the inertial angular momentum. The development includes an analysis of the estimator stability given errors in the measured attitude. Second, a linearized approach is developed. The linearized approach is a pseudo-linear Kalman filter. Simulation test results for both methods are given, including scenarios with erroneous measured attitudes. Even though the development began as an application for the HST robotic servicing mission, the methods presented are applicable to any rendezvous/capture mission involving a non-cooperative target spacecraft.

Thienel, Julie K.↗

NASA NTRS2000

Thermal Characteristics of Pyranometers and Pyrgeometers in Atmosphere-Surface Energetic Measurements

Tsay, Si-Chee↗

NASA NTRS2000

Characterization of Thermal Parameters for Improving Pyranometer and Pyrgeometer Measurements

Since the introduction of thermopile, pyranometers (solar, e.g., 0.3-3.0 micrometers) and pyrgeometers (terrestrial, e.g., 4-50 micrometers) have become instruments commonly used for measuring the broadband hemispherical irradiances at the surface in a long-term, monitoring mode for decades. These commercially available radiometers have been manufactured in several countries such as from the United States, Asia, and Europe, and are generally reliable and economical. These worldwide distributions of surface measurements become even more important in the era of Earth remote sensing in studying climate change. However, recent studies from field campaigns have pointed out that erroneous factors (e.g., temperature gradients between the filter dome and detector, emissivity of the thermopile) are responsible for the unacceptable level of uncertainty (e.g., 20 W m(exp -2)). Using a newly developed instrument of Quantum Well Infrared Photodetector (QWTP), we have characterized the brightness temperature fields of pyranometers and pyrgeometers under various sky conditions. The QWIP is based on the superlattice (GaAs/AlGaAs) technology and has a noise equivalent temperature (NEAT) less than 0.1 K. The quality of pyranometer and pyrgeometer measure- ments can be improved largely by applying proper knowledge of the thermal parameters affecting the operation of the thermopile systems. Data correction procedure and algorithm will be presented and discussed.

Tsay, Si-Chee↗

NASA NTRS1999

On the Dome Effect of Flux Radiometers to Radiative Forcing

Since the introduction of thermopile, pyranometers (solar, e.g., 0.3-3.0 microns) and pyrgeometers (terrestrial, e.g., 4-50 microns) have become instruments commonly used for measuring the broadband hemispherical irradiances at the surface in a long-term, monitoring mode for decades. These commercially available radiometers have been manufactured in several countries such as from the United States, Asia, and Europe, and are generally reliable and economical. These worldwide distributions of surface measurements become even more important in the era of Earth remote sensing in studying climate forcing. However, recent studies from field campaigns have pointed out that erroneous factors (e.g., temperature gradients between the filter dome and detector, emissivity of the thermopile) are responsible for the unacceptable level of uncertainty (e.g., 10-20 W/square Meter). Using a newly developed instrument of Quantum Well Infrared Photodetector (QWIP), we have characterized the brightness temperature fields of pyranometers and pyrgeometers under various sky conditions. The QWIP is based on the superlattice (GaAs/AlGaAs) technology and has a noise equivalent temperature (NE delta T) less than 0.1 K. The quality of pyranometer and pyrgeometer measurements can be improved largely by applying proper knowledge of the thermal parameters affecting the operation of the thermopile systems. For example, we show a method to determine the "dome factor" (the longwave emission divided by the longwave transmission of a pyrgeometer dome) from field measurements. The results show, and are verified independently by the QWIP, that our dome factors of 0.59 and 0.90 are much smaller than the value of 4.0 assumed by the WMO. Data correction procedure and algorithm will be presented and discussed.

Tsay, S.-C.↗

NASA NTRS1999

On the Dome Effect of Flux Radiometers to Radiative Forcing

Since the introduction of thermopile, pyranometers (solar, e.g., 0.3-3.0 micrometers) and pyrgeometers (terrestrial, e.g., 4-50 micrometers) have become instruments commonly used for measuring the broadband hemispherical irradiances at the surface in a long-term, monitoring mode for decades. These commercially available radiometers have been manufactured in several countries such as from the United States, Asia, and Europe, and are generally reliable and economical. These worldwide distributions of surface measurements become even more important in the era of Earth remote sensing in studying climate forcing. However, recent studies from field campaigns have pointed out that erroneous factors (e.g., temperature gradients between the filter dome and detector, emissivity of the thermopile) are responsible for the unacceptable level of uncertainty (e.g., 10-20 W m (exp -2)). Using a newly developed instrument of Quantum Well Infrared Photodetector (QWIP), we have characterized the brightness temperature fields of pyranometers and pyrgeometers under various sky conditions. The QWIP is based on the superlattice (GaAs/AlGaAs) technology and has a noise equivalent temperature (NE delta T) less than 0.1 K. The quality of pyranometer and pyrgeometer measurements can be improved largely by applying proper knowledge of the thermal parameters affecting the operation of the thermopile systems. For example, we show a method to determine the "dome factor" (the longwave emission divided by the longwave transmission of a pyrgeometer dome) from field measurements. The results show, and are verified independently by the QWIP, that our dome factors of 0.59 and 0.90 are much smaller than the value of 4.0 assumed by the WMO (World Meteorological Organization). Data correction procedure and algorithm will be presented and discussed.

Tsay, S.-C.↗

NASA NTRS1983

Baseline ozone results from 1923 to 1955

Baseline total atmospheric ozone values from the year 1923 to 1955 are reported which have been derived from observations of the solar constant made by Smithsonian Institution sites in both the Northern and Southern Hemispheres. Ozone was determined from absorption by the broad, weak Chappuis band near 0.6 microns as measured on 1194 days at Mt. Montezuma, Chile and 970 days at Table Mountain, California. Results show systematic changes on the order of 25 percent in the ozone level at Montezuma with a time scale of 10-20 years, although the previously reported 30 percent decrease between 1920-1930 and 1940-1950 is found to have been erroneous. Comparisons of ozone data with geomagnetic indices and sunspot number show a suggestive correlation of ozone with sunspot number, although the relation is not borne out by comparison of ozone and sunspot cycles, or by Fourier analysis. Comparison of ozone data in the Chappuis band obtained by a modern filter-wheel radiometer with that obtained from a Dobson spectrometer at Mauna Loa Observatory shows Chappuis band measurements to be 14 percent lower.

Angione, R. J.↗

NASA NTRS2010

The Invigoration of Deep Convective Clouds Over the Atlantic: Aerosol Effect, Meteorology or Retrieval Artifact?

Associations between cloud properties and aerosol loading are frequently observed in products derived from satellite measurements. These observed trends between clouds and aerosol optical depth suggest aerosol modification of cloud dynamics, yet there are uncertainties involved in satellite retrievals that have the potential to lead to incorrect conclusions. Two of the most challenging problems are addressed here: the potential for retrieved aerosol optical depth to be cloud-contaminated, and as a result, artificially correlated with cloud parameters; and the potential for correlations between aerosol and cloud parameters to be erroneously considered to be causal. Here these issues are tackled directly by studying the effects of the aerosol on convective clouds in the tropical Atlantic Ocean using satellite remote sensing, a chemical transport model, and a reanalysis of meteorological fields. Results show that there is a robust positive correlation between cloud fraction or cloud top height and the aerosol optical depth, regardless of whether a stringent filtering of aerosol measurements in the vicinity of clouds is applied, or not. These same positive correlations emerge when replacing the observed aerosol field with that derived from a chemical transport model. Model-reanalysis data is used to address the causality question by providing meteorological context for the satellite observations. A correlation exercise between the full suite of meteorological fields derived from model reanalysis and satellite-derived cloud fields shows that observed cloud top height and cloud fraction correlate best with model pressure updraft velocity and relative humidity. Observed aerosol optical depth does correlate with meteorological parameters but usually different parameters from those that correlate with observed cloud fields. The result is a near-orthogonal influence of aerosol and meteorological fields on cloud top height and cloud fraction. The results strengthen the case that the aerosol does play a role in invigorating convective clouds.

Koren, Ilan↗

NASA NTRS2011

Effects of Data Quality on the Characterization of Aerosol Properties from Multiple Sensors

Cross-comparison of aerosol properties between ground-based and spaceborne measurements is an important validation technique that helps to investigate the uncertainties of aerosol products acquired using spaceborne sensors. However, it has been shown that even minor differences in the cross-characterization procedure may significantly impact the results of such validation. Of particular consideration is the quality assurance I quality control (QA/QC) information - an auxiliary data indicating a "confidence" level (e.g., Bad, Fair, Good, Excellent, etc.) conferred by the retrieval algorithms on the produced data. Depending on the treatment of available QA/QC information, a cross-characterization procedure has the potential of filtering out invalid data points, such as uncertain or erroneous retrievals, which tend to reduce the credibility of such comparisons. However, under certain circumstances, even high QA/QC values may not fully guarantee the quality of the data. For example, retrievals in proximity of a cloud might be particularly perplexing for an aerosol retrieval algorithm, resulting in an invalid data that, nonetheless, could be assigned a high QA/QC confidence. In this presentation, we will study the effects of several QA/QC parameters on cross-characterization of aerosol properties between the data acquired by multiple spaceborne sensors. We will utilize the Multi-sensor Aerosol Products Sampling System (MAPSS) that provides a consistent platform for multi-sensor comparison, including collocation with measurements acquired by the ground-based Aerosol Robotic Network (AERONET), The multi-sensor spaceborne data analyzed include those acquired by the Terra-MODIS, Aqua-MODIS, Terra-MISR, Aura-OMI, Parasol-POLDER, and CalipsoCALIOP satellite instruments.

Petrenko, Maksym↗

DOE OSTI2024

A Comprehensive Northern Hemisphere Particle Microphysics Data Set From the Precipitation Imaging Package

Microphysical observations of precipitating particles are critical data sources for numerical weather prediction models and remote sensing retrieval algorithms. However, obtaining coherent data sets of particle microphysics is challenging as they are often unindexed, distributed across disparate institutions, and have not undergone a uniform quality control process. This work introduces a unified, comprehensive Northern Hemisphere particle microphysical data set from the National Aeronautics and Space Administration precipitation imaging package (PIP), accessible in a standardized data format and stored in a centralized, public repository. Data is collected from 10 measurement sites spanning 34° latitude (37°N–71°N) over 10 years (2014–2023), which comprise a set of 1,070,000 precipitating minutes. The provided data set includes measurements of a suite of microphysical attributes for both rain and snow, including distributions of particle size, vertical velocity, and effective density, along with higher-order products including an approximation of volume-weighted equivalent particle densities, liquid equivalent snowfall, and rainfall rate estimates. The data underwent a rigorous standardization and quality assurance process to filter out erroneous observations to produce a self-describing, scalable, and achievable data set. Case study analyses demonstrate the capabilities of the data set in identifying physical processes like precipitation phase-changes at high temporal resolution. Bulk precipitation characteristics from a multi-site intercomparison also highlight distinct microphysical properties unique to each location. This curated PIP data set is a robust database of high-quality particle microphysical observations for constraining future precipitation retrieval algorithms, and offers new insights toward better understanding regional and seasonal differences in bulk precipitation characteristics.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1977

An implementable digital adaptive flight controller designed using stabilized single-stage algorithms

An explicit adaptive controller, which makes direct use of on-line parameter identification, has been developed and applied to both the linearized and nonlinear equations of motion for the F-8 aircraft. This controller is composed of an on-line weighted least squares parameter identifier, a Kalman state filter, and a real model following control law designed using single-stage performance indices. The corresponding control gains are readily adjustable in accordance with parameter changes to ensure asymptotic stability if the conditions of perfect model following are satisfied, and stability in the sense of boundedness otherwise. Simulation experiments with realistic measurement noise indicate that the controller was effective in compensating for parameter variations and capable of rapid recovery from a set of erroneous initial parameter estimates which defined a set of destabilizing gains.

Alag, G.↗

DOE OSTI2023

Calibrated Radar Wind Profiler (RWP) Moments

The SGP Central Facility (C1) radar wind profiler (RWP) was calibrated using nearby surface disdrometer observations. Between 2011 and 2019, the SGP C1 RWP operated in two modes. The vertically pointing mode (named the precipitation mode) transmitted a short and long pulse length to have two different range resolutions and the beam-swinging mode (named the wind mode) transmitted one pulse length into three different beam directions. The precipitation-mode observations were available and calibrated from April 2011 through mid-August 2019. The wind-mode observations were available and calibrated between April 2014 and March 2019. The RWP spectra were processed to account for Nyquist velocity aliasing and coherent integration filtering effects before calculating the spectrum moments. During intense precipitation events, the calculated signal-to-noise ratio (SNR) is biased low due to signal power being distributed across the velocity spectrum such that some signal power is erroneously included in the noise level estimate, causing the noise level to be biased high. To correct for the low SNR bias, a new noise level is estimated using observations without precipitation and the SNR is increased accordingly. The adjusted SNR was converted to radar reflectivity factor and then calibrated against a nearby surface disdrometer. The calibration methodology is fully described in: Williams, CR, J Barrio, PE Johnston, P Muradyan, and S Giangrande. 2023. “Calibrating radar wind profiler reflectivity factor using surface disdrometer observations.” Atmospheric Measurement Techniques, https://egusphere.copernicus.org/preprints/2023/egusphere-2022-1405/

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1999

Tests of Radar Rainfall Retrieval Algorithms

The NASA/JPL Airborne Rain Mapping Radar (ARMAR) operates at 14 GHz. ARMAR flew on the NASA DC-8 aircraft during Tropical Ocean Global Atmosphere (TOGA) Coupled Ocean Atmosphere Response Experiment (COARE), collecting data in oceanic mesoscale convective systems, similar to those now being observed by the Tropical Rainfall Measuring Mission (TRMM) satellite, which includes a 14-GHz precipitation radar. Several algorithms for retrieving rain rate from downward looking radars are in existence. These can be categorized as deterministic and stochastic. Deterministic algorithms use the path integrated attenuation (PIA), measured by the surface reference technique, as a constraint. One deterministic algorithm corrects the attenuation-rainfall (k-R) relation, while another corrects the reflectivity rainfall (ZR) relation. Stochastic algorithms apply an Extended Kalman Filter to the reflectivity profile. One employs radar reflectivity only; the other additionally uses the PIA. We find that the stochastic algorithm with PIA is the most robust algorithm with regard to incorrect assumptions about the drop-size distribution (DSD). The deterministic algorithm that uses the PIA to adjust the Z-R relation is also fairly robust and produces rain rates similar to the stochastic algorithm that uses the PIA. The deterministic algorithm that adjusts only the k-R relation and the stochastic radar-only algorithm are more sensitive to assumptions about the DSD. It is likely that they underestimate convective rainfall, especially if the DSD is erroneously assumed to be appropriate for stratiform rain conditions. The underestimation is illustrated in the diagram. The algorithm labeled D IS initially assumes a DSD that is appropriate for stratiform. rain, while the rain is most likely convective. The PIA constraint causes the k-R relation to be adjusted, resulting in a much lower rain rate than the other algorithms. Additional information is contained in the original.

Durden, Stephen L.↗

NASA NTRS1998

Comparison of Radar Rainfall Retrieval Algorithms in Convective Rain During TOGA COARE

The authors compare deterministic and stochastic rain-rate retrieval algorithms by applying them to 14-GHz nadir-looking airborne radar reflectivity profiles acquired in tropical convective rain during the Tropical Ocean Global Atmosphere Coupled Ocean-Atmosphere Response Experiment, The deterministic algorithms both use the path-integrated attenuation (PIA), measured by the surface reference technique, as a constraint. One deterministic algorithm corrects the k-R relation, while the second corrects the Z-R relation. The stochastic algorithms are based on applying an extended Kalman filter to the reflectivity profile. One employs radar reflectivity only; the other additionally uses the PIA. The authors find that the stochastic algorithm, which uses the PIA, is the most robust algorithm with regard to incorrect assumptions about the drop size distribution (DSD). The deterministic algorithm that uses the PIA to adjust the Z-R relation is also fairly robust and produces rain rates similar to the stochastic algorithm that uses the PIA, The deterministic algorithm that adjusts only the k-R relation and the stochastic radar-only algorithm are more sensitive to assumptions about the DSD. It is likely that they underestimate convective rainfall, especially if the DSD is erroneously assumed to be appropriate for stratiform rain conditions.

Durden, Stephen L.↗

NASA NTRSDate not supplied

Examination of L-Band Brightness Temperature Forecasts in the SMAP Level-4 Soil Moisture Analysis

The NASA Soil Moisture Active Passive (SMAP) mission [4] has been providing L-band (1.4 GHz) passive microwave brightness temperature (Tb) observations since April 2015. By assimilating the Tb observations into the NASA Catchment land surface model [5] using a spatially distributed ensemble Kalman filter, the NASA Global Modeling and Assimilation Office generates the SMAP Level-4 Soil Moisture (L4_SM) product, which provides global, 3-hourly, 9-km resolution estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture with ~2.5-day latency for use in research and applications [6]. The L4_SM product also includes estimates of soil temperature, land surface fluxes, and assimilation diagnostics such as the model forecast and observed Tb values [7]. The output from the L4_SM system is routinely monitored by the L4_SM team. Such monitoring provides valuable information; instances of unusually large Tb observation-minus-forecast (O-F) residuals can indicate events during which soil moisture conditions are poorly described in the land modeling system [7,8]. For example, repeated occurrences of very large Tb O-F values in central Australia were traced back to deficiencies in the gauge-based precipitation product used in the land modeling system through L4_SM Version 5; this discovery prompted the use, beginning in Version 6, of satellite- and gauge-based precipitation observations outside of North America [9]. Recently, a statistical analysis of the Tb O-F residuals revealed systematic errors in the “tau-omega” L-band radiative transfer model that converts the land-model simulated soil moisture and temperature into the forecast Tb prior to the L4_SM analysis. The L4_SM analysis is built on the ensemble Kalman filter and assumes unbiased forecast errors. The presence of systematic Tb forecast errors could thus adversely impact the quality of the analyzed soil moisture. In this paper, we examine the Tb O-F residuals of the latest Version 7 L4_SM data (Science Version ID Vv7030 and Vv7032) [10,11,12]. In the L4_SM Version 7 algorithm, key parameters of the L-band radiative transfer model, including soil roughness, scattering albedo, and a (seasonally varying) climatology of vegetation opacity, are obtained from the SMAP Level-2 Radiometer retrieval product (Version 5) [1]. Additionally, we also use ground measurements of surface soil moisture and soil temperature from the SMAP core validation sites as in situ reference of soil conditions [2,3]. As part of the L4_SM system calibration, the seasonally-varying bias between the model forecast Tb and the observed values is removed prior to the assimilation of the SMAP Tb observations [7]. That is, the L4_SM system is designed to only correct errors in synoptic-scale and interannual variations from the long-term mean seasonal cycle while maintaining the model’s (potentially erroneous) climatology. The Tb O-F residuals examined here are thus computed using SMAP Tb observations after they are rescaled to the mean seasonal cycle of Tb from the modeling system without SMAP data assimilation. Consequently, the long-term average of the Tb O-F residuals has a global mean of only 0.13 K and locally small values, ranging from -1 to 3 K. Despite the small time-average values of the Tb O-F residuals, the model forecast Tb was nevertheless found to exhibit undesirable systematic errors. At some locations, the time-average Tb O-F values strongly depend on surface soil moisture (SM). At the Yanco SMAP core validation site, for example, the Tb O-F residuals typically range from 5 to 15 K under dry soil moisture conditions (SM < 0.15 m3 m-3) yet are predominantly negative under wet soil moisture conditions (SM > 0.25 m3 m-3), with values ranging from 0 to -40 K. This results in soil moisture analysis increments that persistently make the soil drier under dry SM conditions and persistently make the soil wetter under wet SM conditions, suggesting an error in the dynamic range of the simulated Tb, soil moisture or soil temperature. In this paper, we describe the higher-order systematic Tb forecast errors in more detail, examine their impact on the L4_SM product quality, and explore potential avenues to further improve the L4_SM algorithm.

Rolf Reichle↗

DOE OSTI2023

Adaptive Online Multivariate Signal Extraction With Locally Weighted Robust Polynomial Regression

High-frequency, multivariate data collected in real-time and used to control or make decisions regarding a process’ operation often contain some noise and outliers. Thus, a method to extract the signal is needed in order to reduce the number and magnitude of control-based adjustments that are implemented. Such a method must be (i) online, depending only on past and current observations; (ii) fast, producing a smooth value more quickly than the measurement frequency; (iii) robust, ignoring brief bursts of erroneously measured values; (iv) multivariate, ignoring observations that are jointly unusual; (v) adaptive, adjusting to periods of rapid fluctuation in the signal versus periods of stability; and (vi) purely data-driven, not incorporating any information about the process from which the data are collected. Most existing methods are only able to address a subset of these six features. Furthermore, we also require the method to be nonlinear, providing a local nonlinear estimate of the signal. In this work, we propose a novel, real-time signal extraction method based on a local, robust polynomial fit. We demonstrate the performance of our method compared to a state-of-the-art competitor through simulation. For illustration, the methodology is applied to data collected from a reverse osmosis water treatment process.

97 MATHEMATICS AND COMPUTING↗