SEARCH · Search NASA

Results for “Unbiased estimator”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Nanoscale defect evaluation framework combining real-time transmission electron microscopy and integrated machine learning-particle filter estimation

Observation of dynamic processes by transmission electron microscopy (TEM) is an attractive technique to experimentally analyze materials’ nanoscale phenomena and understand the microstructure-properties relationships in nanoscale. Even if spatial and temporal resolutions of real-time TEM increase significantly, it is still difficult to say that the researchers quantitatively evaluate the dynamic behavior of defects. Images in TEM video are a two-dimensional projection of three-dimensional space phenomena, thus missing information must be existed that makes image’s uniquely accurate interpretation challenging. Therefore, even though they are still a clustering high-dimensional data and can be compressed to two-dimensional, conventional statistical methods for analyzing images may not be powerful enough to track nanoscale behavior by removing various artifacts associated with experiment; and automated and unbiased processing tools for such big-data are becoming mission-critical to discover knowledge about unforeseen behavior. We have developed a method to quantitative image analysis framework to resolve these problems, in which machine learning and particle filter estimation are uniquely combined. The quantitative and automated measurement of the dislocation velocity in an Fe-31Mn-3Al-3Si autunitic steel subjected to the tensile deformation was performed to validate the framework, and an intermittent motion of the dislocations was quantitatively analyzed. The framework is successfully classifying, identifying and tracking nanoscale objects; these are not able to be accurately implemented by the conventional mean-path based analysis.

36 MATERIALS SCIENCE↗

NASA NTRS2013

Simultaneous Estimation of Model State Variables and Observation and Forecast Biases Using a Two-Stage Hybrid Kalman Filter

In this paper, we present a two-stage hybrid Kalman filter to estimate both observation and forecast bias in hydrologic models, in addition to state variables. The biases are estimated using the discrete Kalman filter, and the state variables using the ensemble Kalman filter. A key issue in this multi-component assimilation scheme is the exact partitioning of the difference between observation and forecasts into state, forecast bias and observation bias updates. Here, the error covariances of the forecast bias and the unbiased states are calculated as constant fractions of the biased state error covariance, and the observation bias error covariance is a function of the observation prediction error covariance. In a series of synthetic experiments, focusing on the assimilation of discharge into a rainfall-runoff model, it is shown that both static and dynamic observation and forecast biases can be successfully estimated. The results indicate a strong improvement in the estimation of the state variables and resulting discharge as opposed to the use of a bias-unaware ensemble Kalman filter. Furthermore, minimal code modification in existing data assimilation software is needed to implement the method. The results suggest that a better performance of data assimilation methods should be possible if both forecast and observation biases are taken into account.

Data Assimilation↗

DOE OSTI2025

Validation of the DESI 2024 Lyα forest BAO analysis using synthetic datasets

The first year of data from the Dark Energy Spectroscopic Instrument (DESI) contains the largest set of Lyman-α (Lyα) forest spectra ever observed. This data, collected in the DESI Data Release 1 (DR1) sample, has been used to measure the Baryon Acoustic Oscillation (BAO) feature at redshift z = 2.33. In this work, we use a set of 150 synthetic realizations of DESI DR1 to validate the DESI 2024 Lyα forest BAO measurement presented in [1]. The synthetic data sets are based on Gaussian random fields using the log-normal approximation. We produce realistic synthetic DESI spectra that include all major contaminants affecting the Lyα forest. The synthetic data sets span a redshift range 1.8 < z < 3.8, and are analyzed using the same framework and pipeline used for the DESI 2024 Lyα forest BAO measurement. To measure BAO, we use both the Lyα auto-correlation and its cross-correlation with quasar positions. We use the mean of correlation functions from the set of DESI DR1 realizations to show that our model is able to recover unbiased measurements of the BAO position. We also fit each mock individually and study the population of BAO fits in order to validate BAO uncertainties and test our method for estimating the covariance matrix of the Lyα forest correlation functions. Finally, we discuss the implications of our results and identify the needs for the next generation of Lyα forest synthetic data sets, with the top priority being to simulate the effect of BAO broadening due to non-linear evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

A Proof for the Unbiased Nature of Range-Doppler Measurements in Coarse-Resolution Dechirp-on-Receive Feedback Synthetic Aperture Radar Navigation

In feedback synthetic aperture radar (SAR) navigation, observables extracted from SAR range-Doppler images correct position and velocity errors accumulated within an associated navigation system. Unlike most other sensors, which produce measurements without input from a navigation system, SARs require a prior estimate of the radar’s position and velocity to adjust the radar’s matched filter during range-Doppler image formation. Consequently, it is possible for position and velocity errors within a navigation system to manifest as additional errors (biases) in the range-Doppler measurement observables. Prior work has not tackled this possibility in the context of feedback SAR navigation with a dechirp-on-receive radar. This paper offers a proof demonstrating that range-Doppler observables extracted from coarse-resolution vertical SAR images formed with a dechirp-on-receive radar may be safely modeled as unbiased measurements of the radar’s true position and velocity despite the presence of moderate navigation errors.

dechirp-on-receive↗

DOE OSTI2024

The frequency of metal enrichment of cool helium-atmosphere white dwarfs using the DESI early data release

There is an overwhelming evidence that white dwarfs host planetary systems; revealed by the presence, disruption, and accretion of planetary bodies. A lower limit on the frequency of white dwarfs that host planetary material has been estimated to be ≃ 25–50 per cent; inferred from the ongoing or recent accretion of metals on to both hydrogen-atmosphere and warm helium-atmosphere white dwarfs. Now with the unbiased sample of white dwarfs observed by the Dark Energy Spectroscopic Instrument (DESI) survey in their Early Data Release (EDR), we have determined the frequency of metal enrichment around cool-helium atmosphere white dwarfs as 21 ± 3 per cent using a sample of 234 systems. This value is in good agreement with values determined from previous studies. With the current samples we cannot distinguish whether the frequency of planetary accretion varies with system age or host-star mass, but the DESI data release 1 will contain roughly an order of magnitude more white dwarfs than DESI EDR and will allow these parameters to be investigated.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2017

SMAP Level 4 Surface and Root Zone Soil Moisture

The SMAP Level 4 soil moisture (L4_SM) product provides global estimates of surface and root zone soil moisture, along with other land surface variables and their error estimates. These estimates are obtained through assimilation of SMAP brightness temperature observations into the Goddard Earth Observing System (GEOS-5) land surface model. The L4_SM product is provided at 9 km spatial and 3-hourly temporal resolution and with about 2.5 day latency. The soil moisture and temperature estimates in the L4_SM product are validated against in situ observations. The L4_SM product meets the required target uncertainty of 0.04 m(exp. 3)m(exp. -3), measured in terms of unbiased root-mean-square-error, for both surface and root zone soil moisture.

SMAP↗

NASA NTRSDate not supplied

Systematic Errors in Simulated L-Band Brightness Temperature in the SMAP Level-4 Soil Moisture Analysis

The NASA Soil Moisture Active Passive (SMAP) mission has been providing L-band (1.4 GHz) brightness temperature (Tb) observations since April 2015. By assimilating the Tb observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter (EnKF), the SMAP Level-4 Soil Moisture (L4_SM) product provides global, 3-hourly, 9-km resolution estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture with ~2.5-day latency for use in research and applications. The EnKF-based L4_SM analysis assumes unbiased forecast errors. Consequently, the seasonally varying bias between the model forecast Tb and the observed values is removed prior to the assimilation of the SMAP Tb observations. The L4_SM system is thus designed to only correct errors in synoptic-scale and interannual variations from the long-term mean seasonal cycle while maintaining the model’s (possibly wrong) climatology. In this paper, we examine the Tb observation-minus-forecast (O-F) residuals from the L4_SM Version 7 product (computed after rescaling the Tb observations to the mean seasonal cycle of the simulated Tb). The long-term average of the Tb O-F residuals has a global mean of only 0.13 K and locally small values, ranging from -1 to 3 K. The model forecast Tb, however, still exhibits undesirable systematic errors relative to the (rescaled) Tb observations. At some locations, the time-average Tb O-F values strongly depend on surface soil moisture (SM). At the Yanco SMAP core validation site, for example, the Tb O-F residuals typically range from 5 to 15 K under dry soil moisture conditions (SM < 0.15 m3 m-3) yet are predominantly negative under wet soil moisture conditions (SM > 0.25 m3 m-3), with values ranging from 0 to -40 K. This results in soil moisture analysis increments that persistently make the soil drier under dry SM conditions and persistently make the soil wetter under wet SM conditions, suggesting an error in the dynamic range of the simulated Tb, soil moisture or soil temperature. In this paper, we describe the higher-order systematic Tb forecast errors in more detail, examine their impact on the L4_SM product quality, and explore potential avenues to improve the L4_SM algorithm.

Rolf Reichle↗

NASA NTRS2024

Improved Soil Moisture Estimation and Detection of Irrigation Signal By Incorporating SMAP Soil Moisture Into the Indian Land Data Assimilation System (ILDAS)

Land surface models have facilitated the estimation of soil moisture over a range of spatiotemporal scales. However, limitations in model parameterization and under-representation of anthropogenic processes restrict their ability to estimate local-scale soil moisture variability, especially over irrigated areas. Assimilation of satellite-based soil moisture retrievals into land surface models can be a viable approach to overcome these constraints, specially over highly irrigated countries such as India, where such applications are rare. Additionally, large-scale validation of modeled soil moisture has been limited over India till now due to lack of a representative station network. By assimilating Soil Moisture Active Passive (SMAP)-based estimates into the state-of-the-art Indian Land Data Assimilation System (ILDAS) and combining with a new soil moisture station network of more than 200 stations, this study demonstrates improved soil moisture estimations and capture of irrigation signals over the region. The Noah-MP land surface model is forced by multiple local and global meteorological datasets and Ensemble Kalman Filter (EnKF) is used for assimilation of soil moisture. Comparison of open-loop and data assimilated soil moisture against station soil moisture data shows relative spatial mean improvement of 0.0178 in correlation and 0.0029 m3/m3 in RMSE. Further statistical comparison with in-situ data has also shown better results over most of the stations, as evident from improved correlations and reduced unbiased RMSE after assimilation. Finally, the climatology of soil moisture over the different irrigation fractions reveals that data assimilated outputs over irrigated grid cells tend to have higher soil moisture during dry winter season, demonstrating the ability to capture irrigation signals. These findings quantify the value of data assimilation in improving soil moisture estimates and the ability to capture unmodeled processes such as irrigation, which lays the science groundwork for upcoming space missions such as NASA ISRO Synthetic Aperture Radar (NISAR).

Soil Moisture↗

NASA NTRS1987

Stellar bars and the spatial distribution of infrared luminosity

Ground-based 10 micron observations of the central region of over 100 infrared luminous galaxies are presented. A first order estimate of the spatial distribution of infrared emission in galaxies is obtained through a combination of ground-based and Infrared Astronomy Satellite (IRAS) data. The galaxies are nearby and primarily noninteracting, permitting an unbiased investigation of correlations with Hubble type. Approximately 40% of the early-type barred galaxies in this sample are associated with enhanced luminosity in the central (approximately 1 kpc diameter) region. The underlying luminosity source is attributed to both Seyfert and star formation activity. Late-type spirals are different in that the spatial distribution of infrared emission and the infrared luminoisty are not strongly dependent on barred morphology.

Devereux, Nicholas↗

NASA NTRS2019

Fractional Polarization of Extragalactic Sources in the 500 deg 2 SPTpol Survey

We study the polarization properties of extragalactic sources at 95 and 150 GHz in the SPTpol 500 deg 2 survey. We estimate the polarized power by stacking maps at known source positions, and correct for noise bias by subtracting the mean polarized power at random positions in the maps. We show that the method is unbiased using a set of simulated maps with similar noise properties to the real SPTpol maps. We find a flux-weighted mean-squared polarization fraction 〈p 2 〉 = [8.9 ± 1.1] × 10 -4 at 95 GHz and [6.9 ± 1.1] × 10 -4 at 150 GHz for the full sample. This is consistent with the values obtained for a subsample of active galactic nuclei. For dusty sources, we find 95 per cent upper limits of 〈p 2 〉95 < 16.9 × 10 -3 and 〈p 2 〉150 < 2.6 × 10 -3 . We find no evidence that the polarization fraction depends on the source flux or observing frequency. The 1σ upper limit on measured mean-squared polarization fraction at 150 GHz implies that extragalactic foregrounds will be subdominant to the CMB E and B mode polarization power spectra out to at least ℓ ≲ 5700 (ℓ ≲ 4700) and ℓ ≲ 5300 (ℓ ≲ 3600), respectively, at 95 (150) GHz.

Nikhel Gupta↗

DOE OSTI2020

Planck 2018 results - IV. Diffuse component separation

We present full-sky maps of the cosmic microwave background (CMB) and polarized synchrotron and thermal dust emission, derived from the third set of Planck frequency maps. These products have significantly lower contamination from instrumental systematic effects than previous versions. The methodologies used to derive these maps follow closely those described in earlier papers, adopting four methods (Commander, NILC, SEVEM, and SMICA) to extract the CMB component, as well as three methods (Commander, GNILC, and SMICA) to extract astrophysical components. Our revised CMB temperature maps agree with corresponding products in the Planck 2015 delivery, whereas the polarization maps exhibit significantly lower large-scale power, reflecting the improved data processing described in companion papers; however, the noise properties of the resulting data products are complicated, and the best available end-to-end simulations exhibit relative biases with respect to the data at the few percent level. Using these maps, we are for the first time able to fit the spectral index of thermal dust independently over 3° regions. We derive a conservative estimate of the mean spectral index of polarized thermal dust emission of β d = 1.55 ± 0.05, where the uncertainty marginalizes both over all known systematic uncertainties and different estimation techniques. For polarized synchrotron emission, we find a mean spectral index of β s = -3.1 ± 0.1, consistent with previously reported measurements. We note that the current data processing does not allow for construction of unbiased single-bolometer maps, and this limits our ability to extract CO emission and correlated components. The foreground results for intensity derived in this paper therefore do not supersede corresponding Planck 2015 products. For polarization the new results supersede the corresponding 2015 products in all respects.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1979

Maximum likelihood estimation for life distributions with competing failure modes

Systems which are placed on test at time zero, function for a period and die at some random time were studied. Failure may be due to one of several causes or modes. The parameters of the life distribution may depend upon the levels of various stress variables the item is subject to. Maximum likelihood estimation methods are discussed. Specific methods are reported for the smallest extreme-value distributions of life. Monte-Carlo results indicate the methods to be promising. Under appropriate conditions, the location parameters are nearly unbiased, the scale parameter is slight biased, and the asymptotic covariances are rapidly approached.

Sidik, S. M.↗

NASA NTRS2021

The Contributions of Gauge-Based Precipitation and SMAP Brightness Temperature Observations to the Skill of the SMAP Level-4 Soil Moisture Product

Soil Moisture Active Passive (SMAP) mission L-band brightness temperature (Tb) observations are routinely assimilated into the Catchment land surface model to generate Level-4 Soil Moisture (L4_SM) estimates of global surface and root-zone soil moisture at 9-km, 3-hourly resolution with ~2.5-day latency. The Catchment model in the L4_SM algorithm is driven with ¼-degree, hourly surface meteorological forcing data from the Goddard Earth Observing System (GEOS). Outside of Africa and the high latitudes, GEOS precipitation is corrected using Climate Prediction Center Unified (CPCU) gauge-based, ½-degree, daily precipitation. L4_SM soil moisture was previously shown to improve over land model-only estimates that use CPCU precipitation but no Tb assimilation (CPCU_SIM). Here, we additionally examine the skill of model-only (CTRL) and Tb assimilation-only (SMAP_DA) estimates derived without CPCU precipitation. Soil moisture is assessed versus in situ measurements in well-instrumented regions and globally through the Instrumental Variable (IV) method using independent soil moisture retrievals from the Advanced Scatterometer. At the in situ locations, SMAP_DA and CPCU_SIM have comparable soil moisture skill improvements relative to CTRL for the unbiased root-mean-square error (surface and root-zone) and correlation metrics (root-zone only). In the global average, SMAP Tb assimilation increases the surface soil moisture anomaly correlation by 0.10-0.11 compared to an increase of 0.02-0.03 from the CPCU-based precipitation corrections. The contrast is particularly strong in central Australia, where CPCU is known to have errors and observation-minus-forecast Tb residuals are larger when CPCU precipitation is used. Validation versus streamflow measurements in the contiguous U.S. reveals that CPCU precipitation provides most of the skill gained in L4_SM runoff estimates over CTRL.

SMAP↗

NASA NTRS2021

Validation of SMAP L2 passive-only soil moisture products using upscaled in situ measurements collected in Twente, the Netherlands

The Twente region in the east of the Netherlands has a network with twenty soil monitoring stations that has been utilized for validation of the Soil Moisture Active/Passive (SMAP) passive-only soil moisture products. Over the period from April 2015 until December 2018, seven stations covered by the SMAP reference pixels 15 have fairly complete data records. Spatially distributed soil moisture simulations with the Dutch national hydrological model have been utilized for the development of upscaling functions to translate the spatial mean of point measurements to the domain of the SMAP reference pixels. The native and upscaled spatial soil moisture means computed using the in-situ measurements have been adopted as references to assess the performance of the SMAP i) Single Channel Algorithm at Horizontal Polarization (SCA-H), ii) Single Channel Algorithm at Vertical Polarization (SCA-V), and iii) Dual Channel Algorithm (DCA) soil moisture estimates. In the case of the Twente network it was found that the SCA-V soil moisture retrieved SMAP observations collected in the afternoon had the best agreement with the native spatial mean leading to an unbiased Root Mean Squared Error (uRMSE) of 0.059 m3 m-3, whereas for the upscaled in-situ references primarily larger biases were found. These error levels are larger than the mission’s target accuracy of 0.04 m3 m-3, which can be attributed to large over- and underestimation errors (>0.08 m3 m-3) in particular at the end of dry spells and during freezing, respectively. The strong vertical dielectric gradients associated with rapid soil freezing and wetting causes the disparity in soil depth characterized by SMAP and in situ that leads to the large mismatches. Once filtered for frozen conditions and antecedent rainfall the uRMSE improves to 0.043 m3 m-3.

Rogier van der Velde↗

NASA NTRS2022

Verification and Validation of Hybridspectral Radiometry Obtained from an Unmanned Surface Vessel (USV) in the Open and Coastal Oceans

The hardware and software capabilities of the compact-profiling hybrid instrumentation for radiometry and ecology (C-PHIRE) instruments on an unmanned surface vessel (USV) are evaluated. Both the radiometers and USV are commercial-off-the-shelf (COTS) products, with the latter being only minimally modified to deploy the C-PHIRE instruments. The hybridspectral C-PHIRE instruments consist of an array of 18 multispectral microradiometers with 10 nm wavebands spanning 320–875 nm plus a hyperspectral compact grating spectrometer (CGS) with 2048 pixels spanning 190–1000 nm. The C-PHIRE data were acquired and processed using two architecturally linked software packages, thereby allowing lessons learned in one to be applied to the other. Using standard data products and unbiased statistics, the C-PHIRE data were validated with those from the well-established compact-optical profiling system (C-OPS) and verified with the marine optical buoy (MOBY). Agreement between algorithm variables used to estimate colored dissolved organic matter (CDOM) absorption and chlorophyll a concentration were also validated. Developing and operating novel technologies, such as the C-PHIRE series of instruments, deployed on a USV increase the frequency and coverage of optical observations, which are required to fully support the present and next-generation validation exercises in radiometric remote sensing of aquatic ecosystems.

Hybridspectral↗

NASA NTRS2021

Asymmetry in Subseasonal Surface Air Temperature Forecast Error with Respect to Soil Moisture Initialization

Soil moisture (W) helps control evapotranspiration (ET), and ET variations can in turn have a distinct impact on 2-m air temperature (T2M), given that increases in evaporative cooling encourage reduced temperatures. Soil moisture is accordingly linked to T2M, and realistic soil moisture initialization has, in previous studies, been shown to improve the skill of subseasonal T2M forecasts. The relationship between soil moisture and evapotranspiration, however, is distinctly nonlinear, with ET tending to increase with soil moisture in drier conditions and to be insensitive to soil moisture variations in wetter conditions. Here, through an extensive analysis of subseasonal forecasts produced with a state-of-the-art seasonal forecast system, this nonlinearity is shown to imprint itself on T2M forecast error in the conterminous United States in two unique ways: (i) the T2M forecast bias (relative to independent observations) induced by a negative precipitation bias tends to be larger for dry initializations, and (ii) on average, the unbiased root-mean-square error (ubRMSE) tends to be larger for dry initializations. Such findings can aid in the identification of forecasts of opportunity; taken a step further, they suggest a pathway for improving bias correction and uncertainty estimation in subseasonal T2M forecasts by conditioning each on initial soil moisture state.

Air Temperature↗

NASA NTRSDate not supplied

T2M Forecasts at Subseasonal Leads: Do Different Soil Moisture Initial States Have Different Impacts?

2-meter Temperature↗

NASA NTRS1999

Moisture Forecast Bias Correction in GEOS DAS

Data assimilation methods rely on numerous assumptions about the errors involved in measuring and forecasting atmospheric fields. One of the more disturbing of these is that short-term model forecasts are assumed to be unbiased. In case of atmospheric moisture, for example, observational evidence shows that the systematic component of errors in forecasts and analyses is often of the same order of magnitude as the random component. we have implemented a sequential algorithm for estimating forecast moisture bias from rawinsonde data in the Goddard Earth Observing System Data Assimilation System (GEOS DAS). The algorithm is designed to remove the systematic component of analysis errors and can be easily incorporated in an existing statistical data assimilation system. We will present results of initial experiments that show a significant reduction of bias in the GEOS DAS moisture analyses.

Dee, D.↗