SEARCH · Search NASA

Results for “Unbiased estimator”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

DOE OSTI2025

An iterative CMB lensing estimator minimizing instrumental noise bias

Noise maps from cosmic microwave background (CMB) experiments are generally statistically anisotropic, due to scanning strategies, atmospheric conditions, or instrumental effects. Any mismodeling of this complex noise can bias the reconstruction of the lensing potential and the measurement of the lensing power spectrum from the observed CMB maps. We introduce a new CMB lensing estimator based on the maximum (MAP) reconstruction that is minimally sensitive to these instrumental noise biases. By modifying the likelihood to rely exclusively on correlations between CMB map splits with independent noise realizations, we minimize autocorrelations that contribute to biases. In the regime of many independent splits, this maximum closely approximates the optimal MAP reconstruction of the lensing potential. In simulations, we demonstrate that this method is able to determine lensing observables that are immune to any noise mismodeling with a negligible cost in signal-to-noise ratio. Our estimator enables unbiased and nearly optimal lensing reconstruction for next-generation CMB surveys.

Legrand, Louis [University of Cambridge (United Ki↗

DOE OSTI2023

Graph Sparsification by Approximate matrix Multiplication

Graphs arising in statistical problems, signal processing, large networks, combinatorial optimization, and data analysis are often dense, which causes both computational and storage bottlenecks. One way of sparsifying a weighted graph, while sharing the same vertices as the original graph but reducing the number of edges, is through spectral sparsification. We study this problem through the perspective of RandNLA. Specifically, we utilize randomized matrix multiplication to give a clean and simple analysis of how sampling according to edge weights gives a spectral approximation to graph Laplacians, without requiring spectral information. Through the CR–MM algorithm, we attain a simple and computationally efficient sparsifier whose resulting Laplacian estimate is unbiased and of minimum variance. Here, we define a new notion of additive spectral sparsifiers, which has not been considered in the literature.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

MENT-Flow: maximum-entropy phase space tomography using normalizing flows

Generative models can be trained to reproduce low-dimensional projections of high-dimensional phase space distributions. Normalizing flows are generative models that parameterize invertible transformations, allowing exact probability density evaluation and sampling. Consequently, flows are unbiased entropy estimators and could be used to solve the high-dimensional maximum-entropy tomography (MENT) problem. In this work, we evaluate a flow-based MENT solver (MENT-Flow) against exact maximum-entropy solutions and Minerbo's iterative MENT algorithm in two dimensions.

Hoover, Austin↗

NASA NTRS1972

Control system estimation and design for aerospace vehicles

The selection of an estimator which is unbiased when applied to structural parameter estimation is discussed. The mathematical relationships for structural parameter estimation are defined. It is shown that a conventional weighted least squares (CWLS) estimate is biased when applied to structural parameter estimation. Two approaches to bias removal are suggested: (1) change the CWLS estimator or (2) change the objective function. The advantages of each approach are analyzed.

Stefani, R. T.↗

NASA NTRS2011

Efficient Kriging Algorithms

More efficient versions of an interpolation method, called kriging, have been introduced in order to reduce its traditionally high computational cost. Written in C++, these approaches were tested on both synthetic and real data. Kriging is a best unbiased linear estimator and suitable for interpolation of scattered data points. Kriging has long been used in the geostatistic and mining communities, but is now being researched for use in the image fusion of remotely sensed data. This allows a combination of data from various locations to be used to fill in any missing data from any single location. To arrive at the faster algorithms, sparse SYMMLQ iterative solver, covariance tapering, Fast Multipole Methods (FMM), and nearest neighbor searching techniques were used. These implementations were used when the coefficient matrix in the linear system is symmetric, but not necessarily positive-definite.

Memarsadeghi, Nargess↗

NASA NTRS2011

EEG Artifact Removal Using a Wavelet Neural Network

!n this paper we developed a wavelet neural network. (WNN) algorithm for Electroencephalogram (EEG) artifact removal without electrooculographic (EOG) recordings. The algorithm combines the universal approximation characteristics of neural network and the time/frequency property of wavelet. We. compared the WNN algorithm with .the ICA technique ,and a wavelet thresholding method, which was realized by using the Stein's unbiased risk estimate (SURE) with an adaptive gradient-based optimal threshold. Experimental results on a driving test data set show that WNN can remove EEG artifacts effectively without diminishing useful EEG information even for very noisy data.

Nguyen, Hoang-Anh T.↗

NASA NTRS1977

Determination of the heat balance of the earth: Interpretation of radiation measurements from satellites

A method is developed for estimating the mean and mean-square variation of the flux at an altitude arbitrarily chosen to represent the top of the atmosphere. When applied to practical satellite measurements, the method is shown to be optimum in that the estimated mean is unbiased and the mean square variation of the estimates converges to that of the true flux. Data from the Meteor-1 and -2 satellites support the essential assumptions and provide a quantitative indication of the performance that can be expected.

Laughlin, C. R.↗

NASA NTRS1990

Exact closed-form expressions for the performance of the split-symbol moments estimator of signal-to-noise ratio

Previously, the performance of the split-symbol moments estimator (SSME) of signal-to-noise ratio (SNR) has been evaluated by means of approximate expressions for the estimator mean and variance. These are asymptotic formulas in the sense that they become accurate as the number of estimator samples gets large. Here, exact closed-form expressions are obtained for the same quantities. These expressions confirm the accuracy of the previously derived asymptotic results, and, unlike the asymptotic formulas, they are useful even when the number of samples is small. It is also shown that the conventional split-symbol estimator can be trivially scaled to form a signal-to-noise ratio estimator which is precisely unbiased (as long as the estimate is based on more than two split-symbols).

Dolinar, S.↗

NASA NTRS1996

Passive Microwave Remote Sensing of Rainfall Considering the Effects of Wind and Nonprecipitating Clouds

It has long been shown both in theory and in observation that emission from rain drops in a raining cloud results in upwelling brightness temperature above that caused by the sea surface alone. High brightness temperatures at microwave frequencies (e.g. 37 and 19 GHz) have usually been quantitatively associated with rainfall using physical or statistical models. By comparing concurrent special sensor microwave/imager and radar data, however, we noticed many cases where there is no appreciable rainfall in a field of view (FOV) which exhibits high brightness temperature (T(sub B)) at 37 and 19 GHz. On the basis of calculations and past literature it is shown that such high brightness temperatures can be caused by nonprecipitating clouds and by wind. The effect of the wind is to create wave and high-emissivity foam on the sea surface. A model is developed to relate T(sub B) to the fractional coverage of rain, f, within a FOV. The parameters of the model are calibrated by fitting the model to the observed brightness temperature and fractional rain coverage data. The critical parameter of the model, T(sub B min.), which is the threshold brightness temperature for the presence of rain, depends on the strength of the storm. The strength of the storm is characterized by the fraction of the FOVs within a large area that have T(sub B) higher than 240 K, which is readily obtainable from satellite data alone. The instantaneous FOV rain rate R can then be obtained through the f approximately R relationship which is empirically derived using radar data. An algorithm has been proposed based on the T(sub B) approximately f and f approximately R relationship. Application of the algorithm to TOGA-COARE and Darwin storms results in reasonable instantaneous FOV rain estimate. When averaged over the entire radar scan, a more accurate and unbiased areal rain estimate can be achieved.

Qihang Li.↗

NASA NTRS2012

Momentum Flux Determination Using the Multi-beam Poker Flat Incoherent Scatter Radar

In this paper, we develop an estimator for the vertical flux of horizontal momentum with arbitrary beam pointing, applicable to the case of arbitrary but fixed beam pointing with systems such as the Poker Flat Incoherent Scatter Radar (PFISR). This method uses information from all available beams to resolve the variances of the wind field in addition to the vertical flux of both meridional and zonal momentum, targeted for high-frequency wave motions. The estimator utilises the full covariance of the distributed measurements, which provides a significant reduction in errors over the direct extension of previously developed techniques and allows for the calculation of an error covariance matrix of the estimated quantities. We find that for the PFISR experiment, we can construct an unbiased and robust estimator of the momentum flux if sufficient and proper beam orientations are chosen, which can in the future be optimized for the expected frequency distribution of momentum-containing scales. However, there is a potential trade-off between biases and standard errors introduced with the new approach, which must be taken into account when assessing the momentum fluxes. We apply the estimator to PFISR measurements on 23 April 2008 and 21 December 2007, from 60-85 km altitude, and show expected results as compared to mean winds and in relation to the measured vertical velocity variances.

Momentum flux↗

NASA NTRS1981

Optimal determination of geopotential base height for stratospheric temperature sounders

A technique is presented by which a geopotential base height between 100 and 10 mbar may be estimated to serve as a reference for the construction of stratospheric height fields from remotely sensed temperatures. The scheme employs conventional data obtained below 100 mbar coupled with remotely sensed observations above this level to derive an accurate estimate of the height field by the minimization of the error at the tie-on level, the pressure level of the base height. In a series of numerical realizations, it is demonstrated that the technique yields an unbiased and optimal estimate of the height at levels where conventional errors are typically large, particularly where the conventional height error grows rapidly in the vertical.

Salby, M. L.↗

NASA NTRS1991

Perturbation analysis of queueing systems with a time-varying arrival rate

The authors consider an M/G/1 queuing with a time-varying arrival rate. The objective is to obtain infinitesimal perturbation analysis (IPA) gradient estimates for various performance measures of interest with respect to certain system parameters. In particular, the authors consider the mean system time over n arrivals and an arrival rate alternating between two values. By choosing a convenient sample path representation of this system, they derive an unbiased IPA gradient estimator which, however, is not consistent, and investigate the nature of this problem.

Cassandras, Christos G.↗

DOE OSTI2021

Retrospective Analysis of Backwater Habitat Availability Using Remote Sensing

Low-velocity channel-margin habitats serve as important nursery habitats for the endangered Colorado pikeminnow (Ptychocheilus lucius) in the middle Green River between Jensen and Ouray, Utah. These habitats, known as backwaters, are associated with emergent sandbars, and are shaped and reformed annually by peak flows. Our recent knowledge about backwater characteristics and dynamics that is summarized in the synthesis report (Grippo et al. 2015) was based on detailed annual survey data from a relatively small sample of backwaters that were collected from 2003 to 2014 and reach-wide evaluations of backwater surface area based on manual interpretation of aerial and satellite imagery. Methods that bridge the gap between the detailed surveys from a small number of backwaters and the reach-wide assessment of their surface area would enable an assessment of the availability of backwater habitats that meet the minimum depth requirements for suitable habitat for Colorado pikeminnow. In 2015 Argonne National Laboratory (Argonne) tested three regression models—linear, multiple, and partial least square (PLS) regression models—for estimating backwater depth using National Agriculture Imagery Program (NAIP) imagery collected in July 2006 that covered the Jensen-Ouray reach of the Green River (Hamada and LaGory 2016). The results suggested that a PLS regression model showed high correlation with the reference depth (R 2 = 0.69) and had the most unbiased and consistent estimate of backwater depth. The results also indicated that the PLS model would provide reasonable estimates of the amount of habitat providing a minimum suitable depth of 30 cm for young-of-the-year Colorado pikeminnow, even though absolute depth estimates may be uncertain for backwater areas deeper than approximately 40 cm. The study also provided insights regarding the amount and the selection of calibration and validation (cal-val) data needed for improving the accuracy of depth prediction.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

A machine learning approach for efficient multi-dimensional integration

Many physics problems involve integration in multi-dimensional space whose analytic solution is not available. The integrals can be evaluated using numerical integration methods, but it requires a large computational cost in some cases, so an efficient algorithm plays an important role in solving the physics problems. We propose a novel numerical multi-dimensional integration algorithm using machine learning (ML). After training a ML regression model to mimic a target integrand, the regression model is used to evaluate an approximation of the integral. Then, the difference between the approximation and the true answer is calculated to correct the bias in the approximation of the integral induced by ML prediction errors. Because of the bias correction, the final estimate of the integral is unbiased and has a statistically correct error estimation. Three ML models of multi-layer perceptron, gradient boosting decision tree, and Gaussian process regression algorithms are investigated. The performance of the proposed algorithm is demonstrated on six different families of integrands that typically appear in physics problems at various dimensions and integrand difficulties. The results show that, for the same total number of integrand evaluations, the new algorithm provides integral estimates with more than an order of magnitude smaller uncertainties than those of the VEGAS algorithm in most of the test cases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

A causal data fusion method for the general exposure and outcome

Abstract With the advent of the big data era, the need to combine multiple individual data sets to draw causal effects arises naturally in many medical and biological applications. Especially each data set cannot measure enough confounders to infer the causal effect of an exposure on an outcome. In this article, we extend the method proposed by a previous study to causal data fusion of more than two data sets without external validation and to a more general (continuous or discrete) exposure and outcome. Theoretically, we obtain the condition for identifiability of exposure effects using multiple individual data sources for the continuous or discrete exposure and outcome. The simulation results show that our proposed causal data fusion method has unbiased causal effect estimate and higher precision than traditional regression, meta‐analysis and statistical matching methods. We further apply our method to study the causal effect of BMI on glucose level in individuals with diabetes by combining two data sets. Our method is essential for causal data fusion and provides important insights into the ongoing discourse on the empirical analysis of merging multiple individual data sources.

Li, Hongkai↗

DOE OSTI2022

Damping inter-area oscillation using reinforcement learning controlled TCSC

Appropriate damping control of the inter-area oscillation would ensure the grid stability and maintain the tie-line power transfer capability. In this paper, we proposed a novel reinforcement learning (RL) based power oscillation damping (POD) controller that uses Thyristor Controlled Series Compensators (TCSC) to damp inter-area oscillations. By leveraging the unbiased gradient direction estimation of the natural evolution strategy (NES), we successfully regulated the power flows on the tie-lines and damped inter-area oscillations through dynamically modulating the inserted reactance of the TCSC. The proposed RL-based POD controller has been tested on both two-area four-machine system and North American Minni-WECC system. Extensive studies have demonstrated the excellent performance of the proposed RL-based TCSC POD controller in damping inter-area oscillations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Cosmic shear power spectra in practice

Cosmic shear is one of the most powerful probes of Dark Energy, targeted by several current and future galaxy surveys. Lensing shear, however, is only sampled at the positions of galaxies with measured shapes in the catalog, making its associated sky window function one of the most complicated amongst all projected cosmological probes of inhomogeneities, as well as giving rise to inhomogeneous noise. Partly for this reason, cosmic shear analyses have been mostly carried out in real-space, making use of correlation functions, as opposed to Fourier-space power spectra. Since the use of power spectra can yield complementary information and has numerical advantages over real-space pipelines, it is important to develop a complete formalism describing the standard unbiased power spectrum estimators as well as their associated uncertainties. Building on previous work, this paper contains a study of the main complications associated with estimating and interpreting shear power spectra, and presents fast and accurate methods to estimate two key quantities needed for their practical usage: the noise bias and the Gaussian covariance matrix, fully accounting for survey geometry, with some of these results also applicable to other cosmological probes. Here, we demonstrate the performance of these methods by applying them to the latest public data releases of the Hyper Suprime-Cam and the Dark Energy Survey collaborations, quantifying the presence of systematics in our measurements and the validity of the covariance matrix estimate. We make the resulting power spectra, covariance matrices, null tests and all associated data necessary for a full cosmological analysis publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1981

Statistical estimation of correlation for nonstationary aircraft noise

Based on the acoustic radiation theory for a moving source, the estimation of the correlation function of a nonstationary acoustic signal is considered. An estimator is obtained for the acoustic correlation, which is shown to be unbiased and consistent. The estimation procedure can be applied to an aircraft noise measurement, where the reflected wave can be eliminated.

Chow, P. L.↗