Search NASA⌕ Search

SEARCH · Search NASA

Results for “variance estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

Statistical Properties of Maximum Likelihood Estimators of Power Law Spectra Information

A simple power law model consisting of a single spectral index, sigma(sub 2), is believed to be an adequate description of the galactic cosmic-ray (GCR) proton flux at energies below 10(exp 13) eV, with a transition at the knee energy, E(sub k), to a steeper spectral index sigma(sub 2) greater than sigma(sub 1) above E(sub k). The maximum likelihood (ML) procedure was developed for estimating the single parameter sigma(sub 1) of a simple power law energy spectrum and generalized to estimate the three spectral parameters of the broken power law energy spectrum from simulated detector responses and real cosmic-ray data. The statistical properties of the ML estimator were investigated and shown to have the three desirable properties: (Pl) consistency (asymptotically unbiased), (P2) efficiency (asymptotically attains the Cramer-Rao minimum variance bound), and (P3) asymptotically normally distributed, under a wide range of potential detector response functions. Attainment of these properties necessarily implies that the ML estimation procedure provides the best unbiased estimator possible. While simulation studies can easily determine if a given estimation procedure provides an unbiased estimate of the spectra information, and whether or not the estimator is approximately normally distributed, attainment of the Cramer-Rao bound (CRB) can only be ascertained by calculating the CRB for an assumed energy spectrum- detector response function combination, which can be quite formidable in practice. However, the effort in calculating the CRB is very worthwhile because it provides the necessary means to compare the efficiency of competing estimation techniques and, furthermore, provides a stopping rule in the search for the best unbiased estimator. Consequently, the CRB for both the simple and broken power law energy spectra are derived herein and the conditions under which they are stained in practice are investigated.

Howell, L. W., Jr.↗

An Empirical State Error Covariance Matrix Orbit Determination Example

State estimation techniques serve effectively to provide mean state estimates. However, the state error covariance matrices provided as part of these techniques suffer from some degree of lack of confidence in their ability to adequately describe the uncertainty in the estimated states. A specific problem with the traditional form of state error covariance matrices is that they represent only a mapping of the assumed observation error characteristics into the state space. Any errors that arise from other sources (environment modeling, precision, etc.) are not directly represented in a traditional, theoretical state error covariance matrix. First, consider that an actual observation contains only measurement error and that an estimated observation contains all other errors, known and unknown. Then it follows that a measurement residual (the difference between expected and observed measurements) contains all errors for that measurement. Therefore, a direct and appropriate inclusion of the actual measurement residuals in the state error covariance matrix of the estimate will result in an empirical state error covariance matrix. This empirical state error covariance matrix will fully include all of the errors in the state estimate. The empirical error covariance matrix is determined from a literal reinterpretation of the equations involved in the weighted least squares estimation algorithm. It is a formally correct, empirical state error covariance matrix obtained through use of the average form of the weighted measurement residual variance performance index rather than the usual total weighted residual form. Based on its formulation, this matrix will contain the total uncertainty in the state estimate, regardless as to the source of the uncertainty and whether the source is anticipated or not. It is expected that the empirical error covariance matrix will give a better, statistical representation of the state error in poorly modeled systems or when sensor performance is suspect. In its most straight forward form, the technique only requires supplemental calculations to be added to existing batch estimation algorithms. In the current problem being studied a truth model making use of gravity with spherical, J2 and J4 terms plus a standard exponential type atmosphere with simple diurnal and random walk components is used. The ability of the empirical state error covariance matrix to account for errors is investigated under four scenarios during orbit estimation. These scenarios are: exact modeling under known measurement errors, exact modeling under corrupted measurement errors, inexact modeling under known measurement errors, and inexact modeling under corrupted measurement errors. For this problem a simple analog of a distributed space surveillance network is used. The sensors in this network make only range measurements and with simple normally distributed measurement errors. The sensors are assumed to have full horizon to horizon viewing at any azimuth. For definiteness, an orbit at the approximate altitude and inclination of the International Space Station is used for the study. The comparison analyses of the data involve only total vectors. No investigation of specific orbital elements is undertaken. The total vector analyses will look at the chisquare values of the error in the difference between the estimated state and the true modeled state using both the empirical and theoretical error covariance matrices for each of scenario.

Frisbee, Joseph H., Jr.↗

Recursive bias estimation for high dimensional regression smoothers

In multivariate nonparametric analysis, sparseness of the covariates also called curse of dimensionality, forces one to use large smoothing parameters. This leads to biased smoother. Instead of focusing on optimally selecting the smoothing parameter, we fix it to some reasonably large value to ensure an over-smoothing of the data. The resulting smoother has a small variance but a substantial bias. In this paper, we propose to iteratively correct of the bias initial estimator by an estimate of the latter obtained by smoothing the residuals. We examine in details the convergence of the iterated procedure for classical smoothers and relate our procedure to L{sub 2}-Boosting, For multivariate thin plate spline smoother, we proved that our procedure adapts to the correct and unknown order of smoothness for estimating an unknown function m belonging to H({nu}) (Sobolev space where m should be bigger than d/2). We apply our method to simulated and real data and show that our method compares favorably with existing procedures.

97 MATHEMATICS AND COMPUTING↗

Frequency domain analysis of errors in cross-correlations of ambient seismic noise

We analyse random errors (variances) in cross-correlations of ambient seismic noise in the frequency domain, which differ from previous time domain methods. Extending previous theoretical results on ensemble averaged cross-spectrum, we estimate confidence interval of stacked cross-spectrum of finite amount of data at each frequency using non-overlapping windows with fixed length. The extended theory also connects amplitude and phase variances with the variance of each complex spectrum value. Analysis of synthetic stationary ambient noise is used to estimate the confidence interval of stacked cross-spectrum obtained with different length of noise data corresponding to different number of evenly spaced windows of the same duration. This method allows estimating Signal/Noise Ratio (SNR) of noise cross-correlation in the frequency domain, without specifying filter bandwidth or signal/noise windows that are needed for time domain SNR estimations. Based on synthetic ambient noise data, we also compare the probability distributions, causal part amplitude and SNR of stacked cross-spectrum function using one-bit normalization or pre-whitening with those obtained without these pre-processing steps. Natural continuous noise records contain both ambient noise and small earthquakes that are inseparable from the noise with the existing pre-processing steps. Using probability distributions of random cross-spectrum values based on the theoretical results provides an effective way to exclude such small earthquakes, and additional data segments (outliers) contaminated by signals of different statistics (e.g. rain, cultural noise), from continuous noise waveforms. This technique is applied to constrain values and uncertainties of amplitude and phase velocity of stacked noise cross-spectrum at different frequencies, using data from southern California at both regional scale (~35 km) and dense linear array (~20 m) across the plate-boundary faults. A block bootstrap resampling method is used to account for temporal correlation of noise cross-spectrum at low frequencies (0.05–0.2 Hz) near the ocean microseismic peaks.

58 GEOSCIENCES↗

Evapotranspiration simulations in ISIMIP2a—Evaluation of spatio-temporal characteristics with a comprehensive ensemble of independent datasets

Actual land evapotranspiration (ET) is a key component of the global hydrological cycle and an essential variable determining the evolution of hydrological extreme events under different climate change scenarios. However, recently available ET products show persistent uncertainties that are impeding a precise attribution of human-induced climate change. Here, we aim at comparing a range of independent global monthly land ET estimates with historical model simulations from the global water, agriculture, and biomes sectors participating in the second phase of the Inter-Sectoral Impact Model Intercomparison Project (ISIMIP2a). Among the independent estimates, we use the EartH2Observe Tier-1 dataset (E2O), two commonly used reanalyses, a pre-compiled ensemble product (LandFlux-EVAL), and an updated collection of recently published datasets that algorithmically derive ET from observations or observations-based estimates (diagnostic datasets). A cluster analysis is applied in order to identify spatiotemporal differences among all datasets and to thus identify factors that dominate overall uncertainties. The clustering is controlled by several factors including the model choice, the meteorological forcing used to drive the assessed models, the data category (models participating in the different sectors of ISIMIP2a, E2O models, diagnostic estimates, reanalysis-based estimates or composite products), the ET scheme, and the number of soil layers in the models. By using these factors to explain spatial and spatio-temporal variabilities in ET, we and that the model choice mostly dominates (24%{40% of variance explained), except for spatio-temporal patterns of total ET, where the forcing explains the largest fraction of the variance (29%). The most dominant clusters of datasets are further compared with individual diagnostic and reanalysis-based estimates to assess their representation of selected heat waves and droughts in the Great Plains, Central Europe and Western Russia. Although most of the ET estimates capture these extreme events, the generally large spread among the entire ensemble indicates substantial uncertainties.

54 ENVIRONMENTAL SCIENCES↗

Deep Interacting Multiple Model Filtering

In this paper, a deep learning-based multiple model estimation framework is presented for the state estimation of hybrid dynamical systems from high dimensional observations such as camera images. A low dimensional vector which represents the measurement of the latent dynamical system and its corresponding variance are learned using a deep encoder neural network. An Interacting Multiple Model (IMM) filter is used to generate the latent state estimates and covariances using multiple dynamical models, which can be learned using backpropagation through time. The state estimates of the dynamical system and the corresponding covariance matrix are generated from the latent state estimates and covariance using a deep decoder neural network. The whole network is trained in an end-to-end manner using a loss function which minimizes the negative log-likelihood of the neural network parameters. Simulation results are presented using a 2D bouncing ball example and estimation error statistics are computed which demonstrates the accuracy and consistency of the estimation.

Ghananeel Rotithor↗

Singular value decomposition of adjoint flux distributions for Monte Carlo variance reduction

Monte Carlo (MC) shielding calculations often use weight windows (WWs) and biased sources formed from a deterministic estimate of the adjoint flux to improve the convergence rate of tallies. This requires a significant amount of computer memory, which can limit the memory available for high-resolution tally output. A new method is proposed for reducing these memory requirements by using singular value decomposition (SVD) in linear or logarithmic space to approximate the adjoint flux. This method’s performance is evaluated using the Shift and Denovo codes for streaming and diffusion base case problems, followed by problems using the Westinghouse AP1000 and the Joint European Torus. The log SVD reduced WW memory requirements by an order of magnitude in all cases without a significant performance penalty. Additionally, the linear SVD reduced biased source memory requirements by an order of magnitude, but further investigation is needed to account for observed limitations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Utilizing the maximum likelihood estimator for flow analysis

We explore the possibility of evaluating flow harmonics by employing the maximum likelihood estimator (MLE). For a given finite multiplicity, the MLE simultaneously furnishes estimations for all the parameters of the underlying distribution function while efficiently suppressing the variance of measures. Also, the method provides a means to assess a specific class of mixed harmonics, which is not straightforwardly feasible by the approaches primarily based on particle correlations. The results are analyzed using the Wald, likelihood ratio, and score tests of hypotheses. Besides, the resultant flow harmonics obtained using MLE are compared with those derived using particle correlations and event plane methods. Here, the dependencies of extracted flow harmonics on the multiplicity of individual events and the total number of events are analyzed. It is shown that the proposed approach works efficiently to deal with the deficiency in detector acceptability. Moreover, we elaborate on a fictitious scenario where the event plane is not a well-defined quantity in the distribution function. For the latter case, the MLE is shown to largely perform better than the two-particle correlation estimator. In this regard, one concludes that the MLE furnishes a meaningful alternative to the existing approaches for flow analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

The Pattern Across the Continental United States of Evapotranspiration Variability Associated with Water Availability

The spatial pattern across the continental United States of the interannual variance of warm season water-dependent evapotranspiration, a pattern of relevance to land-atmosphere feedback, cannot be measured directly. Alternative and indirect approaches to estimating the pattern, however, do exist, and given the uncertainty of each, we use several such approaches here. We first quantify the water dependent evapotranspiration variance pattern inherent in two derived evapotranspiration datasets available from the literature. We then search for the pattern in proxy geophysical variables (air temperature, stream flow, and NDVI) known to have strong ties to evapotranspiration. The variances inherent in all of the different (and mostly independent) data sources show some differences but are generally strongly consistent they all show a large variance signal down the center of the U.S., with lower variances toward the east and (for the most part) toward the west. The robustness of the pattern across the datasets suggests that it indeed represents the pattern operating in nature. Using Budykos hydroclimatic framework, we show that the pattern can largely be explained by the relative strength of water and energy controls on evapotranspiration across the continent.

Air Temperature↗

Tree cover shows strong sensitivity to precipitation variability across the global tropics

Abstract Aim Vegetation is sensitive to mean annual precipitation (MAP), but the sensitivity of vegetation to precipitation variability (PV) is less clear. Tropical ecosystems are likely to experience increased PV in the future. Here we assessed the importance, magnitude and mechanism of PV effects on tree cover in the context of covarying environmental drivers such as fire, temperature and soil properties. Location Tropical land. Time period 2000–2010. Major taxa studied Trees. Methods We compiled climate, soil and remotely‐sensed tree cover data over tropical land. We then comprehensively assessed the contribution of PV at different time‐scales to tropical tree cover variations and estimated the sensitivity of tree cover to PV changes by conducting rolling‐window regression and variance decomposition analyses. We further adopted a mechanistic modelling approach to test whether water competition between trees and grasses can explain the observed effect of PV. Results We find that PV contributes 33–56% to the total explained spatial variation (65–79%) in tree cover. The contribution of PV depends on MAP and is highest under intermediate MAP (500–1,500 mm). Tree cover generally increases with rainy day frequency and wet season length but shows mixed responses to inter‐annual PV. Based on the estimated sensitivity, tropical tree cover can decrease by 3–5% overall and by up to 20% in Amazonia under a 20% decrease in rainy days. Mechanistic modelling analysis reproduced the continental differences in tree cover along an MAP gradient. Main conclusions Under intermediate rainfall regimes (500–1,500 mm), PV can be a more important determinant of tropical tree cover than conventionally proposed drivers such as MAP and fire. The effect of PV likely results from the sensitivity of tree–grass competition to the temporal distribution of water resources. These results show that climate variability can strongly shape the biosphere.

Xu, Xiangtao↗

PHOTOMETRIC REDSHIFT PROBABILITY DISTRIBUTIONS FOR GALAXIES IN THE SDSS DR8

We present redshift probability distributions for galaxies in the Sloan Digital Sky Survey (SDSS) Data Release 8 imaging data. We used the nearest-neighbor weighting algorithm to derive the ensemble redshift distribution N(z), and individual redshift probability distributions P(z) for galaxies with r < 21.8 and u < 29.0. As part of this technique, we calculated weights for a set of training galaxies with known redshifts such that their density distribution in five-dimensional color-magnitude space was proportional to that of the photometry-only sample, producing a nearly fair sample in that space. We estimated the ensemble N(z) of the photometric sample by constructing a weighted histogram of the training-set redshifts. We derived P(z)'s for individual objects by using training-set objects from the local color-magnitude space around each photometric object. Using the P(z) for each galaxy can reduce the statistical error in measurements that depend on the redshifts of individual galaxies. The spectroscopic training sample is substantially larger than that used for the DR7 release. The newly added PRIMUS catalog is now the most important training set used in this analysis by a wide margin. We expect the primary sources of error in the N(z) reconstruction to be sample variance and spectroscopic failures: The training sets are drawn from relatively small volumes of space, and some samples have large incompleteness. Using simulations we estimated the uncertainty in N(z) due to sample variance at a given redshift to be {approx}10%-15%. The uncertainty on calculations incorporating N(z) or P(z) depends on how they are used; we discuss the case of weak lensing measurements. The P(z) catalog is publicly available from the SDSS Web site.

79 ASTRONOMY AND ASTROPHYSICS↗

Estimates of daily rainfall over the Amazon basin

Five geostationary satellite rain estimation techniques were tested over Amazonia. Individually, the techniques explained 1/4 to 1/3 of the variance of daily gage rainfall. Based in large part on cost, one technique, which involves a nonlinear relation in temperature, was selected to provide a mapping of daily Amazonia rainfall between May 6 and 12, 1987. Accumulated over the 7 days, rainfall by this technique averaged 40 mm. It varied from zero in the southeast to more than 150 mm in the northwest. To the southwest the predominantly convective pattern of the rain image was overlaid by a streakines, implying some baroclinic influence. In maps combining gage observations with satellite estimates, rainfall varied significantly from day to day. Only over the largest scale did a trend emerge: a tendency for rain to withdraw from south to north.

Martin, David W.↗

Linear minimum variance filters applied to carrier tracking

A new approach is taken to the problem of tracking a fixed amplitude signal with a Brownian-motion phase process. Classically, a first-order phase-lock loop (PLL) is used; here, the problem is treated via estimation of the quadrature signal components. In this space, the state dynamics are linear with white multiplicative noise. Therefore, linear minimum-variance filters, which have a particularly simple mechanization, are suggested. The resulting error dynamics are linear at any signal/noise ratio, unlike the classical PLL. During synchronization, and above threshold, this filter with constant gains degrades by 3 per cent in output rms phase error with respect to the classical loop. However, up to 80 per cent of the maximum possible noise improvement is obtained below threshold, where the classical loop is nonoptimum, as demonstrated by a Monte Carlo analysis. Filter mechanizations are presented for both carrier and baseband operation.

Gustafson, D. E.↗

Evaluating Combined Lidar and Polarimeter Measurements of Cloud Top Parameters (Extinction, Scattering Cross Sections, and Droplet Number Density, Liquid Water Content)

We present a new method to derive profiles of extinction from a lidar which is then combined with polarimeter measurements to derive cloud droplet number density (CDNC) in the tops of warm clouds. The method employs polarization-sensitive elastic backscatter lidar measurements to estimate attenuation of the lidar signal within the cloud and polarimeter estimates of cloud droplet size distributions. The measurements used for this demonstration are from NASA Langley Research Center’s High Spectral Resolution Lidar – Generation 2 (HSRL-2) and NASA GISS’s Research Scanning Polarimeter (RSP). The measurements were acquired on NASA’s ACTIVATE mission, during which the instruments were deployed in a down-looking mode from a high-altitude aircraft, which flew in coordination with a low-flying aircraft acquiring coincident in situ measurements of cloud droplet size and number. The high vertical (1.25 m) and horizontal (~50 m) sampling resolution of the HSRL-2 data enabled retrievals of single-scattering extinction profiles to within ~2.5 optical depths of cloud top. Another key feature of the method was the well-calibrated measurement of backscatter at cloud top due to using the HSRL technique. The RSP retrievals of cloud droplet effective radius and variance were accomplished using the “cloud-bow” technique. Overall, the technique provides extinction profile estimates for the top 2.5 optical depths of water clouds that can be used to estimate the cloud droplet number density in various types of warm clouds. The mean extinction values at cloud top (0-1 optical depth) are compared against cloud drop size and number concentration acquired from wing-mounted probes (e.g., DMT Cloud Droplet Probe - CDP, SPEC Fast Cloud Droplet Probe FCDP, and SPEC 2D Stereo Probe - 2DS) that were deployed on the low-flying aircraft. Comparisons between the effective radius and variance from the polarimeter, lidar ratio (extinction to backscatter) from the lidar and polarimeter, and LWC are also presented. All measurements were acquired over the Western North Atlantic over 3 years from 2020 to 2022.

lidar↗

Angular dependence of primordial trispectra and CMB spectral distortions

Under the presence of anisotropic sources in the inflationary era, the trispectrum of the primordial curvature perturbation has a very specific angular dependence between each wavevector that is distinguishable from the one encountered when only scalar fields are present, characterized by an angular dependence described by Legendre polynomials. We examine the imprints left by curvature trispectra on the TT μ bispectrum, generated by the correlation between temperature anisotropies (T) and chemical potential spectral distortions (μ) of the Cosmic Microwave Background (CMB). Due to the angular dependence of the primordial signal, the corresponding TT μ bispectrum strongly differs in shape from TT μ sourced by the usual g {sub NL} or τ{sub NL} local trispectra, enabling us to obtain an unbiased estimation. From a Fisher matrix analysis, we find that, in a cosmic-variance-limited (CVL) survey of TT μ, a minimum detectable value of the quadrupolar Legendre coefficient is d {sub 2} ∼ 0.01, which is 4 orders of magnitude better than the best value attainable from the TTTT CMB trispectrum. In the case of an anisotropic inflationary model with a f (φ) F {sup 2} interaction (coupling the inflaton field φ with a vector kinetic term F {sup 2}), the size of the curvature trispectrum is related to that of quadrupolar power spectrum asymmetry, g {sub *}. In this case, a CVL measurement of TT μ makes it possible to measure g {sub *} down to 10{sup −3}.

79 ASTRONOMY AND ASTROPHYSICS↗

Analytic marginalization of N(z) uncertainties in tomographic galaxy surveys

In this paper, we present a new method to marginalize over uncertainties in redshift distributions, N(z), within tomographic cosmological analyses applicable to current and upcoming photometric galaxy surveys. We allow for arbitrary deviations from the best-guess N(z) governed by a general covariance matrix describing the uncertainty in our knowledge of redshift distributions. In principle, this is marginalization over hundreds or thousands of new parameters describing potential deviations as a function of redshift and tomographic bin. However, by linearly expanding the theory predictions around a fiducial model, this marginalization can be performed analytically, resulting in a modified data covariance matrix that effectively downweights the modes of the data vector that are more sensitive to redshift distribution variations. We showcase this method by applying it to the galaxy clustering measurements from the Hyper Suprime-Cam first data release. We illustrate how to marginalize over sample variance of the calibration sample and a large general systematic uncertainty in photometric estimation methods, and explore the impact of priors imposing smoothness in the redshift distributions.

79 ASTRONOMY AND ASTROPHYSICS↗

Ground-state properties of light 4 n self-conjugate nuclei in ab initio no-core Monte Carlo shell model calculations with nonlocal N N interactions

We report J π = 0 + ground-state energies and point-proton radii of 4 He, 8 Be, 12 C, 16 O, and 20 Ne nuclei calculated by the ab initio no-core Monte Carlo shell model with the JISP16 and Daejeon16 nonlocal NN interactions. Ground-state energies are obtained in the basis spaces up to seven oscillator shells (N shell =7) with several oscillator energies (ℏω) around the optimal oscillator energy for the convergence of ground-state energies. These energy eigenvalues are extrapolated to obtain estimates of converged ground-state energies in each basis space using energy variances of computed energy eigenvalues. We further extrapolate these energy-variance-extrapolated energies obtained in the finite basis spaces to infinite basis-space results with an empirical exponential form. This form features a dependence on the basis-space size but is independent of the value of ℏω used for the harmonic-oscillator basis functions. Point-proton radii for these states of atomic nuclei are also calculated following techniques employed for the energies. From these results, it is found that the Daejeon16 NN interaction provides good agreement with experimental data up to approximately 16 O, while the JISP16 NN interaction provides good agreement with experimental data up to approximately 12 C. Beyond these nuclei, the interactions produce overbinding accompanied by radii that are too small. These findings suggest and encourage further revisions of nonlocal NN interactions towards the investigation of nuclear structure in heavier-mass regions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Sparse matrix transform for fast projection to reduced dimension

We investigate three algorithms that use the sparse matrix transform (SMT) to produce variance-maximizing linear projections to a lower-dimensional space. The SMT expresses the projection as a sequence of Givens rotations and this enables computationally efficient implementation of the projection operator. The baseline algorithm uses the SMT to directly approximate the optimal solution that is given by principal components analysis (PCA). A variant of the baseline begins with a standard SMT solution, but prunes the sequence of Givens rotations to only include those that contribute to the variance maximization. Finally, a simpler and faster third algorithm is introduced; this also estimates the projection operator with a sequence of Givens rotations, but in this case, the rotations are chosen to optimize a criterion that more directly expresses the dimension reduction criterion.

97 MATHEMATICS AND COMPUTING↗