Search NASA⌕ Search

SEARCH · Search NASA

Results for “Unbiased estimator”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Graph Sparsification by Approximate matrix Multiplication

Graphs arising in statistical problems, signal processing, large networks, combinatorial optimization, and data analysis are often dense, which causes both computational and storage bottlenecks. One way of sparsifying a weighted graph, while sharing the same vertices as the original graph but reducing the number of edges, is through spectral sparsification. We study this problem through the perspective of RandNLA. Specifically, we utilize randomized matrix multiplication to give a clean and simple analysis of how sampling according to edge weights gives a spectral approximation to graph Laplacians, without requiring spectral information. Through the CR–MM algorithm, we attain a simple and computationally efficient sparsifier whose resulting Laplacian estimate is unbiased and of minimum variance. Here, we define a new notion of additive spectral sparsifiers, which has not been considered in the literature.

97 MATHEMATICS AND COMPUTING↗

MENT-Flow: maximum-entropy phase space tomography using normalizing flows

Generative models can be trained to reproduce low-dimensional projections of high-dimensional phase space distributions. Normalizing flows are generative models that parameterize invertible transformations, allowing exact probability density evaluation and sampling. Consequently, flows are unbiased entropy estimators and could be used to solve the high-dimensional maximum-entropy tomography (MENT) problem. In this work, we evaluate a flow-based MENT solver (MENT-Flow) against exact maximum-entropy solutions and Minerbo's iterative MENT algorithm in two dimensions.

Hoover, Austin↗

Retrospective Analysis of Backwater Habitat Availability Using Remote Sensing

Low-velocity channel-margin habitats serve as important nursery habitats for the endangered Colorado pikeminnow (Ptychocheilus lucius) in the middle Green River between Jensen and Ouray, Utah. These habitats, known as backwaters, are associated with emergent sandbars, and are shaped and reformed annually by peak flows. Our recent knowledge about backwater characteristics and dynamics that is summarized in the synthesis report (Grippo et al. 2015) was based on detailed annual survey data from a relatively small sample of backwaters that were collected from 2003 to 2014 and reach-wide evaluations of backwater surface area based on manual interpretation of aerial and satellite imagery. Methods that bridge the gap between the detailed surveys from a small number of backwaters and the reach-wide assessment of their surface area would enable an assessment of the availability of backwater habitats that meet the minimum depth requirements for suitable habitat for Colorado pikeminnow. In 2015 Argonne National Laboratory (Argonne) tested three regression models—linear, multiple, and partial least square (PLS) regression models—for estimating backwater depth using National Agriculture Imagery Program (NAIP) imagery collected in July 2006 that covered the Jensen-Ouray reach of the Green River (Hamada and LaGory 2016). The results suggested that a PLS regression model showed high correlation with the reference depth (R 2 = 0.69) and had the most unbiased and consistent estimate of backwater depth. The results also indicated that the PLS model would provide reasonable estimates of the amount of habitat providing a minimum suitable depth of 30 cm for young-of-the-year Colorado pikeminnow, even though absolute depth estimates may be uncertain for backwater areas deeper than approximately 40 cm. The study also provided insights regarding the amount and the selection of calibration and validation (cal-val) data needed for improving the accuracy of depth prediction.

54 ENVIRONMENTAL SCIENCES↗

A machine learning approach for efficient multi-dimensional integration

Many physics problems involve integration in multi-dimensional space whose analytic solution is not available. The integrals can be evaluated using numerical integration methods, but it requires a large computational cost in some cases, so an efficient algorithm plays an important role in solving the physics problems. We propose a novel numerical multi-dimensional integration algorithm using machine learning (ML). After training a ML regression model to mimic a target integrand, the regression model is used to evaluate an approximation of the integral. Then, the difference between the approximation and the true answer is calculated to correct the bias in the approximation of the integral induced by ML prediction errors. Because of the bias correction, the final estimate of the integral is unbiased and has a statistically correct error estimation. Three ML models of multi-layer perceptron, gradient boosting decision tree, and Gaussian process regression algorithms are investigated. The performance of the proposed algorithm is demonstrated on six different families of integrands that typically appear in physics problems at various dimensions and integrand difficulties. The results show that, for the same total number of integrand evaluations, the new algorithm provides integral estimates with more than an order of magnitude smaller uncertainties than those of the VEGAS algorithm in most of the test cases.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A causal data fusion method for the general exposure and outcome

Abstract With the advent of the big data era, the need to combine multiple individual data sets to draw causal effects arises naturally in many medical and biological applications. Especially each data set cannot measure enough confounders to infer the causal effect of an exposure on an outcome. In this article, we extend the method proposed by a previous study to causal data fusion of more than two data sets without external validation and to a more general (continuous or discrete) exposure and outcome. Theoretically, we obtain the condition for identifiability of exposure effects using multiple individual data sources for the continuous or discrete exposure and outcome. The simulation results show that our proposed causal data fusion method has unbiased causal effect estimate and higher precision than traditional regression, meta‐analysis and statistical matching methods. We further apply our method to study the causal effect of BMI on glucose level in individuals with diabetes by combining two data sets. Our method is essential for causal data fusion and provides important insights into the ongoing discourse on the empirical analysis of merging multiple individual data sources.

Li, Hongkai↗

Damping inter-area oscillation using reinforcement learning controlled TCSC

Appropriate damping control of the inter-area oscillation would ensure the grid stability and maintain the tie-line power transfer capability. In this paper, we proposed a novel reinforcement learning (RL) based power oscillation damping (POD) controller that uses Thyristor Controlled Series Compensators (TCSC) to damp inter-area oscillations. By leveraging the unbiased gradient direction estimation of the natural evolution strategy (NES), we successfully regulated the power flows on the tie-lines and damped inter-area oscillations through dynamically modulating the inserted reactance of the TCSC. The proposed RL-based POD controller has been tested on both two-area four-machine system and North American Minni-WECC system. Extensive studies have demonstrated the excellent performance of the proposed RL-based TCSC POD controller in damping inter-area oscillations.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Cosmic shear power spectra in practice

Cosmic shear is one of the most powerful probes of Dark Energy, targeted by several current and future galaxy surveys. Lensing shear, however, is only sampled at the positions of galaxies with measured shapes in the catalog, making its associated sky window function one of the most complicated amongst all projected cosmological probes of inhomogeneities, as well as giving rise to inhomogeneous noise. Partly for this reason, cosmic shear analyses have been mostly carried out in real-space, making use of correlation functions, as opposed to Fourier-space power spectra. Since the use of power spectra can yield complementary information and has numerical advantages over real-space pipelines, it is important to develop a complete formalism describing the standard unbiased power spectrum estimators as well as their associated uncertainties. Building on previous work, this paper contains a study of the main complications associated with estimating and interpreting shear power spectra, and presents fast and accurate methods to estimate two key quantities needed for their practical usage: the noise bias and the Gaussian covariance matrix, fully accounting for survey geometry, with some of these results also applicable to other cosmological probes. Here, we demonstrate the performance of these methods by applying them to the latest public data releases of the Hyper Suprime-Cam and the Dark Energy Survey collaborations, quantifying the presence of systematics in our measurements and the validity of the covariance matrix estimate. We make the resulting power spectra, covariance matrices, null tests and all associated data necessary for a full cosmological analysis publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗

Variance reduction in lattice QCD observables via normalizing flows

Normalizing flows can be used to construct unbiased, reduced-variance estimators for lattice field theory observables that are defined by a derivative with respect to action parameters. This work implements the approach for observables involving gluonic operator insertions in the SU(3) Yang-Mills theory and two-flavor QCD in four space-time dimensions. Variance reduction by factors of 10–60 is achieved in glueball correlation functions and in gluonic matrix elements related to hadron structure, with demonstrated computational advantages. The observed variance reduction is found to be approximately independent of the lattice volume, so volume transfer can be utilized to minimize training costs.

Abbott, Ryan [Columbia U.; MIT, Cambridge, CTP; IA↗

New Probe of Cosmic Birefringence Using Galaxy Polarization and Shapes

We propose a novel statistical method to measure cosmic birefringence and demonstrate its power in probing parity violation due to axions. Exploiting an empirical correlation between the integrated radio polarization direction of a spiral galaxy and its apparent shape, we devise an unbiased minimum-variance estimator for the rotation angle, which should achieve an uncertainty of 5°–15° per galaxy. In conclusion, large galaxy samples from the forthcoming SKA continuum surveys, together with optical shape catalogs, promise a comparable or even lower noise power spectrum for the rotation angle than in the CMB Stage-IV (CMB-S4) experiment, with different systematics.

Axion-like particles↗

Error mitigated metasurface-based randomized measurement schemes

Estimating properties of quantum states via randomized measurements has become a significant part of quantum information science. In this paper, we design an innovative approach leveraging metasurfaces to perform randomized measurements on photonic qubits, together with error mitigation techniques that suppress realistic metasurface measurement noise. Through fidelity and purity estimation, we confirm the capability of metasurfaces to implement randomized measurements and the unbiased nature of our error-mitigated estimator. Our findings show the potential of metasurface-based randomized measurement schemes in achieving robust and resource-efficient estimation of quantum state properties. Published by the American Physical Society 2024

Ren, Hang (ORCID:0000000255448692)↗

DESI DR1 Ly α 1D power spectrum: Validation of estimators

The Data Release 1 (DR1) of the Dark Energy Spectroscopic Instrument (DESI) is the largest sample to date for small-scale Lyα forest cosmology, accessed through its one-dimensional power spectrum (P 1D ). The Lyα forest P 1D is extracted from quasar spectra that are highly inhomogeneous (both in wavelength and between quasars) in noise properties due to intrinsic properties of the quasar, atmospheric and astrophysical contamination, and also sensitive to low-level details of the spectral extraction pipeline. We employ two estimators in DR1 analysis to measure P 1D : the optimal estimator and the fast Fourier transform (FFT) estimator. To ensure robustness of our DR1 measurements, we validate these two power spectrum and covariance matrix estimation methodologies against the challenging aspects of the data. First, using a set of 20 synthetic 1D realizations of DR1, we derive the masking bias corrections needed for the FFT estimator and the continuum fitting bias needed for both estimators. We demonstrate that both estimators, including their covariances, are unbiased with these corrections using the Kolmogorov-Smirnov test. Second, we substantially extend our previous suite of CCD image simulations to include 675,000 quasars, allowing us to accurately quantify the pipeline's performance. This set of simulations reveals biases at the highest k values, corresponding to a resolution error of a few percent. We base the resolution systematics error budget of DR1 P 1D on these values, but do not derive corrections from them since the simulation fidelity is insufficient for precise corrections.

Lyman alpha forest↗

SpecDis: Value Added Distance Catalog for 4 Million Stars from DESI Year-1 Data

We present the SpecDis value-added stellar distance catalog accompanying DESI Data Release 1. SpecDis trains a feed-forward neural network (NN) with Gaia parallaxes and gets the distance estimates. To build up an unbiased training sample, we do not apply selections on parallax error or signal-to-noise (S/N) of the stellar spectra, and instead, we incorporate parallax error into the loss function. Moreover, we employ principal component analysis to reduce the noise and dimensionality of stellar spectra. Validated by independent external samples of member stars with precise distances from globular clusters, dwarf galaxies, stellar streams, combined with blue horizontal branch stars, we demonstrate that our distance measurements show no significant bias up to 100 kpc, and are much more precise than Gaia parallax beyond 7 kpc. The median distance uncertainties are 23%, 19%, 11%, and 7% for S/N < 20, 20 ≤ S/N < 60, 60 ≤ S/N < 100, and S/N ≥ 100. Selecting stars with ${\mathrm{log}}\,g\lt 3.8$ and distance uncertainties smaller than 25%, we have more than 74,000 giant candidates within 50 kpc of the Galactic center and 1500 candidates beyond this distance. Additionally, we develop a Gaussian mixture model to identify unresolvable equal-mass binaries by modeling the discrepancy between the NN-predicted and the geometric absolute magnitudes from Gaia parallaxes and identify 120,000 equal-mass binary candidates. Our final catalog provides distances and distance uncertainties for >4 million stars, offering a valuable resource for Galactic astronomy.

astronomy data analysis↗

A Measurement of the Largest-scale CMB E -mode Polarization with CLASS

We present measurements of large-scale cosmic microwave background E-mode polarization from the Cosmology Large Angular Scale Surveyor 90 GHz data. Using 115 det-yr of observations collected through 2024 with a variable-delay polarization modulator, we achieved a polarization sensitivity of 82 μK arcimin, comparable to Planck at similar frequencies (100 and 143 GHz ). The analysis demonstrates effective mitigation of systematic errors and addresses challenges to large-angular-scale power recovery posed by time-domain filtering in maximum-likelihood map-making. A novel implementation of the pixel-space transfer matrix is introduced, which enables efficient filtering simulations and bias correction in the power spectrum using the quadratic cross-spectrum estimator. Overall, we achieved an unbiased time-domain filtering correction to recover the largest angular scale polarization, with the only power deficit, arising from map-making nonlinearity, being characterized as <3%. Through cross-correlation with Planck, we detected the cosmic reionization at 99.4% significance and measured the reionization optical depth τ = $0.053^{+0.018}_{-0.019}$, marking the first ground-based attempt at such a measurement. At intermediate angular scales (ℓ > 30), our results, both independently and in cross-correlation with Planck, remain fully consistent with Planck’s measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

Stochastic Approximation for Multi-period Simulation Optimization with Streaming Input Data

We consider a continuous-valued simulation optimization (SO) problem, where a simulator is built to optimize an expected performance measure of a real-world system while parameters of the simulator are estimated from streaming data collected periodically from the system. At each period, a new batch of data is combined with the cumulative data and the parameters are re-estimated with higher precision. The system requires the decision variable to be selected in all periods. Therefore, it is sensible for the decision-maker to update the decision variable at each period by solving a more precise SO problem with the updated parameter estimate to reduce the performance loss with respect to the target system. We define this decision-making process as the multi-period SO problem and introduce a multi-period stochastic approximation (SA) framework that generates a sequence of solutions. Two algorithms are proposed: Re-start SA (ReSA) reinitializes the stepsize sequence in each period, whereas Warm-start SA (WaSA) carefully tunes the stepsizes, taking both fewer and shorter gradient-descent steps in later periods as parameter estimates become increasingly more precise. We show that under suitable strong convexity and regularity conditions, ReSA and WaSA achieve the best possible convergence rate in expected sub-optimality either when an unbiased or a simultaneous perturbation gradient estimator is employed, while WaSA accrues significantly lower computational cost as the number of periods increases. In addition, we present the regularized ReSA, which obviates the need to know the strong convexity constant and achieves the same convergence rate at the expense of additional computation.

Computer Science↗

Verification of Combined VR Techniques, Derivation of Future Time Equation, and Integration of LLNL Pulsed Sphere V&V Suite [Slides]

To determine whether the combination of forced-collision and DXTRAN variance-reduction (VR) techniques is unbiased, and to gain insight into the operation of these techniques, proof that first-moment estimates from Monte Carlo simulations employing both techniques are unbiased is developed. A general background on the forced-collision and DXTRAN VR techniques and their combination is given. Proof of an unbiased simulation is outlined by showing the equivalence of the history score moment equations of simulations with these techniques in use. A report with detailed proof of this equivalence is available upon request. The derivation of the future time equation using a similar approach, as well as a summary of the addition of the LLNL Pulsed Sphere experiments to the MCNP verification and validation suite, is also briefly discussed.

97 MATHEMATICS AND COMPUTING↗

Measuring the Hubble Constant with Dark Neutron Star–Black Hole Mergers

Abstract Detection of gravitational waves (GWs) from neutron star-black hole (NSBH) standard sirens provides local measurements of the Hubble constant (H 0 ), regardless of the detection of an electromagnetic (EM) counterpart, given that matter effects can be exploited to break the redshift degeneracy of the GW waveforms. The distinctive merger morphology and the high-redshift detectability of tidally disrupted NSBH make them promising candidates for this method. Also, the detection prospects of an EM counterpart for these systems will be limited toz< 0.8 in the optical, in the era of future GW detectors. Using recent constraints on the equation of state of NSs from multi-messenger observations of NICER and LIGO/Virgo/KAGRA, we show the prospects of measuringH 0 solely from GW observation of NSBH systems, achievable by the Einstein telescope (ET) and Cosmic Explorer (CE) detectors. We first analyze individual events to quantify the effect of high-frequency (≥500 Hz) tidal distortions on the inference of NS tidal deformability parameter (Λ) and hence onH 0 . We find that disruptive mergers can constrain Λ up to  ( 60 % ) more precisely than nondisruptive ones. However, this precision is not sufficient to place stringent constraints on theH 0 from individual events. By performing Bayesian analysis on simulated NSBH data (up toN= 100 events, corresponding to a day of observation) in the ET+CE detectors, we find that NSBH systems enable unbiased 4%–13% precision on the estimate ofH 0 (68% credible interval). This is a similar measurement precision found in studies analyzing NSBH mergers with EM counterparts in the LVKC O5 era.

Astronomy & Astrophysics↗

Hedonic Price Estimates of Lake Water Quality: Valued Attribute, Instrumental Variables, and Ecological-Economic Benefits

We estimate the effect of lake water quality on residential housing prices using cross-sectional data on water clarity from 113 lakes across the United States. An instrumental-variables approach is developed to address potential endogeneity bias in the water-clarity variable. Three lake-based physical variables serve as instrumental variables: total nitrogen concentration in lake water, total phosphorus concentration in lake water, and water temperature near the lake surface. The econometric results include three methodological findings: the instruments are valid and strong; the ordinary-least-squares estimate of the coefficient on the water-clarity variable is unbiased; and water clarity is the attribute of water quality valued in the housing market. The estimated water-clarity effect shows that a one-tenth of a meter change in water clarity leads to a one-percent change in housing price, or an elasticity of 0.20 at mean clarity. Coupling this effect with estimates of an ecological production function, a lake-specific benefit index is developed that shows the effect on housing values of bringing lakes into compliance with the US Environmental Protection Agency's regional recommendations for phosphorous concentration in lake waters.

54 ENVIRONMENTAL SCIENCES↗

Mitigation of DESI fiber assignment incompleteness effect on two-point clustering with small angular scale truncated estimators

We present a method to mitigate the effects of fiber assignment incompleteness in two-point power spectrum and correlation function measurements from galaxy spectroscopic surveys, by truncating small angular scales from estimators. We derive the corresponding modified correlation function and power spectrum windows to account for the small angular scale truncation in the theory prediction. We validate this approach on simulations reproducing the Dark Energy Spectroscopic Instrument (DESI) Data Release 1 (DR1) with and without fiber assignment. We show that we recover unbiased cosmological constraints using small angular scale truncated estimators from simulations with fiber assignment incompleteness, with respect to standard estimators from complete simulations. Additionally, we present an approach to remove the sensitivity of the fits to high k modes in the theoretical power spectrum, by applying a transformation to the data vector and window matrix. We find that our method efficiently mitigates the effect of fiber assignment incompleteness in two-point correlation function and power spectrum measurements, at low computational cost and with little statistical loss.

79 ASTRONOMY AND ASTROPHYSICS↗