Search NASA⌕ Search

SEARCH · Search NASA

Results for “Unbiased estimator”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Uniformly decaying subspaces for error-mitigated quantum computation

Here, we present a general condition to obtain subspaces that decay uniformly in a system governed by the Lindblad master equation and use them to perform error-mitigated quantum computation. The expectation values of dynamics encoded in such subspaces are unbiased estimators of noise-free expectation values. In analogy to the decoherence free subspaces which are left invariant by the action of Lindblad operators, we show that the uniformly decaying subspaces are left invariant (up to orthogonal terms) by the action of the dissipative part of the Lindblad equation. We apply our theory to a system of qubits and qudits undergoing relaxation with varying decay rates and show that such subspaces can be used to eliminate bias up to first-order variations in the decay rates without requiring full knowledge of noise. Since such a bias cannot be corrected through standard symmetry verification, our method can improve error mitigation in dual-rail qubits and, given partial knowledge of noise, can perform better than probabilistic error cancellation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

Linking Community‐Climate Disequilibrium to Ecosystem Function

Turnover in species composition often lags behind the pace of climate change, resulting in mismatches between climate and communities. However, the impact of these community‐climate disequilibria on ecosystem functions is rarely considered, and current methods for measuring disequilibria assume that species ranges were, until recently, in equilibrium with climate. Here, in this work, we develop a simple theoretical model to address both of these problems by linking community‐climate disequilibrium with ecosystem functioning. We show how disequilibrium can impair functioning in the near‐term even when climate change is expected to enhance functioning in the long‐term. Responses are most likely to change over time in communities where turnover is slow, the impact of disequilibrium counteracts the direct effects of climate on ecosystem function, and pre‐existing disequilibrium is large. These findings emphasise the importance of precise and unbiased estimates of community‐climate disequilibria for improving ecological forecasts. By fitting our model to time series of both climate and ecosystem function from a metacommunity simulation, we show the potential for community‐climate disequilibrium to be inferred without direct knowledge about species' distributions or climatic tolerances. We end by outlining a research agenda to apply dynamic disequilibrium concepts and test novel hypotheses across diverse ecosystems.

climate change↗
DOE OSTI2024

Creating Accurate Methane Emission Inventories through Data-Driven Airborne Survey Strategies: Methods and Results from the Haynesville, Anadarko, and Permian Basins

Significantly reducing methane emissions from the oil and gas sector can decrease the rate of climate change over the next two decades, buying critical time for a global energy transition. However, emissions inventories that can be used by oil and gas operators and environmental regulators to identify optimal methane emission mitigation strategies are either based on conservative emission factor methods, or are inconsistent between studies due to differences in sampling strategies or survey technologies. We developed a new approach for methane emissions survey design that yields representative basinwide methane emissions inventories by surveying a subset of total assets in a given oil and gas basin. We identify several sampling and analysis principles, including large sample sizes, balanced sampling across oil and gas production, careful survey area definition, and a unified protocol for analysis, to be vital to producing an unbiased estimate of basin-scale emissions that can be reconciled with future studies. We further present results from deploying this strategy in two oil and gas producing regions in the United States: the Haynesville Basin in Texas and Louisiana, and the Woodford Shale in the Anadarko Basin in Oklahoma. Aerial surveys were performed in 2023 using the Insight M LeakSurveyor™ technology. Preliminary results from methane emissions detected by Insight M indicate that aerially detected emissions above roughly 30 kg(CH4)/hr by themselves contribute a fractional loss rate of 1.13% of gross gas production across oil and gas operations in the Haynesville Basin, with aerially detected emissions equivalent to 2.67% of gross gas production in the Woodford Shale. We supplement these aerial estimates with modeled emissions that are below the LeakSurveyor’s survey sensitivity using a recently published inventory-based model of methane emissions, which we update for our survey areas. We then combine our aerial detections with modeled emissions to yield methane emission distributions and inventories that incorporate the full range of potential methane emissions from the smallest to the largest. These results can be used to identify the most effective methane mitigation strategies for our study areas, and can be reconciled with future methane emissions surveys that use different technologies.

Sherwin, Evan (ORCID:0000000321804297)↗
DOE OSTI2022

Integrating Deep Learning and Hydrodynamic Modeling to Improve the Great Lakes Forecast

The Laurentian Great Lakes, one of the world’s largest surface freshwater systems, pose a modeling challenge in seasonal forecast and climate projection. While physics-based hydrodynamic modeling is a fundamental approach, improving the forecast accuracy remains critical. In recent years, machine learning (ML) has quickly emerged in geoscience applications, but its application to the Great Lakes hydrodynamic prediction is still in its early stages. This work is the first one to explore a deep learning approach to predicting spatiotemporal distributions of the lake surface temperature (LST) in the Great Lakes. Our study shows that the Long Short-Term Memory (LSTM) neural network, trained with the limited data from hypothetical monitoring networks, can provide consistent and robust performance. The LSTM prediction captured the LST spatiotemporal variabilities across the five Great Lakes well, suggesting an effective and efficient way for monitoring network design in assisting the ML-based forecast. Furthermore, we employed an explainable artificial intelligence (XAI) technique named SHapley Additive exPlanations (SHAP) to uncover how the features impact the LSTM prediction. Our XAI analysis shows air temperature is the most influential feature for predicting LST in the trained LSTM. The relatively large bias in the LSTM prediction during the spring and fall was associated with substantial heterogeneity of air temperature during the two seasons. In contrast, the physics-based hydrodynamic model performed better in spring and fall yet exhibited relatively large biases during the summer stratification period. Finally, we developed a statistical integration of the hydrodynamic modeling and deep learning results based on the Best Linear Unbiased Estimator (BLUE). The integration further enhanced prediction accuracy, suggesting its potential for next-generation Great Lakes forecast systems.

Xue, Pengfei (ORCID:000000025702421X)↗
DOE OSTI2025

Measurement and Modeling of Polarized Atmosphere at the South Pole with SPT-3G

We present the detection and characterization of fluctuations in linearly polarized emission from the atmosphere above the South Pole. These measurements make use of data from the SPT-3G receiver on the South Pole Telescope in three frequency bands centered at 95, 150, and 220 GHz. We use the cross-correlation between detectors to produce an unbiased estimate of the power in Stokes I, Q, and U parameters on large angular scales. Our results are consistent with the polarized signal being produced by the combination of Rayleigh scattering of thermal radiation from the ground and thermal emission from a population of horizontally aligned ice crystals with an anisotropic distribution described by Kolmogorov turbulence. The measured spatial scaling, frequency scaling, and elevation dependence of the polarized emission are explained by this model. Polarized atmospheric emission has the potential to significantly impact observations on the large angular scales being targeted by searches for inflationary B-mode CMB polarization. We present the distribution of measured angular power spectrum amplitudes in Stokes Q and I for 4 yr of Austral winter observations, which can be used to simulate the impact of atmospheric polarization and intensity fluctuations at the South Pole on a specified experiment and observation strategy. We present a mitigation strategy that involves both downweighting significantly contaminated observations and subtracting a polarized atmospheric signal from the 150 GHz band maps. In observations with the SPT-3G instrument, the polarized atmospheric signal is a well-understood and subdominant contribution to the measured noise after implementing the mitigation strategies described here.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Efficient Precoding for Single Carrier Modulation in Multi-User Massive MIMO Networks

Abstract—Frequency domain (FD) multi-user detection (MUD) and precoding has been shown to be an effective means of approaching the theoretical per-user capacity for single carrier modulation (SCM) schemes in massive MIMO scenarios with highly dispersive channels. When a cyclic prefix is added to the SCM waveform, the circulant structures of the resulting convolutional channel matrix allows for relatively simple expressions for the FD detection and precoding. In this paper, we further refine the computationally efficient minimum mean squared error (MMSE) FD-MUD technique in a time-division duplexing (TDD) massive MIMO setup by pre-computing the scale factor needed to produce an unbiased estimate. The resulting scale factor and the matrix inverse that was calculated for the uplink is then reused for the downlink to form a computationally efficient precoding scheme with superior performance compared to zero-forcing (ZF) precoding. Performance analysis is provided and confirmed through simulation results.

5G and Beyond Communications↗
DOE OSTI2023

Efficient Subset Simulation using Hamiltonian Neural Network enhanced Markov Chain Monte Carlo Methods

The Monte Carlo method delivers an unbiased estimate of the probability of failure. However, the variance of the estimate depends on the number of evaluated samples. This number must be very large for estimations of a low probability of failure. If the evaluation of each sample is computationally expensive, the crude Monte Carlo simulation strategy is impracticable. Therefore, subset simulations are used to reduce the required number of evaluations. Subset simulations require a Markov Chain Monte Carlo sampler, such as the random walk Metropolis-Hastings algorithm. The algorithm, however, struggles with sampling in low-probability regions, especially if they are narrow. As a consequence, advanced Markov Chain Monte Carlo simulations have been developed. In particular, the Hamiltonian Monte Carlo method explores the target distribution rapidly. Driven by the idea of Hamiltonian dynamics, this sampler provides a non-random walk through the target distribution. The incorporation of subset simulation and Hamiltonian Monte Carlo methods has shown promising results for reliability analysis. One downside of the Hamiltonian Monte Carlo method is that gradient evaluations are computationally expensive, especially when dealing with high-dimensional problems and evaluating long trajectories. We show that integrating Hamiltonian neural networks in Hamiltonian Monte Carlo simulations significantly speeds up the sampling task. Furthermore, the enhancement of adaptive trajectory length within the Hamiltonian Monte Carlo results in the efficient proposal of the following states. Based on this recent enhancement, we provide a fast sampling strategy for subset simulations using Hamiltonian neural networks to replace the evaluation of the gradient and significantly speed up the Hamiltonian Monte Carlo simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A light weight regularization for wave function parameter gradients in quantum Monte Carlo

The parameter derivative of the expectation value of the energy, ∂E/∂p, is a key ingredient in variational Monte Carlo (VMC) wave function optimization methods. In some cases, a naïve estimate of this derivative suffers from an infinite variance, which inhibits the efficiency of optimization methods that rely on a stable estimate of the derivative. In this work, we derive a simple regularization of the naïve estimator, which is trivial to implement in existing VMC codes, has finite variance, and a negligible bias, which can be extrapolated to zero bias with no extra cost. We use this estimator to construct an unbiased, finite variance estimation of ∂E/∂p for a multi-Slater–Jastrow trial wave function on the LiH molecule and in the optimization of a multi-Slater–Jastrow trial wave function on the CuO molecule. This regularized estimator is a simple and efficient estimator of ∂E/∂p for VMC optimization techniques.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Conditional H I Mass Functions and the H I -to-halo Mass Relation in the Local Universe

We present a new H I mass estimator that relates log 10 (M HI /M * ) to a linear combination of four galaxy properties: stellar surface mass density, color index u - r, stellar mass, and concentration index, with the scatter of individual galaxies around the mean H I mass modeled with a Gaussian distribution function. We calibrate the estimator using the xGASS sample, including both H I detection and nondetection, and constrain the model parameters through Bayesian inferences. Tests with mock catalogs demonstrate that our estimator provides unbiased H I masses for optical samples like SDSS. We apply our estimator to the SDSS spectroscopic sample to estimate the H I mass function (HIMF) of local galaxies, as well as the conditional H I mass function in galaxy groups and the H I –halo mass relation. Our HIMF agrees with the ALFALFA measurements at M HI ≳ 5 × 10 9 M ⊙ , but with higher amplitude and a steeper slope at lower masses. We show that this discrepancy is caused primarily by the cosmic variance, which is corrected for the SDSS sample but not for ALFALFA. The total CHIMFs for all halo masses can be described by a single Schechter function, while those of central galaxies show a double-Gaussian profile. The total H I mass in a group increases monotonically with halo mass, but for central galaxies, the H I mass shows weak dependence on halo mass when M h ≳ 10 12 M ⊙ . The observed H I –halo mass relation is not reproduced by current hydrodynamic simulations and semianalytic models of galaxy formation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

A variance deconvolution estimator for efficient uncertainty quantification in Monte Carlo radiation transport applications

Monte Carlo simulations are at the heart of many high-fidelity simulations and analyses for radiation transport systems. As is the case with any complex computational model, it is important to propagate sources of input uncertainty and characterize how they affect model output. Unfortunately, uncertainty quantification (UQ) is made difficult by the stochastic variability that Monte Carlo transport solvers introduce. The standard method to avoid corrupting the UQ statistics with the transport solver noise is to increase the number of particle histories, resulting in very high computational costs. In this contribution, we propose and analyze a sampling estimator based on the law of total variance to compute UQ variance even in the presence of residual noise from Monte Carlo transport calculations. Here, we rigorously derive the statistical properties of the new variance estimator, compare its performance to that of the standard method, and demonstrate its use on neutral particle transport model problems involving both attenuation and scattering physics. We illustrate, both analytically and numerically, the estimator’s statistical performance as a function of available computational budget and the distribution of that budget between UQ samples and particle histories. We show analytically and corroborate numerically that the new estimator is unbiased, unlike the standard approach, and is more accurate and precise than the standard estimator for the same computational budget.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

Active operator learning with predictive uncertainty quantification for partial differential equations

With the increased prevalence of neural operators being used to provide rapid solutions to partial differential equations (PDEs), understanding the accuracy of model predictions and the associated error levels is necessary for deploying reliable surrogate models in scientific applications. Existing uncertainty quantification (UQ) frameworks employ ensembles or Bayesian methods, which can incur substantial computational costs during both training and inference. Here, we propose a lightweight predictive UQ method tailored for Deep operator networks (DeepONets) that also generalizes to other operator networks. Numerical experiments on linear and nonlinear PDEs demonstrate that the framework’s uncertainty estimates are unbiased and provide accurate out-of-distribution uncertainty predictions with a sufficiently large training dataset. Our framework provides fast inference and uncertainty estimates that can efficiently drive outer-loop analyses that would be prohibitively expensive with conventional solvers. We demonstrate how predictive uncertainties can be used in the context of Bayesian optimization and active learning problems to yield improvements in accuracy and data-efficiency for outer-loop optimization procedures. In the active learning setup, we extend the framework to Fourier Neural Operators (FNO) and describe a generalized method for other operator networks. To enable real-time deployment, we introduce an inference strategy based on precomputed trunk outputs and a sparse placement matrix, reducing evaluation time by more than a factor of five. Our method provides a practical route to uncertainty-aware operator learning in time-sensitive settings.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Rare Event Sampling Improves Mercury Instability Statistics

Due to the chaotic nature of planetary dynamics, there is a non-zero probability that Mercury's orbit will become unstable in the future. Previous efforts have estimated the probability of this happening between 3 and 5 billion years in the future using a large number of direct numerical simulations with an N-body code, but were not able to obtain accurate estimates before 3 billion years in the future because Mercury instability events are too rare. In this paper we use a new rare-event sampling technique, Quantile Diffusion Monte Carlo (QDMC), to estimate that the probability of a Mercury instability event in the next 2 billion years is approximately 10 –4 in the REBOUND N-body code. We show that QDMC provides unbiased probability estimates at a computational cost of up to 100 times less than direct numerical simulation. QDMC is easy to implement and could be applied to many problems in planetary dynamics in which it is necessary to estimate the probability of a rare event.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

A comparison of cost and quality of three methods for estimating density for wild pig (Sus scrofa)

A critical element in efective wildlife management is monitoring the status of wildlife populations; however, resources to monitor wildlife populations are typically limited. We compared cost efectiveness of three common population estimation methods (i.e. non-invasive DNA sampling, camera sampling, and sampling from trapping) by applying them to wild pigs (Sus scrofa) across three habitats in South Carolina, U.S.A where they are invasive. We used mark-recapture analyses for fecal DNA sampling data, spatially-explicit capture-recapture analyses for camera sampling data, and a removal analysis for removal sampling from trap data. Density estimates were similar across methods. Camera sampling was the least expensive, but had large variances. Fecal DNA sampling was the most expensive, although this technique generally performed well. We examined how reductions in efort by method related to increases in relative bias or imprecision. For removal sampling, the largest cost savings while maintaining unbiased density estimates was from reducing the number of traps. For fecal DNA sampling, a reduction in efort only minimally reduced costs due to the need for increased lab replicates while maintaining high quality estimates. For camera sampling, efort could only be marginally reduced before inducing bias. We provide a decision tree for researchers to help make monitoring decisions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Application of Generalized Standard Addition Method and Ultraviolet Spectroscopy to Quantify Electrolytic Depolymerization of Lignin

Industrial lignin waste is an important byproduct of bio-refineries and the paper industry. Depolymerization of this industrial lignin could generate useful aromatic compounds. This group has focused on electrolytic decomposition of biorefinery lignin. To quantify electrolytic decomposition of the lignin in a highly caustic solution, ultraviolet (UV) spectroscopy provides a useful probe. The conversion of the neat lignin to the oxidized products achieved by the electrolytic reactor may be measured by quantifying the amount of unreacted neat lignin that remains in the effluent. Because the properties of electrolytic decomposition products are largely unknown, a useful approach to quantify decomposition of the neat lignin is to use a multivariate calibration method referred to as the generalized standard addition method (GSAM). In this approach, the electrolytic decomposition products represent a background interference and the neat lignin that remains can be quantified. Furthermore, this approach allows the conversion of the neat lignin to be calculated in a solution that is a complex mixture.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Convergence of variational Monte Carlo simulation and scale-invariant pre-training

We provide theoretical convergence bounds for the variational Monte Carlo (VMC) method as applied to optimize neural network wave functions for the electronic structure problem. Here, we study both the energy minimization phase and the supervised pre-training phase that is commonly used prior to energy minimization. For the energy minimization phase, the standard algorithm is scale-invariant by design, and we provide a proof of convergence for this algorithm without modifications. The pre-training stage typically does not feature such scale-invariance. We propose using a scale-invariant loss for the pretraining phase and demonstrate empirically that it leads to faster pre-training.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Multitask Machine Learning of Collective Variables for Enhanced Sampling of Rare Events

Computing accurate reaction rates is a central challenge in computational chemistry and biology because of the high cost of free energy estimation with unbiased molecular dynamics. In this work, a data-driven machine learning algorithm is devised to learn collective variables with a multitask neural network, where a common upstream part reduces the high dimensionality of atomic configurations to a low dimensional latent space and separate downstream parts map the latent space to predictions of basin class labels and potential energies. Here, the resulting latent space is shown to be an effective low-dimensional representation, capturing the reaction progress and guiding effective umbrella sampling to obtain accurate free energy landscapes. This approach is successfully applied to model systems including a 5D Müller Brown model, a 5D three-well model, the alanine dipeptide in vacuum, and an Au(110) surface reconstruction unit reaction. It enables automated dimensionality reduction for energy controlled reactions in complex systems, offers a unified and data-efficient framework that can be trained with limited data, and outperforms single-task learning approaches, including autoencoders.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

First cosmology results using type Ia supernovae from the Dark Energy Survey: the effect of host galaxy properties on supernova luminosity

ABSTRACT We present improved photometric measurements for the host galaxies of 206 spectroscopically confirmed type Ia supernovae discovered by the Dark Energy Survey Supernova Program (DES-SN) and used in the first DES-SN cosmological analysis. For the DES-SN sample, when considering a 5D (z, x1, c, α, β) bias correction, we find evidence of a Hubble residual ‘mass step’, where SNe Ia in high-mass galaxies (>1010M⊙) are intrinsically more luminous (after correction) than their low-mass counterparts by $\gamma =0.040\pm 0.019$ mag. This value is larger by 0.031 mag than the value found in the first DES-SN cosmological analysis. This difference is due to a combination of updated photometric measurements and improved star formation histories and is not from host-galaxy misidentification. When using a 1D (redshift-only) bias correction the inferred mass step is larger, with $\gamma =0.066\pm 0.020$ mag. The 1D−5D γ difference for DES-SN is $0.026\pm 0.009$ mag. We show that this difference is due to a strong correlation between host galaxy stellar mass and the x1 component of the 5D distance-bias correction. Including an intrinsic correlation between the observed properties of SNe Ia, stretch and colour, and stellar mass in simulated SN Ia samples, we show that a 5D fit recovers γ with −9 mmag bias compared to a +2 mmag bias for a 1D fit. This difference can explain part of the discrepancy seen in the data. Improvements in modelling correlations between galaxy properties and SN is necessary to ensure unbiased precision estimates of the dark energy equation of state as we enter the era of LSST.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

An iterative CMB lensing estimator minimizing instrumental noise bias

Noise maps from cosmic microwave background (CMB) experiments are generally statistically anisotropic, due to scanning strategies, atmospheric conditions, or instrumental effects. Any mismodeling of this complex noise can bias the reconstruction of the lensing potential and the measurement of the lensing power spectrum from the observed CMB maps. We introduce a new CMB lensing estimator based on the maximum (MAP) reconstruction that is minimally sensitive to these instrumental noise biases. By modifying the likelihood to rely exclusively on correlations between CMB map splits with independent noise realizations, we minimize autocorrelations that contribute to biases. In the regime of many independent splits, this maximum closely approximates the optimal MAP reconstruction of the lensing potential. In simulations, we demonstrate that this method is able to determine lensing observables that are immune to any noise mismodeling with a negligible cost in signal-to-noise ratio. Our estimator enables unbiased and nearly optimal lensing reconstruction for next-generation CMB surveys.

Legrand, Louis [University of Cambridge (United Ki↗