Search NASA⌕ Search

SEARCH · Search NASA

Results for “maximum likelihood estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

A perturbative analysis of synchrotron spectral index variation over the microwave sky

In this paper, we implement a perturbative approach, first proposed by Bouchet and Gispert, to estimate the variation of the spectral index of galactic polarized synchrotron emission, using a linear combination of simulated Stokes Q polarization maps of selected frequency bands from WMAP and Planck observations on a region of sky dominated by the synchrotron Stokes Q signal. We find that a first order perturbative analysis recovers the input spectral index map well. Along with the spectral index variation map, our method provides a fixed reference index, β-hat {sub 0s}, over the sky portion being analyzed. Using Monte-Carlo simulations, we find that 〈 β-hat {sub 0s}〉=−2.84±0.01, which matches very closely with the position of a peak at β{sub s}(p)=−2.85 of the empirical probability density function of input synchrotron indices obtained from the same sky region. For thermal dust, the mean recovered spectral index 〈 β-hat {sub d}〉=2.00±0.004 from simulations, matches very well with the spatially fixed input thermal dust spectral index β{sub d}=2.00. As accompanying results of the method, we reconstruct cosmic microwave background, thermal dust, and a synchrotron template components with fixed spectral indices over the entire sky region. We use, in our analysis, full pixel–pixel noise covariance matrices of all frequency bands, estimated from the sky region being analyzed. The perturbative technique of this work (1) can build a model with an arbitrary but sufficient degree of accuracy (and precession) as allowed by the data and (2) can produce maximum likelihood estimators for reference indices and templates asymptotically.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark Energy Survey Year 1 results: measurement of the galaxy angular power spectrum

We use data from the first-year observations of the DES collaboration to measure the galaxy angular power spectrum (APS), and search for its BAO feature. We test our methodology in a sample of 1800 DES Y1-like mock catalogues. We use the pseudo-C ℓ method to estimate the APS and the mock catalogues to estimate its covariance matrix. We use templates to model the measured spectra and estimate template parameters firstly from the C ℓ ’s of the mocks using two different methods, a maximum likelihood estimator and a Markov Chain Monte Carlo, finding consistent results with a good reduced χ 2 . Robustness tests are performed to estimate the impact of different choices of settings used in our analysis. Finally, we apply our method to a galaxy sample constructed from DES Y1 data specifically for LSS studies. This catalogue comprises galaxies within an effective area of 1318 deg 2 and 0.6 < z < 1.0. We find that the DES Y1 data favour a model with BAO at the 2.6σ C.L. However, the goodness of fit is somewhat poor, with χ 2 /(d.o.f.) = 1.49. We identify a possible cause showing that using a theoretical covariance matrix obtained from C ℓ ’s that are better adjusted to data results in an improved value of χ 2 /(dof) = 1.36 which is similar to the value obtained with the real-space analysis. Lastly, our results correspond to a distance measurement of D A (z eff = 0.81)/r d = 10.65 ± 0.49, consistent with the main DES BAO findings. This is a companion paper to the main DES BAO article showing the details of the harmonic space analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

DeepCMB: Lensing reconstruction of the cosmic microwave background with deep neural networks

Next-generation cosmic microwave background (CMB) experiments will have lower noise and therefore increased sensitivity, enabling improved constraints on fundamental physics parameters such as the sum of neutrino masses and the tensor-to-scalar ratio r. Achieving competitive constraints on these parameters requires high signal-to-noise extraction of the projected gravitational potential from the CMB maps. Standard methods for reconstructing the lensing potential employ the quadratic estimator (QE). However, the QE performs suboptimally at the low noise levels expected in upcoming experiments. Other methods, like maximum likelihood estimators (MLE), are under active development. In this work, we demonstrate reconstruction of the CMB lensing potential with deep convolutional neural networks (CNN) - ie, a ResUNet. The network is trained and tested on simulated data, and otherwise has no physical parametrization related to the physical processes of the CMB and gravitational lensing. We show that, over a wide range of angular scales, ResUNets recover the input gravitational potential with a higher signal-to-noise ratio than the QE method, reaching levels comparable to analytic approximations of MLE methods. We demonstrate that the network outputs quantifiably different lensing maps when given input CMB maps generated with different cosmologies. We also show we can use the reconstructed lensing map for cosmological parameter estimation. This application of CNN provides a few innovations at the intersection of cosmology and machine learning. First, while training and regressing on images, we predict a continuous-variable field rather than discrete classes. Second, we are able to establish uncertainty measures for the network output that are analogous to standard methods. We expect this approach to excel in capturing hard-to-model non-Gaussian astrophysical foreground and noise contributions.

79 ASTRONOMY AND ASTROPHYSICS↗

DeepCMB: Lensing Reconstruction of the CMB with Deep Neural Networks

Next-generation cosmic microwave background (CMB) experiments will have lower noise and therefore increased sensitivity, enabling improved constraints on fundamental physics parameters such as the sum of neutrino masses and the tensor-to-scalar ratio r. Achieving competitive constraints on these parameters requires high signal-to-noise extraction of the projected gravitational potential from the CMB maps. Standard methods for reconstructing the lensing potential employ the quadratic estimator (QE). However, the QE performs suboptimally at the low noise levels expected in upcoming experiments. Other methods, like maximum likelihood estimators (MLE), are under active development. In this work, we demonstrate reconstruction of the CMB lensing potential with deep convolutional neural networks (CNN) - ie, a ResUNet. The network is trained and tested on simulated data, and otherwise has no physical parametrization related to the physical processes of the CMB and gravitati onal lensing. We show that, over a wide range of angular scales, ResUNets recover the input gravitational potential with a higher signal-to-noise ratio than the QE method, reaching levels comparable to analytic approximations of MLE methods. We demonstrate that the network outputs quantifiably different lensing maps when given input CMB maps generated with different cosmologies. We also show we can use the reconstructed lensing map for cosmological parameter estimation. This application of CNN provides a few innovations at the intersection of cosmology and machine learning. First, while training and regressing on images, we predict a continuous-variable field rather than discrete classes. Second, we are able to establish uncertainty measures for the network output that are analogous to standard methods. We expect this approach to excel in capturing hard-to-model non-Gaussian astrophysical foreground and noise contributions.

79 ASTRONOMY AND ASTROPHYSICS↗

Estimation and uncertainty quantification for the output from quantum simulators

The problem of estimating certain distributions over {0, 1} d is considered here. The distribution represents a quantum system of d qubits, where there are non-trivial dependencies between the qubits. A maximum entropy approach is adopted to reconstruct the distribution from exact moments or observed empirical moments. The Robbins Monro algorithm is used to solve the intractable maximum entropy problem, by constructing an unbiased estimator of the un-normalized target with a sequential Monte Carlo sampler at each iteration. In the case of empirical moments, this coincides with a maximum likelihood estimator. A Bayesian formulation is also considered in order to quantify uncertainty a posteriori. Several approaches are proposed in order to tackle this challenging problem, according to recently developed methodologies. In particular, unbiased estimators of the gradient of the log posterior are constructed and used within a provably convergent Langevin-based Markov chain Monte Carlo method. The methods are illustrated on classically simulated output from quantum simulators.

97 MATHEMATICS AND COMPUTING↗

Distributions of the Mean for Lognormally Distributed Data - 19427

In environmental sciences, a distribution of the mean is often needed for right-skewed data. For example, risk assessments are often based on distributions of the mean to obtain upper confidence limits (UCLs) for analyte concentrations, and, in probabilistic performance assessment (PPA) models, parameters are given distributions rather than deterministic values, and they are usually given distributions of their mean rather than the population distributions to account for the large spatial and temporal domains to which they are applied. How this distribution of the mean is developed depends on the characteristics of the parameter's full distribution and how the parameter relates to its use. In this presentation, I will discuss the implications of a right skew in distribution development. Parameters may vary over orders of magnitude and/or may be right-skewed. The material property of saturated hydraulic conductivity, Ks, is a prime example of such a parameter. Right-skewed parameters are often assumed to follow lognormal distributions. If X follows a lognormal distribution, then log(X) follows a normal distribution. For some right-skewed parameters, practitioners go back and forth between the two forms of the data depending on their needs. For example, it may be preferred to use the untransformed version of X in a model or equation, but it is easier to visualize the parameter values on a logarithmic scale. However, distribution development for the average value of the parameter will differ depending on whether X or log(X) is modeled. This difference is due to Jensen's Inequality, a theorem which states that the expected value of a concave function of a variable is less than or equal to the same function of the expected value of the variable; a logarithm is a concave function. In other words, the mean of log(X) is always less than or equal to the log of the mean of X and therefore the mean estimated from a distribution based on log(X) is less than or equal to the mean estimated from a distribution based on X. If a parameter is naturally considered on a log scale by subject matter experts, then distributions developed for the mean of log(X) may be more consistent with the use of the parameters in the literature than distributions developed for X. The statistical decisions of distribution development will be discussed within the context of right-skewed, lognormal data. These issues include method-of-moments versus maximum likelihood estimation of the distribution parameters and the use of bootstrapping to aid in the visualization of a distribution of the mean. The details surrounding Jensen's Inequality will be explained and visualized within the context of distribution development of a right-skewed parameter such as saturated hydraulic conductivity. (authors)

54 ENVIRONMENTAL SCIENCES↗

Estimating basis functions in massive fields under the spatial mixed effects model

Abstract Spatial prediction is commonly achieved under the assumption of a Gaussian random field by obtaining maximum likelihood estimates of parameters, and then using the kriging equations to arrive at predicted values. For massive datasets, fixed rank kriging using the expectation–maximization algorithm for estimation has been proposed as an alternative to the usual but computationally prohibitive kriging method. The method reduces computation cost of estimation by redefining the spatial process as a linear combination of basis functions and spatial random effects. A disadvantage of this method is that it imposes constraints on the relationship between the observed locations and the knots. We develop an alternative method that utilizes the spatial mixed effects model, but allows for additional flexibility by estimating the range of the spatial dependence between the observations and the knots via an alternating expectation conditional maximization algorithm. Experiments show that our methodology improves estimation without sacrificing prediction accuracy while also minimizing the additional computational burden of extra parameter estimation. The methodology is applied to a temperature dataset archived by the United States National Climate Data Center, with improved results over previous methodology.

Pazdernik, Karl↗

The Impact of Below Detection Limit Samples in (NPP) Decommissioning Residual Risk Assessment - 17033

There are some technical problems with finalizing regulations and standards that address nuclear power plant (NPP) decommissioning site soil analyses for license termination. It is difficult to know how to best include detection limit observations from site soil analysis, because typical soil collection data is reported above, at, and below the detection limit. In addition, multiple detection limits are required to adequately estimate the soil radionuclide concentrations. In the literature, researchers analyzing environmental data refer to below the detection limit observations as 'left-censored data'. Left-censored data are less than the detection limit of the instrument(s) that made the measurements. Conventional approaches to managing left-censored data either ignore or simply replace the detection limits with zero, a fraction of the detection limit, or the detection limit itself. However, these approaches are statistically biased and limited in their usefulness. The Kaplan-Meier method, robust regression on order statistics method, and maximum likelihood estimation method are proposed to estimate the left-censored data more precisely. The proposed methods are applied to data from a Monazite powder manufacturing plant and the Colorado School of Mines Research Institute. Summary statistics such as the sample mean, sample standard deviation, sample percentiles are calculated from each data set and are used in risk and volume estimation calculations. Previous environmental analyses, such as the exposure assessment, recognize the uncertainty issue that is addressed in this research using the Latin hypercube sampling approach. Next, probabilistic distributions of the input parameters are developed for the uncertainty analyses. Finally, a framework methodology depicting the decision-making process in the proposed method is presented. The framework defines the critical steps, the amount of radioactivity, types of distributions, censoring percentage, sample size, and number of detection limits; it also allows the user to select the appropriate approach based on their site-specific data and analyses. The goal of this research is to develop a more precise risk assessment, estimate of the volume of soil removal, examine potential cost savings. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Fitting Matérn smoothness parameters using automatic differentiation

The Mat$\acute{e}$rn covariance function is ubiquitous in the application of Gaussian processes to spatial statistics and beyond. Perhaps the most important reason for this is that the smoothness parameter $\nu$ gives complete control over the mean-square differentiability of the process, which has significant implications for the behavior of estimated quantities such as interpolants and forecasts. Unfortunately, derivatives of the Mat$\acute{e}$rn covariance function with respect to $\nu$ require derivatives of the modified second-kind Bessel function $K$ $\nu$ with respect to $\nu$. While closed form expressions of these derivatives do exist, they are prohibitively difficult and expensive to compute. For this reason, many software packages require fixing $\nu$ as opposed to estimating it, and all existing software packages that attempt to offer the functionality of estimating $\nu$ use finite difference estimates for $\partial$ $\nu$ $K$ $\nu$ . In this work, we introduce a new implementation of $K$$\nu$ that has been designed to provide derivatives via automatic differentiation (AD), and whose resulting derivatives are significantly faster and more accurate than those computed using finite differences. Here, we provide comprehensive testing for both speed and accuracy and show that our AD solution can be used to build accurate Hessian matrices for second-order maximum likelihood estimation in settings where Hessians built with finite difference approximations completely fail.

97 MATHEMATICS AND COMPUTING↗

A Bayesian Approach to Regional Decadal Predictability: Sparse Parameter Estimation in High-Dimensional Linear Inverse Models of High-Latitude Sea Surface Temperature Variability

Stochastic reduced models are an important tool in climate systems whose many spatial and temporal scales cannot be fully discretized or underlying physics may not be fully accounted for. One form of reduced model, the linear inverse model (LIM), has been widely used for regional climate predictability studies—typically focusing more on tropical or midlatitude studies. However, most LIM fitting techniques rely on point estimation techniques deriving from fluctuation–dissipation theory. In this methodological study we explore the use of Bayesian inference techniques for LIM parameter estimation of sea surface temperature (SST), to quantify the skillful decadal predictability of Bayesian LIM models at high latitudes. We show that Bayesian methods, when compared to traditional point estimation methods for LIM-type models, provide better calibrated probabilistic skill, while simultaneously providing better point estimates due to the regularization effect of the prior distribution in high-dimensional problems. We compare the effect of several priors, as well as maximum likelihood estimates, on 1) estimating parameter values on a perfect model experiment and 2) producing calibrated 1-yr SST anomaly forecast distributions using a preindustrial control run of the Community Earth System Model (CESM). Finally, we employ a host of probabilistic skill metrics to determine the extent to which an LIM can forecast SST anomalies at high latitudes. We find that the choice of prior distribution has an appreciable impact on estimation outcomes, and priors that emphasize physically relevant properties enhance the model’s ability to capture variability of SST anomalies.

54 ENVIRONMENTAL SCIENCES↗

Probabilistic Data Association for Orbital-Element Estimation Using Multistage Expectation–Maximization

Tracking space objects is important for managing space traffic and predicting collisions, but is difficult in part due to data association and orbit model uncertainty. Expectation–maximization (EM) is a commonly used tracking method that has not been widely considered for tracking space objects. The technique consists of iteratively computing data association probabilities with a set of current element estimates, and updating estimates of the elements by solving a nonlinear weighted least-squares regression problem where the weights are the data association probabilities. In this paper, we demonstrate the use of EM for probabilistic data association and orbital-element estimation by applying the technique to simulated data from two angles-only tracking scenarios. In both scenarios, EM provides correct data associations and accurate maximum likelihood estimates of orbital elements. One scenario considers tracking a single object in clutter and quantifies the improvement of the orbital-element estimates and data associations as the detection probability increases. However, standard application of EM requires knowing the number of objects or may fail when a large number of objects are present. To address these issues, this paper employs a multistage version of EM that is applicable when there are a large and possibly unknown number of objects.

97 MATHEMATICS AND COMPUTING↗

Disorder in the early universe

Little is known about the microscopic physics that gave rise to inflation in our universe. There are many reasons to wonder if the underlying description requires a careful arrangement of ingredients or if inflation was the result of an essentially random process. At a technical level, randomness in the microphysics of inflation is closely related to disorder in solids. We develop the formalism of disorder for inflation and investigate the observational consequences of quenched disorder. We find that a common prediction is the presence of additional noise in the power spectrum or bispectrum. At a phenomenological level, these results can be recast in terms of a modulating field, allowing us to write the quadratic maximum likelihood estimator for this noise. Preliminary constraints on disorder can be derived from existing analyses but significant improvements should be possible with a dedicated treatment.

79 ASTRONOMY AND ASTROPHYSICS↗

ESTIMATION UNCERTAINTY IN THE DETERMINATION OF THE MASTER CURVE REFERENCE TEMPERATURE

The Master Curve Reference Temperature, T0, characterizes the fracture performance of structural steels in the ductile-to-brittle transition region. For a given material, this reference temperature is estimated via fracture toughness testing. A methodology is presented to compute the standard error of an estimated T0 value from a finite sample of toughness data, in a unified manner for both single temperature and multiple temperature test methods. Using the asymptotic properties of maximum likelihood estimators, closed-form expressions for the standard error of the estimate of T0 are presented for both test methods. This methodology includes statistically rigorous treatment of censored data, which represents an advance over the current ASTM E1921 methodology. Through Monte Carlo simulations of realistic single temperature and multiple temperature test plans, the recommended likelihood-based procedure is shown to provide better statistical performance than the methods in the ASTM E1921 standard.

36 MATERIALS SCIENCE↗

Nuclear counting filter based on a centered Skellam test and a double exponential smoothing

Online nuclear counting represents a challenge due to the stochastic nature of radioactivity. The count data have to be filtered in order to provide a precise and accurate estimation of the count rate, this with a response time compatible with the application in view. An innovative filter is presented in this paper addressing this issue. It is a nonlinear filter based on a Centered Skellam Test (CST) giving a local maximum likelihood estimation of the signal based on a Poisson distribution assumption. This nonlinear approach allows to smooth the counting signal while maintaining a fast response when brutal change activity occur. The filter has been improved by the implementation of a Brown's double Exponential Smoothing (BES). The filter has been validated and compared to other state of the art smoothing filters. The CST-BES filter shows a significant improvement compared to all tested smoothing filters. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

MultiPEM Toolbox: User Manual [Rev. 2]

This document explains use of the Multi-Phenomenology Explosion Monitoring (Multi PEM) Toolbox, a collection of R scripts for estimating the unknown device parameters of a new event with uncertainty quantification. The methodology and application used for illustration in this user manual are fully documented in a Los Alamos National Laboratory technical report hereafter designated “WPA” for reference. Additional details on the application are found in a recent journal article. Two assessment types are available: rapid and complete. Rapid assessments are conducted in two stages, as described in Section 2. In the first stage, calibration data are used to estimate forward and error model parameters (WPA, §5.1) and (if relevant) errors-in-variables yield values for calibration sources (WPA, §3, Equation (3)). In the second stage, new event data are used to estimate the unknown new event device parameters (WPA, §5.2) with uncertainty quantification. Two options for treating the inferred first stage parameters in second stage Bayesian analysis are available: fixing them at their maximum likelihood estimate (default), or multiple imputation. Multiple imputation involves utilizing several posterior samples (imputations) of the first stage parameters as fixed values in the second stage posterior sampling of the new event device parameters. Second stage sampling is conducted across imputations in parallel to improve computational efficiency. This method produces improved uncertainty quantification of the new event device parameters compared with the default treatment of the first stage parameters, at the expense of additional computation. Complete assessments are conducted in a single stage, as described in Section 3. Calibration and (if relevant) new event data are used simultaneously to estimate all forward model, error model, and (if relevant) new event device parameters with uncertainty quantification on the latter. As the name suggests, rapid assessments generally run substantially faster than complete assessments (even with multiple imputation), because the results of first stage analysis can be stored and incorporated into estimating a relatively low-dimensional space of new event device parameters whenever relevant new event data becomes available. On the other hand, complete assessments must be run on the full set of model and device parameters with calibration and new event data every time the latter becomes available.

97 MATHEMATICS AND COMPUTING↗

INFERRING THE ECCENTRICITY DISTRIBUTION

Standard maximum-likelihood estimators for binary-star and exoplanet eccentricities are biased high, in the sense that the estimated eccentricity tends to be larger than the true eccentricity. As with most non-trivial observables, a simple histogram of estimated eccentricities is not a good estimate of the true eccentricity distribution. Here, we develop and test a hierarchical probabilistic method for performing the relevant meta-analysis, that is, inferring the true eccentricity distribution, taking as input the likelihood functions for the individual star eccentricities, or samplings of the posterior probability distributions for the eccentricities (under a given, uninformative prior). The method is a simple implementation of a hierarchical Bayesian model; it can also be seen as a kind of heteroscedastic deconvolution. It can be applied to any quantity measured with finite precision-other orbital parameters, or indeed any astronomical measurements of any kind, including magnitudes, distances, or photometric redshifts-so long as the measurements have been communicated as a likelihood function or a posterior sampling.

79 ASTRONOMY AND ASTROPHYSICS↗

DESI DR1 Ly α 1D power spectrum: the Fast Fourier Transform estimator measurement

Here, we present the one-dimensional Lyman-α forest power spectrum measurement derived from the data release 1 (DR1) of the Dark Energy Spectroscopic Instrument (DESI). The measurement of the Lyman-α forest power spectrum along the line of sight from high-redshift quasar spectra provides information on the shape of the linear matter power spectrum, neutrino masses, and the properties of dark matter. In this work, we use a Fast Fourier Transform (FFT)-based estimator, which is validated on synthetic data in a companion paper. Compared to the FFT measurement performed on the DESI early data release, we improve the noise characterization with a cross-exposure estimator and test the robustness of our measurement using various data splits. We also refine the estimation of the uncertainties and now present an estimator for the covariance matrix of the measurement. Furthermore, we compare our results to previous high-resolution and eBOSS measurements. In another companion paper, we present the same DR1 measurement using the Quadratic Maximum Likelihood Estimator (QMLE). These two measurements are consistent with each other and constitute the most precise one-dimensional power spectrum measurement to date, while being in good agreement with results from the DESI early data release.

Lyman alpha forest↗

Unifying simulation and inference with normalizing flows

There have been many applications of deep neural networks to detector calibrations and a growing number of studies that propose deep generative models as automated fast detector simulators. We show that these two tasks can be unified by using maximum likelihood estimation (MLE) from conditional generative models for energy regression. Unlike direct regression techniques, the MLE approach is prior independent and non-Gaussian resolutions can be determined from the shape of the likelihood near the maximum. Using an ATLAS-like calorimeter simulation, we demonstrate this concept in the context of calorimeter energy calibration. Published by the American Physical Society 2025

Hadronic calorimiters↗