Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistical inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Regression of exchangeable relational arrays

Relational arrays represent measures of association between pairs of actors, often in varied contexts or over time. Trade flows between countries, financial transactions between individuals, contact frequencies between school children in classrooms and dynamic protein-protein interactions are all examples of relational arrays. Elements of a relational array are often modelled as a linear function of observable covariates. Uncertainty estimates for regression coefficient estimators, and ideally the coefficient estimators themselves, must account for dependence between elements of the array, e.g., relations involving the same actor. Existing estimators of standard errors that recognize such relational dependence rely on estimating extremely complex, heterogeneous structure across actors. This paper develops a new class of parsimonious coefficient and standard error estimators for regressions of relational arrays. Here we leverage an exchangeability assumption to derive standard error estimators that pool information across actors, and are substantially more accurate than existing estimators in a variety of settings. This exchangeability assumption is pervasive in network and array models in the statistics literature, but not previously considered when adjusting for dependence in a regression setting with relational data. We demonstrate improvements in inference theoretically, via a simulation study, and by analysis of a dataset involving international trade.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Daily Forecasting of Regional Epidemics of Coronavirus Disease with Bayesian Uncertainty Quantification, United States

To increase situational awareness and support evidence-based policymaking, we formulated a mathematical model for coronavirus disease transmission within a regional population. This compartmental model accounts for quarantine, self-isolation, social distancing, a nonexponentially distributed incubation period, asymptomatic persons, and mild and severe forms of symptomatic disease. We used Bayesian inference to calibrate region-specific models for consistency with daily reports of confirmed cases in the 15 most populous metropolitan statistical areas in the United States. We also quantified uncertainty in parameter estimates and forecasts. This online learning approach enables early identification of new trends despite considerable variability in case reporting.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1980

Inversion of multiwavelength radiometer measurements by three-dimensional filtering

Remote sensing data from satellites typically have three dimensions: scan position, spacecraft position, and wavelength. Inversion of the radiometric data to infer geophysical parameters is a filtering problem in which the dimension of wavelength (or channel number) is transformed into a dimension of geophysical parameters, and the most general solution is a three-dimensional filter. Linear filters have the advantages of computational speed and easily described transfer functions; but often the measurements are nonlinear functions of the parameters to be inferred. To the extent that the nonlinear inversion problem is overdetermined, it can be modeled by a critically determined linear problem. As an example, inversion of Scanning Multichannel Microwave Radiometer (SMMR) data by means of a three-dimensional Wiener Filter is described. Atmospheric water vapor content, rain liquid water content, surface wind speed and surface temperature are the parameters inferred from the measurements. Nonprecipitating liquid water and water vapor scale height are also modeled but not retrieved. The a priori statistics on which the filter is trained have the effect of governing the selection of a trade-off point of noise as a function of resolution (in all three retrieval dimensions).

Rosenkranz, P. W.↗
NASA NTRS1985

Observed relation between thermal emission and reflected spectral radiance of a complex vegetated landscape

An investigation is conducted, for a complex vegetated land area, into the statistical relationship between remotely sensed thermal emissions and reflected spectral radiance. The Kauth-Thomas Tasseled Cap transformation is employed to infer the albedo and amount of green vegetation present from Landsat multispectral scanner (MSS) observations. Reflective data and thermal infrared data were acquired from the Heat Capacity Mapping Mission (HCMM) satellite along with reflective data from the Landsat 3 MSS for a site near Hartford, CT on a single date. Results are presented which indicate that thermal emissions had the greatest association with the amount of vegetation as indicated by a multispectral index, while albedo did not exhibit any substantial relationship with these emissions. These findings are explained in terms of the enhanced latent heat flux to the atmosphere associated with actively transpiring vegetation.

Goward, S. N.↗
DOE OSTI2024

Joint inference of multiplicative and additive systematics in galaxy density fluctuations and clustering measurements

Galaxy clustering measurements are a key probe of the matter density field in the Universe. With the era of precision cosmology upon us, surveys rely on precise measurements of the clustering signal for meaningful cosmological analysis. However, the presence of systematic contaminants can bias the observed galaxy number density, and thereby bias the galaxy two-point statistics. As the statistical uncertainties get smaller, correcting for these systematic contaminants becomes increasingly important for unbiased cosmological analysis. We present and validate a new method for understanding and mitigating both additive and multiplicative systematics in galaxy clustering measurements (two-point function) by joint inference of contaminants in the galaxy overdensity field (one-point function) using a maximum-likelihood estimator (MLE). We test this methodology with Kilo-Degree Survey-like mock galaxy catalogues and synthetic systematic template maps. We estimate the cosmological impact of such mitigation by quantifying uncertainties and possible biases in the inferred relationship between the observed and the true galaxy clustering signal. Our method robustly corrects the clustering signal to the sub-percent level and reduces numerous additive and multiplicative systematics from 1.5σ to less than 0.1σ for the scenarios we tested. In addition, we provide an empirical approach to identifying the functional form (additive, multiplicative, or other) by which specific systematics contaminate the galaxy number density. Even though this approach is tested and geared towards systematics contaminating the galaxy number density, the methods can be extended to systematics mitigation for other two-point correlation measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

SIMILE enables alignment of tandem mass spectra with statistical significance

Abstract Interrelating small molecules according to their aligned fragmentation spectra is central to tandem mass spectrometry-based untargeted metabolomics. Current alignment algorithms do not provide statistical significance and compounds that have multiple delocalized structural differences and therefore often fail to have their fragment ions aligned. Here we align fragmentation spectra with both statistical significance and allowance for multiple chemical differences using Significant Interrelation of MS/MS Ions via Laplacian Embedding (SIMILE). SIMILE yields spectral alignment inferred structural connections in molecular networks that are not found with cosine-based scoring algorithms. In addition, it is now possible to rank spectral alignments based on p-values in the exploration of structural relationships between compounds and enhance the chemical connectivity that can be obtained with molecular networking.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

A composite likelihood approach for inference under photometric redshift uncertainty

ABSTRACT Obtaining accurately calibrated redshift distributions of photometric samples is one of the great challenges in photometric surveys like LSST, Euclid, HSC, KiDS, and DES. We present an inference methodology that combines the redshift information from the galaxy photometry with constraints from two-point functions, utilizing cross-correlations with spatially overlapping spectroscopic samples, and illustrate the approach on CosmoDC2 simulations. Our likelihood framework is designed to integrate directly into a typical large-scale structure and weak lensing analysis based on two-point functions. We discuss efficient and accurate inference techniques that allow us to scale the method to the large samples of galaxies to be expected in LSST. We consider statistical challenges like the parametrization of redshift systematics, discuss and evaluate techniques to regularize the sample redshift distributions, and investigate techniques that can help to detect and calibrate sources of systematic error using posterior predictive checks. We evaluate and forecast photometric redshift performance using data from the CosmoDC2 simulations, within which we mimic a DESI-like spectroscopic calibration sample for cross-correlations. Using a combination of spatial cross-correlations and photometry, we show that we can provide calibration of the mean of the sample redshift distribution to an accuracy of at least 0.002(1 + z), consistent with the LSST-Y1 science requirements for weak lensing and large-scale structure probes.

(cosmology:) large-scale structure of Universe↗
DOE OSTI2023

Accurate model of the projected velocity distribution of galaxies in dark matter haloes

ABSTRACT We present a per cent-level accurate model of the line-of-sight velocity distribution of galaxies around dark matter haloes as a function of projected radius and halo mass. The model is developed and tested using synthetic galaxy catalogues generated with the UniverseMachine run on the Multi-Dark Planck 2 N-body simulations. The model decomposes the galaxies around a cluster into three kinematically distinct classes: orbiting, infalling, and interloping galaxies. We demonstrate that: (1) we can statistically distinguish between these three types of galaxies using only projected line-of-sight velocity information; (2) the halo edge radius inferred from the line-of-sight velocity dispersion is an excellent proxy for the three-dimensional halo edge radius; and (3) we can accurately recover the full velocity dispersion profile for each of the three populations of galaxies. Importantly, the velocity dispersion profiles of the orbiting and infalling galaxies contain five independent parameters – three distinct radial scales and two velocity dispersion amplitudes – each of which is correlated with mass. Thus, the velocity dispersion profile of galaxy clusters has inherent redundancies that allow us to perform non-trivial systematics checks from a single data set. We discuss several potential applications of our new model for detecting the edge radius and constraining cosmology and astrophysics using upcoming spectroscopic surveys.

Astronomy & Astrophysics↗
DOE OSTI2024

Expanding neutrino oscillation parameter measurements in NOvA using a Bayesian approach

NOvA is a long-baseline neutrino oscillation experiment that measures oscillations in charged-current ν μ → ν μ (disappearance) and ν μ → ν e (appearance) channels, and their antineutrino counterparts, using neutrinos of energies around 2 GeV over a distance of 810 km. In this work we reanalyze the dataset first examined in our previous paper [] using an alternative statistical approach based on Bayesian Markov chain Monte Carlo. We measure oscillation parameters consistent with the previous results. We also extend our inferences to include the first NOvA measurements of the reactor mixing angle θ 13 , where we find 0.071 ≤ sin 2 2 θ 13 ≤ 0.107 , and the Jarlskog invariant, where we observe no significant preference for the C P -conserving value J = 0 over values favoring C P violation. We use these results to examine the effects of constraints from short-baseline measurements of θ 13 using antineutrinos from nuclear reactors when making NOvA measurements of θ 23 . Our long-baseline measurement of θ 13 is shown to be consistent with the reactor measurements, supporting the general applicability and robustness of the Pontecorvo-Maki-Nakagawa-Sakata framework for neutrino oscillations. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2017

Advances in Medical Analytics Solutions for Autonomous Medical Operations on Long-Duration Missions

A review will be presented on the progress made under STMDGame Changing Development Program Funding towards the development of a Medical Decision Support System for augmenting crew capabilities during long-duration missions, such as Mars Transit. To create an MDSS, initial work requires acquiring images and developing models that analyze and assess the features in such medical biosensor images that support medical assessment of pathologies. For FY17, the project has focused on ultrasound images towards cardiac pathologies: namely, evaluation and assessment of pericardial effusion identification and discrimination from related pneumothorax and even bladder-induced infections that cause inflammation around the heart. This identification is substantially changed due to uncertainty due to conditions of fluid behavior under space-microgravity. This talk will present and discuss the work-to-date in this Project, recognizing conditions under which various machine learning technologies, deep-learning via convolutional neural nets, and statistical learning methods for feature identification and classification can be employed and conditioned to graphical format in preparation for attachment to an inference engine that eventually creates decision support recommendations to remote crew in a triage setting.

Medical Decision Support Systems↗
NASA NTRS2018

Flood Hazard Assessment from Storm Tides, Rain and Sea Level Rise for a Tidal River Estuary

Cities and towns along the tidal Hudson River are highly vulnerable to flooding through the combination of storm tides and high streamflows, compounded by sea level rise. Here a three-dimensional hydrodynamic model, validated by comparing peak water levels for 76 historical storms, is applied in a probabilistic flood hazard assessment. In simulations, the model merges streamflows and storm tides from tropical cyclones (TCs), offshore extratropical cyclones (ETCs) and inland "wet extratropical" cyclones (WETCs). The climatology of possible ETC and WETC storm events is represented by historical events (1931-2013), and simulations include gauged streamflows and inferred ungauged streamflows (based on watershed area) for the Hudson River and its tributaries. The TC climatology is created using a stochastic statistical model to represent a wider range of storms than is contained in the historical record. TC streamflow hydrographs are simulated for tributaries spaced along the Hudson, modeled as a function of TC attributes (storm track, sea surface temperature, maximum wind speed) using a statistical Bayesian approach. Results show WETCs are important to flood risk in the upper tidal river (e.g., Albany, New York), ETCs are important in the estuary (e.g., New York City) and lower tidal river, and TCs are important at all locations due to their potential for both high surge and extreme rainfall. The raising of floods by sea level rise is shown to be reduced by approximately 30-60 percent at Albany due to the dominance of streamflow for flood risk. This can be explained with simple channel flow dynamics, in which increased depth throughout the river reduces frictional resistance, thereby reducing the water level slope and the upriver water level.

Tidal river↗
DOE OSTI2024

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

pyFLANK, a graph neural network based null distribution inference model for F ST outlier detection

Detecting genomic regions under selection is essential for understanding how populations adapt to different environments, yet it remains challenging due to the confounding effects of demographic history and linkage disequilibrium (LD). Fixation index (F ST ) is a widely used statistic to identify genomic regions under adaptation. However, identifying genes under selection by defining F ST outliers often remains challenging, owing to confounding effects of underlying demographic history. Traditional methods assume independence among loci and rely on simple demographic models, while newer models perform much better but are computationally expensive and not easily scalable. Here, we present pyFLANK, an open-source and automated Python implementation which detects F ST outliers using a null distribution inferred from quasi-independent loci. Our tool integrates three approaches to identify loci obeying a null distribution: graph neural network (GNN) inference, linkage disequilibrium (LD)-based inference, and user-defined input. Because pyFLANK uses GNN-based inference of quasi-independent loci, it yields a more accurate null model with less need for user parameter input. In simulation experiments, pyFLANK achieved lower false positive rates than current methods while maintaining comparable detection power, indicating that its refined null model better distinguishes true adaptive loci from background variation. The GNN-based model, in particular, detected additional loci associated with phenotypic variance that were not identified by existing methods. Assessments of simulation and real data from different species demonstrate that pyFLANK achieves lower false positive rates compared with other commonly used F ST outlier detectors, while maintaining comparable detection power and excellent computational performance, providing a robust and user-friendly tool for identifying loci under divergent selection. It extends existing F ST outlier frameworks by incorporating explicit LD-aware strategies for null model calibration. The method is intended as a practical and scalable complement to existing genome scan approaches.

FST↗
DOE OSTI2021

Overview of the Tolerance Limit Calculations with Application to TSURFER

To establish confidence in the results of computerized physics models, a key regulatory requirement is to develop a scientifically defendable process. The methods employed for confidence, characterization, and consolidation, or C3, are statistically involved and are often accessible only to avid statisticians. This manuscript serves as a pedagogical presentation of the C3 process to all stakeholders—including researchers, industrial practitioners, and regulators—to impart an intuitive understanding of the key concepts and mathematical methods entailed by C3. The primary focus is on calculation of tolerance limits, which is the overall goal of the C3 process. Tolerance limits encode the confidence in the calculation results as communicated to the regulator. Understanding the C3 process is especially critical today, as the nuclear industry is considering more innovative ways to assess new technologies, including new reactor and fuel concepts, via an integrated approach that optimally combines modeling and simulation and minimal targeted validation experiments. This manuscript employs intuitive, analytical, numerical, and visual representations to explain how tolerance limits may be calculated for a wide range of configurations, and it also describes how their values may be interpreted. Various verification tests have been developed to test the calculated tolerance limits and to help delineate their values. The manuscript demonstrates the calculation of tolerance limits for TSURFER, a computer code developed by the Oak Ridge National Laboratory for criticality safety applications. The goal is to evaluate the tolerance limit for TSURFER-determined criticality biases to support the determination of upper, subcritical limits for regulatory purposes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Initial soil organic carbon stocks govern changes in soil carbon: Reality or artifact?

Abstract Changes in soil organic carbon (SOC) storage have the potential to affect global climate; hence identifying environments with a high capacity to gain or lose SOC is of broad interest. Many cross‐site studies have found that SOC‐poor soils tend to gain or retain carbon more readily than SOC‐rich soils. While this pattern may partly reflect reality, here we argue that it can also be created by a pair of statistical artifacts. First, soils that appear SOC‐poor purely due to random variation will tend to yield more moderate SOC estimates upon resampling and hence will appear to accrue or retain more SOC than SOC‐rich soils. This phenomenon is an example of regression to the mean. Second, normalized metrics of SOC change—such as relative rates and response ratios—will by definition show larger changes in SOC at lower initial SOC levels, even when the absolute change in SOC does not depend on initial SOC. These two artifacts create an exaggerated impression that initial SOC stocks are a major control on SOC dynamics. To address this problem, we recommend applying statistical corrections to eliminate the effect of regression to the mean, and avoiding normalized metrics when testing relationships between SOC change and initial SOC. Careful consideration of these issues in future cross‐site studies will support clearer scientific inference that can better inform environmental management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Extending empirical constraints on the SZ–mass scaling relation to higher redshifts via HST weak lensing measurements of nine clusters from the SPT-SZ survey at z ≳ 1

We present a Hubble Space Telescope (HST) weak gravitational lensing study of nine distant and massive galaxy clusters with redshifts 1.0 ≲ z ≲ 1.7 (z median = 1.4) and Sunyaev Zel’dovich (SZ) detection significance ξ > 6.0 from the South Pole Telescope Sunyaev Zel’dovich (SPT-SZ) survey. We measured weak lensing galaxy shapes in HST/ACS F606W and F814W images and used additional observations from HST/WFC3 in F110W and VLT/FORS2 in U HIGH to preferentially select background galaxies at z ≳ 1.8, achieving a high purity. We combined recent redshift estimates from the CANDELS/3D-HST and HUDF fields to infer an improved estimate of the source redshift distribution. We measured weak lensing masses by fitting the tangential reduced shear profiles with spherical Navarro-Frenk-White (NFW) models. We obtained the largest lensing mass in our sample for the cluster SPT-CL J2040—4451, thereby confirming earlier results that suggest a high lensing mass of this cluster compared to X-ray and SZ mass measurements. Combining our weak lensing mass constraints with results obtained by previous studies for lower redshift clusters, we extended the calibration of the scaling relation between the unbiased SZ detection significance ζ and the cluster mass for the SPT-SZ survey out to higher redshifts. We found that the mass scale inferred from our highest redshift bin (1.2 < z < 1.7) is consistent with an extrapolation of constraints derived from lower redshifts, albeit with large statistical uncertainties. Thus, our results show a similar tendency as found in previous studies, where the cluster mass scale derived from the weak lensing data is lower than the mass scale expected in a PlanckνΛCDM (i.e. νΛ cold dark matter) cosmology given the SPT-SZ cluster number counts.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Recombination smooths the time-signal disrupted by latency in within-host HIV phylogenies

Within-host HIV evolution involves several features that may disrupt standard phylogenetic reconstruction. One important feature is re-activation of latently integrated provirus, which has the potential to disrupt the temporal signal, leading to variation in the branch lengths and apparent evolutionary rates in a tree. Yet, real within-host HIV phylogenies tend to show clear, ladder-like trees structured by the time of sampling. Another important feature is recombination, which violates the fundamental assumption that evolutionary history can be represented by a single bifurcating tree. Thus, recombination complicates the within-host HIV dynamic by mixing genomes and creating evolutionary loop structures that cannot be represented in bifurcating trees. In this paper, we develop a coalescent-based simulator of within-host HIV evolution that includes latency, recombination, and effective population size dynamics that allows us to study the relationship between the true, complex genealogy of within-host HIV evolution, encoded as an Ancestral Recombination Graph (ARG), and the observed phylogenetic tree. To compare our ARG results to the familiar phylogeny format, we calculate the expected bifurcating tree after decomposing the ARG into all unique site trees, their combined distance matrix, and the overall corresponding bifurcating tree. While latency and recombination separately disrupt the phylogenetic signal, remarkably, we find that recombination recovers the temporal signal of within-host HIV evolution caused by latency by mixing fragments of old, latent genomes into the contemporary population. In effect, recombination averages over extant heterogeneity, whether it stems from mixed time-signals or population bottlenecks. Further, we establish that the signals of latency and recombination can be observed in phylogenetic trees despite being an incorrect representation of the true evolutionary history. Using an Approximate Bayesian Computation method, we develop a set of statistical probes to tune our simulation model to nine longitudinally-sampled within-host HIV phylogenies. Because ARGs are exceedingly difficult to infer from real HIV data, our simulation system allows investigating effects of latency, recombination, and population size bottlenecks by matching decomposed ARGs to real data as observed in standard phylogenies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Empirical radius formulas for canonical neutron stars from bidirectionally selecting features of equations of state in extended Bayesian analyses of observational data

Significant advancement in Bayesian inference of nuclear equation of state (EOS) from gravitational wave and x-ray observations of neutron stars (NSs) has been made by the nuclear astrophysics community especially since GW170817. By extending the traditional Bayesian analysis which normally ends at presenting the marginalized posterior probability distribution functions (PDFs) of individual EOS parameters and their correlations (or sometimes only the Pearson correlation coefficients which are only reliably useful when the variables are linearly correlated while they are actually often not), we search for a data-driven and robust empirical formula for the radius 𝑅 1.4 of canonical NSs in terms of the characteristic EOS parameters (features). We also identify the single most important but currently poorly known EOS parameter for determining the 𝑅 1.4 . Using three regression-model-building methodologies: bidirectional stepwise feature selection, least absolute shrinkage selection operator (LASSO) regression, and neural network regression on a large set of posterior EOSs and the corresponding 𝑅 1.4 values inferred from earlier comprehensive Bayesian analyses of NS observational data, we systematically and rigorously develop the most probable 𝑅 1.4 formulas with varying statistical accuracy and technical complexity. Here, the most important EOS parameters for determining 𝑅 1.4 are found consistently in each of the feature selection processes to be (in order of decreasing importance): curvature 𝐾 sym , slope 𝐿, skewness 𝐽 sym of nuclear symmetry energy, skewness 𝐽 0 , incompressibility 𝐾 0 of symmetric nuclear matter, and the magnitude 𝐸 sym ⁡(𝜌 0 ) of symmetry energy at the saturation density 𝜌 0 of nuclear matter.

Bayesian methods↗