SEARCH · Search NASA

Results for “Resampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Machine learning framework for quantum sampling of highly constrained, continuous optimization problems

In recent years, there is growing interest in using quantum computers for solving combinatorial optimization problems. In this work, we developed a generic, machine learning-based framework for mapping continuous-space inverse design problems into surrogate quadratic unconstrained binary optimization (QUBO) problems by employing a binary variational autoencoder and a factorization machine. The factorization machine is trained as a low-dimensional, binary surrogate model for the continuous design space and sampled using various QUBO samplers. Using the D-Wave Advantage hybrid sampler and simulated annealing, we demonstrate that by repeated resampling and retraining of the factorization machine, our framework finds designs that exhibit figures of merit exceeding those of its training set. We showcase the framework’s performance on two inverse design problems by optimizing (i) thermal emitter topologies for thermophotovoltaic applications and (ii) diffractive meta-gratings for highly efficient beam steering. This technique can be further scaled to leverage future developments in quantum optimization to solve advanced inverse design problems for science and engineering applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2026

Constrained variational optimization of counting-time allocation in sequential scattering measurements: Application to Bonse–Hart USANS

Sequential scattering measurements are often performed under a fixed experimental-time budget, even though the expected count rate varies strongly across the measured coordinate. When the dwell time at each measurement position can be controlled independently, this variation creates a general resource-allocation problem: how should the available time be distributed to minimize the uncertainty of the reconstructed profile? We formulate this problem as a constrained variational optimization for measurements governed by Poisson counting statistics. When each measurement is treated independently, minimizing the averaged squared relative uncertainty yields an inverse-square-root intensity allocation. The formulation is then generalized to include correlations between neighboring measurements and an instrumental resolution operator, leading to an allocation criterion that equalizes the marginal reduction in posterior uncertainty per unit measurement time. Bonse–Hart ultra-small-angle neutron scattering (USANS), in which reciprocal space is sampled sequentially through analyzer-angle stepping, provides an experimentally grounded application. Computational benchmarking shows that the optimized allocation outperforms uniform-time and constant-relative-error strategies, while application to an experimentally measured graphite USANS profile from the Spallation Neutron Source, using Poisson resampling under alternative schedules, demonstrates how counting time should be redistributed toward weak-intensity regions under an identical total duration. The resulting framework applies to sequential scattering and related scanning measurements whenever local dwell times are adjustable and directly determine the measurement uncertainties, and when the relevant correlation and instrumental-response models are available.

Tung, Chi-Huan [ORNL] (ORCID:0000000221972074)↗

DOE OSTI2024

Sequential Kalman tuning of the t -preconditioned Crank-Nicolson algorithm: efficient, adaptive and gradient-free inference for Bayesian inverse problems

Ensemble Kalman Inversion (EKI) has been proposed as an efficient method for the approximate solution of Bayesian inverse problems with expensive forward models. However, when applied to the Bayesian inverse problem EKI is only exact in the regime of Gaussian target measures and linear forward models. Here, in this work we propose embedding EKI and Flow Annealed Kalman Inversion, its normalizing flow (NF) preconditioned variant, within a Bayesian annealing scheme as part of an adaptive implementation of the t-preconditioned Crank-Nicolson (tpCN) sampler. The tpCN sampler differs from standard pCN in that its proposal is reversible with respect to the multivariate t-distribution. The more flexible tail behaviour allows for better adaptation to sampling from non-Gaussian targets. Within our Sequential Kalman Tuning (SKT) adaptation scheme, EKI is used to initialize and precondition the tpCN sampler for each annealed target. The subsequent tpCN iterations ensure particles are correctly distributed according to each annealed target, avoiding the accumulation of errors that would otherwise impact EKI. We demonstrate the performance of SKT for tpCN on three challenging numerical benchmarks, showing significant improvements in the rate of convergence compared to adaptation within standard SMC with importance weighted resampling at each temperature level, and compared to similar adaptive implementations of standard pCN. The SKT scheme applied to tpCN offers an efficient, practical solution for solving the Bayesian inverse problem when gradients of the forward model are not available. Code implementing the SKT schemes for tpCN is available at https://github.com/RichardGrumitt/KalmanMC.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Testing general relativity on cosmological scales at redshift z ∼ 1.5 with quasar and CMB lensing

ABSTRACT We test general relativity (GR) at the effective redshift $\bar{z} \sim 1.5$ by estimating the statistic EG, a probe of gravity, on cosmological scales $19 - 190\, h^{-1}{\rm Mpc}$. This is the highest redshift and largest scale estimation of EG so far. We use the quasar sample with redshifts 0.8 < z < 2.2 from Sloan Digital Sky Survey IV extended Baryon Oscillation Spectroscopic Survey Data Release 16 as the large-scale structure (LSS) tracer, for which the angular power spectrum $C_\ell ^{qq}$ and the redshift-space distortion parameter β are estimated. By cross-correlating with the Planck 2018 cosmic microwave background (CMB) lensing map, we detect the angular cross-power spectrum $C_\ell ^{\kappa q}$ signal at $12\, \sigma$ significance. Both jackknife resampling and simulations are used to estimate the covariance matrix (CM) of EG at five bins covering different scales, with the later preferred for its better constraints on the covariances. We find EG estimates agree with the GR prediction at $1\, \sigma$ level over all these scales. With the CM estimated with 300 simulations, we report a best-fitting scale-averaged estimate of $E_G(\bar{z})=0.30\pm 0.05$, which is in line with the GR prediction $E_G^{\rm GR}(\bar{z})=0.33$ with Planck 2018 CMB + BAO matter density fraction Ωm = 0.31. The statistical errors of EG with future LSS surveys at similar redshifts will be reduced by an order of magnitude, which makes it possible to constrain modified gravity models.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

The clustering of DESI-like luminous red galaxies using photometric redshifts

ABSTRACT We present measurements of the redshift-dependent clustering of a DESI-like luminous red galaxy (LRG) sample selected from the Legacy Survey imaging data set, and use the halo occupation distribution (HOD) framework to fit the clustering signal. The photometric LRG sample in this study contains 2.7 million objects over the redshift range of 0.4 < z < 0.9 over 5655 deg2. We have developed new photometric redshift (photo-z) estimates using the Legacy Survey DECam and WISE photometry, with σNMAD = 0.02 precision for LRGs. We compute the projected correlation function using new methods that maximize signal-to-noise ratio while incorporating redshift uncertainties. We present a novel algorithm for dividing irregular survey geometries into equal-area patches for jackknife resampling. For a five-parameter HOD model fit using the MultiDark halo catalogue, we find that there is little evolution in HOD parameters except at the highest redshifts. The inferred large-scale structure bias is largely consistent with constant clustering amplitude over time. In an appendix, we explore limitations of Markov chain Monte Carlo fitting using stochastic likelihood estimates resulting from applying HOD methods to N-body catalogues, and present a new technique for finding best-fitting parameters in this situation. Accompanying this paper, we have released the Photometric Redshifts for the Legacy Surveys catalogue of photo-z’s obtained by applying the methods used in this work to the full Legacy Survey Data Release 8 data set. This catalogue provides accurate photometric redshifts for objects with z < 21 over more than 16 000 deg2 of sky.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

OzDES Reverberation Mapping Programme: Mg ii lags and R − L relation

ABSTRACT The correlation between the broad line region radius and continuum luminosity (R–L relation) of active galactic nuclei (AGNs) is critical for single-epoch mass estimates of supermassive black holes (SMBHs). At z ∼ 1–2, where AGN activity peaks, the R–L relation is constrained by the reverberation mapping (RM) lags of the Mg ii line. We present 25 Mg ii lags from the Australian Dark Energy Survey RM project based on 6 yr of monitoring. We define quantitative criteria to select good lag measurements and verify their reliability with simulations based on both the damped random walk stochastic model and the rescaled, resampled versions of the observed light curves of local, well-measured AGN. Our sample significantly increases the number of Mg ii lags and extends the R–L relation to higher redshifts and luminosities. The relative iron line strength $\mathcal {R}_{\rm Fe}$ has little impact on the R–L relation. The best-fitting Mg iiR–L relation has a slope α = 0.39 ± 0.08 with an intrinsic scatter $\sigma _{\rm rl} = 0.15^{+0.03}_{-0.02}$ . The slope is consistent with previous measurements and shallower than the H β R–L relation. The intrinsic scatter of the new R–L relation is substantially smaller than previous studies and comparable to the intrinsic scatter of the H β R–L relation. Our new R–L relation will enable more precise single-epoch mass estimates and SMBH demographic studies at cosmic noon.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Robust clustering of the local Milky Way stellar kinematic substructures with Gaia eDR3

Understanding local stellar kinematic substructures in the solar neighbourhood helps build a complete picture of the formation of the Milky Way, as well as an empirical phase space distribution of dark matter that would inform detection experiments. We apply the clustering algorithm HDBSCAN on the Gaia early third data release to identify a list of stable clusters in velocity space and action-angle space by taking into account the measurement uncertainties and studying the stability of the clustering results. We find 1405 (497) stars in 23 (6) robust clusters in velocity space (action-angle space) that are consistently not associated with noise. We discuss the kinematic properties of these structures and study whether many of the small clusters belong to a similar larger cluster based on their chemical abundances. They are attributed to the known structures: the Gaia Sausage-Enceladus, the Helmi Stream, and globular cluster NGC 3201 are found in both spaces, while NGC 104 and the thick disc (Sequoia) are identified in velocity space (action-angle space). Although we do not identify any new structures, we find that the HDBSCAN member selection of already known structures is unstable to input kinematics of the stars when resampled within their uncertainties. We therefore present the stable subset of local kinematic structures, which are consistently identified by the clustering algorithm, and emphasize the need to take into account error propagation during both the manual and automated identification of stellar structures, both for existing ones as well as future discoveries.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Investigation of oscillations above the acoustic cut-off frequency for a sample of Kepler stars. II. Identifying temporal frequency shifts

ABSTRACT Stellar oscillations with frequencies greater than the acoustic cut-off frequency are not trapped within the star’s interior. Geometric interference between these high-frequency waves produces a peak-like structure in the power spectrum of the star, known as the pseudo-modes. In this study, we aim to analyse 51 stars previously identified (from a sample of 91 Kepler stars) to contain statistically significant evidence for pseudo-modes, to determine if the pseudo-mode frequencies vary in time. We obtained these frequency variations and the uncertainty by the resampled periodogram approach, where periodogram realisations were created from successive, overlapping 90-d time segments, and a cross-correlation function was generated between them. The computed shifts were compared against temporal p-mode frequency shifts and a stellar magnetic activity proxy, $S_{\mathrm{ph}}$. We found that for 16 per cent of the stars pseudo-mode frequency shifts were significantly anticorrelated with p-mode shifts, as is the case for the Sun. However, we also found pseudo-mode and p-mode shifts to be significantly correlated in-phase in 8 per cent of our sample. The remainder showed no significant correlation. We also searched for trends between the maximum variation of pseudo-mode frequency shifts and stellar parameters. Whilst we found no correlation between the maximum variation and stellar photospheric and chromospheric proxies, we found frequency variations to have a greater amplitude for cooler and slower rotating stars, which is in opposition to p-mode frequency shift variation. Temporal changes to pseudo-mode frequencies may be attributable to variations in stellar magnetic activity, and therefore can contribute to our understanding of stellar activity cycles.

Millson, L. J. (ORCID:0009000342542676)↗

DOE OSTI2021

Statistical uncertainties of the v n { 2 k } harmonics from Q cumulants

Analytic formulas to calculate statistical uncertainties of v n { 2 k } harmonics extracted from the Q cumulants are presented. The Q cumulants are multivariate polynomial functions of the weighted means of 2m-particle azimuthal correlations, $\langle\langle 2 m \rangle\rangle$. Variances and covariances of the $\langle\langle 2 m \rangle\rangle$ are included in the analytic formulas of the uncertainties that can be calculated simultaneously with the calculations of the v n { 2 k } harmonics. The calculations are performed using a simple toy model, which roughly simulates elliptic flow azimuthal anisotropy with magnitudes around 0.05. The results are compared with the results obtained by the many data subsets, and by the bootstrapping method. The first one is a common way of estimation of the statistical uncertainties of the v n { 2 k } harmonics in a real experiment. In order to increase precision in the measurement of the v n { 2 k } harmonics, a large number of 15 000 subsets and the same number of the resampling in the bootstrap method is used. Unlike the other ways of the analytic calculation of the v n { 2 k } statistical uncertainties, our proposal that includes the use of squared weights in the calculation of both the variances and covariances, gives the best agreement with the results obtained from the subsets and bootstrap method. Additionally, a recurrence equation between Q cumulants of any order is also presented.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Emulating ab initio computations of infinite nucleonic matter

We construct efficient emulators for the computation of the infinite nuclear matter equation of state. These emulators are based on the subspace-projected coupled-cluster method for which we here develop a new algorithm called small-batch voting to eliminate spurious states that might appear when emulating quantum many-body methods based on a non-Hermitian Hamiltonian. The efficiency and accuracy of these emulators facilitate a rigorous statistical analysis within which we explore nuclear matter predictions for > 10 6 different parametrizations of a chiral interaction model with explicit Δ -isobars at next-to-next-to leading order. Constrained by nucleon-nucleon scattering phase shifts and bound-state observables of light nuclei up to He 4 , we use history matching to identify nonimplausible domains for the low-energy coupling constants of the chiral interaction. Within these domains we perform a Bayesian analysis using sampling and importance resampling with different likelihood calibrations and study correlations between interaction parameters, calibration observables in light nuclei, and nuclear matter saturation properties. Published by the American Physical Society 2024

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

Solar Transposition Modeling via Deep Neural Networks With Sky Images

This article presents a notable advance toward the development of a new method of increasing the single-axis tracking photovoltaic (PV) system power output by improving the determination and near-term prediction of the optimum module tilt angle. The tilt angle of the plane receiving the greatest total irradiance changes with Sun position and atmospheric conditions including cloud formation and movement, aerosols, and particulate loading, as well as varying albedo within a module's field of view. In this article, we present a multi-input convolutional neural network that can create a profile of plane-of-array irradiance versus surface tilt angle over a full 180° arc from horizon to horizon. As input, the neural network uses the calculated solar position and clear-sky irradiance values, along with sky images. The target irradiance values are provided by the multiplanar irradiance sensor (MPIS). In order to account for varying irradiance conditions, the MPIS signal is normalized by the theoretical clear-sky global horizontal irradiance. Using this information, the neural network outputs an N -dimensional vector, where N is the number of points to approximate the MPIS curve via Fourier resampling. The output vector of the model is smoothed with a Gaussian kernel to account for error in the downsamping and subsequent upsampling steps, as well as to smooth the unconstrained output of the model. Furthermore, these profiles may be used to perform near-term prediction of angular irradiance, which can then inform the movement of a PV tracker.

42 ENGINEERING↗

DOE OSTI2021

Rare Events via Cross-Entropy Population Monte Carlo

Rare events are events that happen with very low frequency. Estimating rare event probabilities using Monte Carlo techniques is computationally expensive, often to the point of intractability, and special methods are required. Importance sampling (IS) is a well known technique that uses a proposal distribution in place of a target distribution to lower the variance of the estimator. Key to the success of IS methods is the choice of a proposal distribution, or the parameters governing the distribution. Adaptive importance sampling improves the parameters of a family or population of proposal distributions iteratively through trials. We present a novel cross-entropy population Monte Carlo algorithm, which adapts the parameters of proposals through the cross-entropy method. The proposed method stands apart from previous work in that we are not optimizing a mixture distribution. Instead, we leverage deterministic mixture weights and optimize the distributions individually through a reinterpretation of the typical derivation of the cross-entropy method. Demonstrations on rare event examples show that the algorithm can outperform existing resampling based population Monte Carlo methods, especially for higher-dimensional problems. Finally, we also demonstrate efficacy on a conjunction analysis problem.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Scalable Risk Assessment of Rare Events in Power Systems With Uncertain Wind Generation and Loads

Risk assessment of rare events has become increasingly important in power system planning and operation with the increasing integration of renewable energy and the presence of system uncertainties. However, quantifying the risk posed by rare events via the traditional method, i.e., Monte Carlo sampling (MCS), incurs substantial computational expense stemming from the vast ensemble of power flow simulations. To accelerate the assessment, this paper proposes a Deep Neural Network (DNN)-kernelized vector-valued Gaussian Process (VVGP) approach with excellent computational efficiency while maintaining high accuracy. Consequently, serving as a surrogate model for the power flow solver, the DNN-kernelized VVGP enables significantly faster but accurate risk assessment compared to the power flow solver. The developed surrogate model evaluates low-order N - k events that contain more than 90% instances by adeptly capturing the topological features while the high-order N - k events are assessed via a power flow solver, thereby striking a balance between computational efficiency and uncertainty quantification accuracy. Moreover, the model incorporates a Support Vector Machine (SVM) classifier to resample concerning low-probability tail events to counteract the biases potentially introduced during the DNN-kernelized VVGP evaluations. Simulations conducted on the modified IEEE 24-bus, 118-bus, and European 1354-bus systems demonstrate that the proposed method maintains the accuracy benchmark set by MCS while significantly reducing computational demands in large-scale power systems as compared to other state-of-the-art methods.

17 WIND ENERGY↗

DOE OSTI2022

Initial soil organic carbon stocks govern changes in soil carbon: Reality or artifact?

Abstract Changes in soil organic carbon (SOC) storage have the potential to affect global climate; hence identifying environments with a high capacity to gain or lose SOC is of broad interest. Many cross‐site studies have found that SOC‐poor soils tend to gain or retain carbon more readily than SOC‐rich soils. While this pattern may partly reflect reality, here we argue that it can also be created by a pair of statistical artifacts. First, soils that appear SOC‐poor purely due to random variation will tend to yield more moderate SOC estimates upon resampling and hence will appear to accrue or retain more SOC than SOC‐rich soils. This phenomenon is an example of regression to the mean. Second, normalized metrics of SOC change—such as relative rates and response ratios—will by definition show larger changes in SOC at lower initial SOC levels, even when the absolute change in SOC does not depend on initial SOC. These two artifacts create an exaggerated impression that initial SOC stocks are a major control on SOC dynamics. To address this problem, we recommend applying statistical corrections to eliminate the effect of regression to the mean, and avoiding normalized metrics when testing relationships between SOC change and initial SOC. Careful consideration of these issues in future cross‐site studies will support clearer scientific inference that can better inform environmental management.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

A 13‐Year Record Indicates Differences in the Duration and Depth of Soil Carbon Accrual Among Potential Bioenergy Crops

Six years after replacing a maize/soybean cropping system, perennial grasses miscanthus (Miscanthus × giganteus) and switchgrass (Panicum virgatum), and a 28-species restored prairie increased particulate organic carbon in surface soils without increasing soil organic carbon (SOC). To resolve potential changes in the quantity and distribution of SOC, soils were resampled after seven to thirteen years to measure bulk density, carbon (C) content, and stable C isotopes to a depth of 1 m. SOC stocks increased between 1.75 and 2.5 Mg ha −1 year −1 in all perennial crops between 2008 and 2016 (nine growing seasons). Despite relatively low litter inputs and belowground biomass, the highest rate of SOC accrual was in restored prairie (2.5 Mg ha −1 year −1 ), followed by miscanthus (2.0 Mg ha −1 year −1 ) and switchgrass (1.75 Mg ha −1 year −1 ). The change in SOC in maize/soybean was not significant. After 2016, total SOC decreased in maize/soybean and miscanthus, resulting in slower overall rates of SOC accumulation over the full sampling period for miscanthus (0.8 Mg ha −1 year −1 ). The rate of SOC accumulation was greatest below 50 cm depth for restored prairie and switchgrass but in the top 10 cm for miscanthus. Stable isotope analysis showed 13 C enrichment in all depths of switchgrass soils, an indication of new organic C accumulation, but mixed results in all other crops. Planting perennial crops on land formerly in an annual maize/soybean cropping system can slow or reverse soil carbon losses, with the greatest increases in SOC from species-rich prairie.

agriculture↗

DOE OSTI2021

Multi-sensor anomalous change detection in remote sensing imagery

Combining multiple satellite remote sensing sources provides a far richer, more frequent view of the earth than that of any single source; the challenge is in distilling these petabytes of heterogeneous sensor imagery into meaningful characterizations of the imaged areas. Meeting this challenge requires effective algorithms for combining multi-modal imagery over time to identify subtle but real changes among the intrinsic data variation. Here, we implement a joint-distribution framework for multi-sensor anomalous change detection (MSACD) that can effectively account for these differences in modality, and does not require any signal resampling of the pixel measurements. This flexibility enables the use of satellite imagery from different sensor platforms and modalities. We use multi-year construction of the SoFi Stadium in California as our testbed, and exploit synthetic aperture radar imagery from Sentinel-1 and multispectral imagery from both Sentinel-2 and Landsat 8. We show results for MSACD using real imagery with implanted, measurable changes, as well as real imagery with real, observable changes, including scaling our analysis over multiple years.

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

Multidecadal shifts in forest plant diversity and community composition across glacial landforms in northern lower Michigan, USA

Understanding how plant community assemblage is affected by spatial and temporal patterns is crucial to understanding forest ecosystem responses to disturbance, including future climate change. In this article, we tracked how diversity and composition are distributed through space and time in a midsuccessional mixed hardwood forest in northern lower Michigan, United States. This region’s geographically and abiotically distinct glacial landforms influence both the spatial and temporal dynamics of its forest communities. Vegetation sampling plots (n = 87) were established at the University of Michigan Biological Station in 1990 and resampled in 2015. Vegetation in the overstory, sapling, and groundcover layers was censused. Abiotic variables, including elevation, pH, and soil nutrients, were measured in a subset of plots (n = 40). There were strong differences in diversity and community composition among glacial landforms, with the moraine having a 31% greater species richness in the groundcover layer compared with those of the other glacial landforms. Surprisingly, plant communities across all three vegetation layers showed little change over the 25-year period, and we found no evidence of differences in successional rates among glacial landforms. Our findings indicate that glacial landforms have a large influence on the production and maintenance of local plant diversity and community composition in this area and suggest that successional dynamics may manifest themselves over much longer time periods in these northern biomes.

Forestry↗

DOE OSTI2022

Machine-Learning Assisted Identification of Accurate Battery Lifetime Models with Uncertainty

Reduced-order battery lifetime models, which consist of algebraic expressions for various aging modes, are widely utilized for extrapolating degradation trends from accelerated aging tests to real-world aging scenarios. Identifying models with high accuracy and low uncertainty is crucial for ensuring that model extrapolations are believable, however, it is difficult to compose expressions that accurately predict multivariate data trends; a review of cycling degradation models from literature reveals a wide variety of functional relationships. Here, a machine-learning assisted model identification method is utilized to fit degradation in a stand-out LFP-Gr aging data set, with uncertainty quantified by bootstrap resampling. The model identified in this work results in approximately half the mean absolute error of a human expert model. Models are validated by converting to a state-equation form and comparing predictions against cells aging under varying loads. Parameter uncertainty is carried forward into an energy storage system simulation to estimate the impact of aging model uncertainty on system lifetime. The new model identification method used here reduces life-prediction uncertainty by more than a factor of three (86% ± 5% relative capacity at 10 years for human-expert model, 88.5% ± 1.5% for machine-learning assisted model), empowering more confident estimates of energy storage system lifetime.

25 ENERGY STORAGE↗