Search NASA⌕ Search

SEARCH · Search NASA

Results for “randomized sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Single-frame far-field diffractive imaging with randomized illumination

Contains two transmission ptychography datasets, one collected from a Siemens star, and the second from an Fe/Gd multilayer. Both samples are under illumination from the same randomized zone plate. Each dataset has a single diffraction pattern removed, and these patterns are reported in a separate cxi file. Either ptychography dataset can be used for calibration of the probe function, and the remaining diffraction patterns can be reconstructed via randomized probe imaging.

BESSY II↗
DOE OSTI2023

On unifying randomized methods for inverse problems

This work unifies the analysis of various randomized methods for solving linear and nonlinear inverse problems with Gaussian priors by framing the problem in a stochastic optimization setting. By doing so, we show that many randomized methods are variants of a sample average approximation (SAA). More importantly, we are able to prove a single theoretical result that guarantees the asymptotic convergence for a variety of randomized methods. Additionally, viewing randomized methods as an SAA enables us to prove, for the first time, a single non-asymptotic error result that holds for randomized methods under consideration. Another important consequence of our unified framework is that it allows us to discover new randomization methods. Here, we present various numerical results for linear, nonlinear, algebraic, and PDE-constrained inverse problems that verify the theoretical convergence results and provide a discussion on the apparently different convergence rates and the behavior for various randomized methods.

42 ENGINEERING↗
DOE OSTI2018

Scalable hierarchical PDE sampler for generating spatially correlated random fields using nonmatching meshes: Scalable hierarchical PDE sampler using nonmatching meshes

This work describes a domain embedding technique between two nonmatching meshes used for generating realizations of spatially correlated random fields with applications to large-scale sampling-based uncertainty quantification. The goal is to apply the multilevel Monte Carlo (MLMC) method for the quantification of output uncertainties of PDEs with random input coefficients on general and unstructured computational domains. We propose a highly scalable, hierarchical sampling method to generate realizations of a Gaussian random field on a given unstructured mesh by solving a reaction–diffusion PDE with a stochastic right-hand side. The stochastic PDE is discretized using the mixed finite element method on an embedded domain with a structured mesh, and then, the solution is projected onto the unstructured mesh. This work describes implementation details on how to efficiently transfer data from the structured and unstructured meshes at coarse levels, assuming that this can be done efficiently on the finest level. We investigate the efficiency and parallel scalability of the technique for the scalable generation of Gaussian random fields in three dimensions. An application of the MLMC method is presented for quantifying uncertainties of subsurface flow problems. Here, we demonstrate the scalability of the sampling method with nonmatching mesh embedding, coupled with a parallel forward model problem solver, for large-scale 3D MLMC simulations with up to 1.9·109 unknowns.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

DESI 2024 II: sample definitions, characteristics, and two-point clustering statistics

We present the samples of galaxies and quasars used for DESI 2024 cosmological analyses, drawn from the DESI Data Release 1 (DR1). We describe the construction of largescale structure (LSS) catalogs from these samples, which include matched sets of synthetic reference ‘randoms’ and weights that account for variations in the observed density of the samples due to experimental design and varying instrument performance. We detail how we correct for variations in observational completeness, the input ‘target’ densities due to imaging systematics, and the ability to confidently measure redshifts from DESI spectra. We then summarize how remaining uncertainties in the corrections can be translated to systematic uncertainties for particular analyses. We describe the weights added to maximize the signalto-noise of DESI DR1 2-point clustering measurements. We detail measurement pipelines applied to the LSS catalogs that obtain 2-point clustering measurements in configuration and Fourier space. The resulting 2-point measurements depend on window functions and normalization constraints particular to each sample, and we present the corrections required to match models to the data. We compare the configuration- and Fourier-space 2-point clustering of the data samples to that recovered from simulations of DESI DR1 and find they are, generally, in statistical agreement to within 2% in the inferred real-space over-density field. The LSS catalogs, 2-point measurements, and their covariance matrices will be released publicly with DESI DR1.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

CyBERT: Cybersecurity Claim Classification by Fine-Tuning the BERT Language Model

We introduce CyBERT, a cybersecurity feature claims classifier based on bidirectional encoder representations from transformers and a key component in our semi-automated cybersecurity vetting for industrial control systems (ICS). To train CyBERT, we created a corpus of labeled sequences from ICS device documentation collected across a wide range of vendors and devices. This corpus provides the foundation for fine-tuning BERT’s language model, including a prediction-guided relabeling process. We propose an approach to obtain optimal hyperparameters, including the learning rate, the number of dense layers, and their configuration, to increase the accuracy of our classifier. Fine-tuning all hyperparameters of the resulting model led to an increase in classification accuracy from 76% obtained with BertForSequenceClassification’s original architecture to 94.4% obtained with CyBERT. Furthermore, we evaluated CyBERT for the impact of randomness in the initialization, training, and data-sampling phases. CyBERT demonstrated a standard deviation of ±0.6% during validation across 100 random seed values. Finally, we also compared the performance of CyBERT to other well-established language models including GPT2, ULMFiT, and ELMo, as well as neural network models such as CNN, LSTM, and BiLSTM. The results showed that CyBERT outperforms these models on the validation accuracy and the F1 score, validating CyBERT’s robustness and accuracy as a cybersecurity feature claims classifier.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Errors in radial velocity variance from Doppler wind lidar

A high-fidelity lidar turbulence measurement technique relies on accurate estimates of radial velocity variance that are subject to both systematic and random errors determined by the autocorrelation function of radial velocity, the sampling rate, and the sampling duration. Our paper quantifies the effect of the volumetric averaging in lidar radial velocity measurements on the autocorrelation function and the dependence of the systematic and random errors on the sampling duration, using both statistically simulated and observed data. For current-generation scanning lidars and sampling durations of about 30 min and longer, during which the stationarity assumption is valid for atmospheric flows, the systematic error is negligible but the random error exceeds about 10%.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Socio-Structural and Neighborhood Predictors of Incident Criminal Justice Involvement in a Population-Based Cohort of Young Black MSM and Transgender Women

Black men who have sex with men (MSM) and transgender women are disproportionately affected by criminal justice involvement (CJI) and HIV. This study recruited 618 young Black MSM and transgender women in Chicago, IL, using respondent-driven sampling between 2013 and 2014. Random effects logistic regression evaluated predictors of incident CJI over 18 months of follow-up. We report, controlling for respondent age, gender and sexual identity, spirituality (aOR 0.56, 95% CI 0.33-0.96), and presence of a mother figure (aOR 0.41, 95% CI 0.19-0.89) were protective against CJI. Economic hardship (financial or residential instability vs. neither aOR 2.23, 95% CI 1.10-4.51), two or more past episodes of CJI vs. none (aOR 2.66, 95% CI 1.40-5.66), and substance use (marijuana use vs. none aOR 2.79, 95% CI 1.23-6.34; other drug use vs. none aOR 4.49, 95% CI 1.66-12.16) were associated with CJI during follow-up. Research to identify and leverage resilience factors that can buffer the effects of socioeconomic marginalization may increase the effectiveness of interventions to address the socio-structural factors that increase the risk for CJI among Black MSM and transgender women. Given the intersection of incarceration, HIV and other STIs, and socio-structural stressors, criminal justice settings are important venues for interventions to reduce health inequities in these populations.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

Anti-site mixing and magnetic properties of Fe 3 Co 3 Nb 2 studied via neutron powder diffraction

Here, we studied the crystal structure and magnetic properties of the rare-earth-free intermetallic compound Fe 3 Co 3 Nb 2 , which has recently been demonstrated to have potentially high magnetic anisotropy, using temperature-dependent neutron powder diffraction. Furthermore, the temperature dependence of the diffraction spectra reveals a magnetic transition between 300 and 400 K, in agreement with the magnetometry measurements. According to the structural refinement of the paramagnetic state and the substantial magnetic contribution to the diffuse scattering in the ferromagnetic state, the Fe/Co anti-site mixing is so strong that the site occupation for Fe and Co is almost random. The projection of the magnetic moments turned out to be non-zero along the c axis and in the a–b plane of Fe 3 Co 3 Nb 2 , most likely because of the exchange interactions between the randomly orientated nanograins in the samples. These findings suggest that future studies on the magnetism of Fe 3 Co 3 Nb 2 need to take the Fe/Co anti-site mixing into account, and the exchange interactions need to be suppressed to obtain large remanence and coercivity.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2022

A phase-shift-periodic parallel boundary condition for low-magnetic-shear scenarios

Abstract We formulate a generalized periodic boundary condition as a limit of the standard twist-and-shift parallel boundary condition that is suitable for simulations of plasmas with low magnetic shear. This is done by applying a phase shift in the binormal direction when crossing the parallel boundary. While this phase shift can be set to zero without loss of generality in the local flux-tube limit when employing the twist-and-shift boundary condition, we show that this is not the most general case when employing periodic parallel boundaries, and may not even be the most desirable. A non-zero phase shift can be used to avoid the convective cells that plague simulations of the three-dimensional Hasegawa–Wakatani system, and is shown to have measurable effects in periodic low-magnetic-shear gyrokinetic simulations. We propose a numerical program where a sampling of periodic simulations at random pseudo-irrational flux surfaces are used to determine physical observables in a statistical sense. This approach can serve as an alternative to applying the twist-and-shift boundary condition to low-magnetic-shear scenarios, which, while more straightforward, can be computationally demanding.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Experimental observation of magnetic dimers in diluted Yb:YAlO 3

In this paper, we present a comprehensive experimental investigation of Yb magnetic dimers in Yb 0.04 Y 0.96 AlO 3 , an Yb-doped yttrium aluminum perovskite YAlO3, by means of specific heat, magnetization, and high-resolution inelastic neutron scattering (INS) measurements. In our sample, the Yb ions are randomly distributed over the lattice and ~7% of Yb ions form quantum dimers due to nearest-neighbor antiferromagnetic coupling along the c axis. At zero field, the dimer formation manifests itself in an appearance of an inelastic peak at Δ ≈ 0.2 meV in the INS spectrum and a Schottky-like anomaly in the specific heat. The structure factor of the INS peak exhibits a cosine modulation along the $L$ direction, in agreement with the $c$-axis nearest-neighbor intradimer coupling. A careful fitting of the low-temperature specific heat shows that the excited state is a degenerate triplet, which indicates a surprisingly small anisotropy of the effective Yb-Yb exchange interaction despite the low crystal symmetry and anisotropic magnetic dipole contribution, in agreement with previous reports for the Yb parent compound, YbAlO 3 , and in contrast to Yb 2 Pt 2 Pb. The obtained results are precisely reproduced by analytical calculations for the Yb dimers.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Renormalization group computation of likelihood functions for cosmological data sets

I show how a renormalization group (RG) method can be used to incrementally integrate the information in cosmological large-scale structure data sets (including CMB, galaxy redshift surveys, etc.). I show numerical tests for Gaussian fields, where the method allows arbitrarily close to exact computation of the likelihood function in order N time, even for problems with no symmetry, compared to N 3 for brute force linear algebra (where N is the number of data points - to be fair, methods already exist to solve the Gaussian problem in at worst N log N time, and this method will not necessarily be faster in practice). The method requires no sampling or other Monte Carlo (random) element. Nonlinearity/non-Gaussianity can be accounted for to the extent that terms generated by integrating out small scale modes can be projected onto a sufficient basis, e.g., at least in the sufficiently perturbative regime. The formulas to evaluate are straightforward and require no understanding of quantum field theory, but this paper may also serve as a pedagogical introduction to Wilsonian RG for astronomers.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Constant-Depth Preparation of Matrix Product States with Adaptive Quantum Circuits

Adaptive quantum circuits, which combine local unitary gates, midcircuit measurements, and feedforward operations, have recently emerged as a promising avenue for efficient state preparation, particularly on near-term quantum devices limited to shallow-depth circuits. Matrix product states (MPS) comprise a significant class of many-body entangled states, efficiently describing the ground states of one-dimensional gapped local Hamiltonians and finding applications in a number of recent quantum algorithms. Recently, it has been shown that the Affleck-Kennedy-Lieb-Tasaki state—a paradigmatic example of an MPS—can be exactly prepared with an adaptive quantum circuit of constant depth, an impossible feat with local unitary gates alone due to its nonzero correlation length [Smith , PRX Quantum 4, 020315 (2023)]. In this work, we broaden the scope of this approach and demonstrate that a diverse class of MPS can be exactly prepared using constant-depth adaptive quantum circuits, outperforming theoretically optimal preparation with unitary circuits. We show that this class includes short- and long-ranged entangled MPS, symmetry-protected topological (SPT) and symmetry-broken states, MPS with finite Abelian, non-Abelian, and continuous symmetries, resource states for MBQC, and families of states with tunable correlation length. Moreover, we illustrate the utility of our framework for designing constant-depth sampling protocols, such as for random MPS or for generating MPS in a particular SPT phase. We present sufficient conditions for particular MPS to be preparable in constant time, with global on-site symmetry playing a pivotal role. Altogether, this work demonstrates the immense promise of adaptive quantum circuits for efficiently preparing many-body entangled states and provides explicit algorithms that outperform known protocols to prepare an essential class of states. Published by the American Physical Society 2024

Smith, Kevin C. (ORCID:0000000223971518)↗
DOE OSTI2020

An Analysis of the Statistics and Systematics of Limb Anomaly Detections in HST/STIS Transit Images of Europa

Several recent studies derived the existence of plumes on Jupiter’s moon Europa. The only technique that provided multiple detections is the far-ultraviolet imaging observations of Europa in transit of Jupiter taken by the Space Telescope Imaging Spectrograph (STIS) on the Hubble Space Telescope (HST). In this study, we reanalyze the three HST/STIS transit images in which Sparks et al. identified limb anomalies as evidence for Europa’s plume activity. After reproducing the results of Sparks et al., we find that positive outliers are similarly present in the images as the negative outliers that were attributed to plume absorption. A physical explanation for the positive outliers is missing. We then investigate the systematic uncertainties and statistics in the images and identify two factors that are crucial when searching for anomalies around the limb. One factor is the alignment between the actual and assumed locations of Europa on the detector. A misalignment introduces distorted statistics, most strongly affecting the limb above the darker trailing hemisphere where the plumes were detected. The second factor is a discrepancy between the observation and the model used for comparison, adding uncertainty in the statistics. When accounting for these two factors, the limb minima (and maxima) are consistent with random statistical occurrence in a sample size given by the number of pixels in the analyzed limb region. The plume candidate features in the three analyzed images can be explained by purely statistical fluctuations and do not provide evidence for absorption by plumes.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Evolution of Scenario Generation Capabilities in the ExaSGD Project

High-fidelity renewable energy scenarios and rare-event high-impact contingencies are essential for modeling operations and infrastructure expansion of the next generation power grids using exascale computing resources. As the ExaSGD project progressed, our capabilities for generating scenarios for modeling wind power output at multiple wind farms significantly improved, evolving from the use of independent random perturbations to importance sampling-based techniques capturing representative spatial-temporal relations. Contingency generation also improved, evolving from standard N-1 techniques to probabilistic models of infrastructure damage resulting from extreme weather events. We review the developments in the realistic intermittent-energy scenario forecasting and extreme-event contingency creation as the ExaSGD project progressed and discuss the future work in these areas.

economic dispatch↗
DOE OSTI2016

Interactive Visualization of Multi-Group Cross Sections on High-Fidelity Spatial Meshes

Core simulation tools utilizing Monte Carlo transport methods represent the 'Holy Grail' for nuclear reactor analysis. However, deterministic transport methods pose a number of advantages to Monte Carlo from a computational perspective, which seems likely to make these methods more viable in the near to intermediate term. Deterministic methods almost universally discretize the energy domain in a few to hundreds of energy groups. One of the key challenges for deterministic transport-based methods to be viable is accurate, reactor agnostic multi-group cross section generation. This paper describes tools for data processing and visualization of multigroup cross sections generated on high-fidelity spatial meshes from the OpenMC Monte Carlo code. Next generation deterministic transport reactor core modeling tools will require multi-group cross section (MGXS) generation on high-fidelity spatial meshes. High-fidelity MGXS are necessary for the accurate simulation of neutron physics in nuclear reactors with a high degree of spectral heterogeneity - e.g., large localized neutron flux gradients throughout a reactor core. Although many local (e.g., pin cell) approximations have been developed to model the scalar flux to compute spectral-averaged MGXS, these techniques cannot account for complex intra-pin and intra-assembly spatial self-shielding effects. Monte Carlo presents the most accurate method for reactor agnostic multi-group cross section generation since it does not require the use of local approximations to the flux. Monte Carlo has been proposed as a highly desirable framework for reactor agnostic cross section generation for many years. Monte Carlo methods can effectively embed all of the relevant spectral effects into the MGXS through the random particle tracking and interaction sampling processes. Previous work has applied MCNP and Serpent to compute few-group constants for diffusion calculations, and OpenMC to compute multi-group cross sections for transport-based methods. The primary difficulty with using Monte Carlo for MGXS generation is the tremendous computational resources required to adequately converge multi-group cross sections in each spatial region and energy group. Recent development of the OpenMC Monte Carlo code for high-performance computing platforms has made multigroup cross section generation from Monte Carlo more tractable in the foreseeable future. The recent release of OpenMC v0.7.1 includes a new Python-based module for MGXS generation. The MGXS generation module leverages many of the algorithms and features for 'big data' analysis of large tally datasets on complex spatial meshes. This paper describes the data management workflow and visualization tools which have been developed to explore the plethora of MGXS data generated with OpenMC. It is the authors' hope that the development of the visualization tool described in this paper will ultimately enable the design of machine learning algorithms to accelerate the convergence rate of high-fidelity multi-group cross section generated with Monte Carlo. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

A Comprehensive Investigation of Active Learning Strategies for Conducting Anti-Cancer Drug Screening

It is well-known that cancers of the same histology type can respond differently to a treatment. Thus, computational drug response prediction is of paramount importance for both preclinical drug screening studies and clinical treatment design. To build drug response prediction models, treatment response data need to be generated through screening experiments and used as input to train the prediction models. In this study, we investigate various active learning strategies of selecting experiments to generate response data for the purposes of (1) improving the performance of drug response prediction models built on the data and (2) identifying effective treatments. Here, we focus on constructing drug-specific response prediction models for cancer cell lines. Various approaches have been designed and applied to select cell lines for screening, including a random, greedy, uncertainty, diversity, combination of greedy and uncertainty, sampling-based hybrid, and iteration-based hybrid approach. All of these approaches are evaluated and compared using two criteria: (1) the number of identified hits that are selected experiments validated to be responsive, and (2) the performance of the response prediction model trained on the data of selected experiments. The analysis was conducted for 57 drugs and the results show a significant improvement on identifying hits using active learning approaches compared with the random and greedy sampling method. Active learning approaches also show an improvement on response prediction performance for some of the drugs and analysis runs compared with the greedy sampling method.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Random insights into the complexity of two-dimensional tensor network calculations

Projected entangled pair states (PEPS) offer memory-efficient representations of some quantum many-body states that obey an entanglement area law and are the basis for classical simulations of ground states in two-dimensional (2d) condensed matter systems. However, rigorous results show that exactly computing observables from a 2d PEPS state is generically a computationally hard problem. Yet approximation schemes for computing properties of 2d PEPS are regularly used, and empirically seen to succeed, for a large subclass of (“not too entangled”) condensed matter ground states. Adopting the philosophy of random matrix theory, in this work, we analyze the complexity of approximately contracting a 2d random PEPS by exploiting an analytic mapping to an effective replicated statistical mechanics model that permits a controlled analysis at a large bond dimension. Through this statistical-mechanics lens, we argue that (i) although approximately sampling wave-function amplitudes of random PEPS faces a computational-complexity phase transition above a critical bond dimension, and (ii) one can generically efficiently estimate the norm and correlation functions for any finite bond dimension. Furthermore, these results are supported numerically for various bond-dimension regimes. It is an important open question whether the above results for random PEPS apply more generally also to PEPS representing physically relevant ground states.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2021

An uncertainty quantification method relevant to material test reactors

Within material test reactor calculations, energy dependent flux and reaction rate uncertainties are typically not quantified when performing as-run analyses to determine the neutron field experienced by the experiment. When high fidelity Monte-Carlo codes are used in such analyses, straight forward methods to calculate output uncertainties are not available, instead expert opinion is used to postulate computational uncertainties. New methods to propagate uncertainties through these high fidelity simulations are available when sufficient computational power is available. A tool is developed here for sampling any part of an MCNP input from random distributions to determine output uncertainties based on those inputs. Another tool is developed to sample nuclear data cross-section in ACE format using multi-group nuclear data covariances. The Total Monte-Carlo Method and Gesellschaft für Anlagen-und Reaktorsicherheit method (GRS) are implemented and compared to one another as well as MCNP sensitivity and uncertainty calculations. The methods were applied to the Godiva critical sphere k-eigenvalue, the UAM pin-cell benchmark energy dependent flux and reaction rates, and the Advanced Test Reactor energy dependent flux within an experimental location. Furthermore, the two methods agree well, with GRS allowing for an order of magnitude speedup for reaction rate uncertainty calculations and several orders of magnitude for eigenvalue uncertainty calculations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗