Search NASA⌕ Search

SEARCH · Search NASA

Results for “randomized sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

The construction of large-scale structure catalogs for the Dark Energy Spectroscopic Instrument

We present the technical details on how large-scale structure (LSS) catalogs are constructed from redshifts measured from spectra observed by the Dark Energy Spectroscopic Instrument (DESI). The LSS catalogs provide the information needed to determine the relative number density of DESI tracers as a function of redshift and celestial coordinates and, e.g., determine clustering statistics. We produce catalogs that are weighted subsamples of the observed data, each matched to a weighted `random' catalog that forms an unclustered sampling of the probability density that DESI could have observed those data at each location. Precise knowledge of the DESI observing history and associated hardware performance allows for a determination of the DESI footprint and the number of times DESI has covered it at sub-arcsecond level precision. This enables the completeness of any DESI sample to be modeled at this same resolution. The pipeline developed to create LSS catalogs has been designed to easily allow robustness tests and enable future improvements. We describe how it allows ongoing work improving the match between galaxy and random catalogs, such as including further information when assigning redshifts to randoms, accounting for fluctuations in target density, accounting for variation in the redshift success rate, and accommodating blinding schemes.

79 ASTRONOMY AND ASTROPHYSICS↗

D-Guaranteed Discrimination of Statistical Hypotheses: a Review of Results and Unsolved Problems

We compare two sequential d-guaranteed tests and an optimal d-guaranteed test based on a fixed number of observations with respect to the average number of observations within the most accepted practical applications of Bayesian probabilistic models. We consider the sequential “first skipping” test, the sequential locally efficient test based on the score statistic, and the test based on a fixed number of observations that minimizes the necessary sample size. We study various characteristics of these tests connected with the number of observations within three probabilistic models, namely, the normal (ϑ, σ{sup 2}) distribution of the observed random variable and the normal a priori distribution of ϑ with fixed σ{sup 2}; the exponential distribution with the intensity parameter ϑ and the a priori gamma distribution of ϑ; and the Bernoulli sampling with the success probability ϑ and the a priori beta distribution of ϑ. We discuss the connection of the d-posterior approach with the compound decision problem as applied to the analysis of data provided by microchips (when the false discovery rate, or FDR, for short, is treated as the d-risk of the first kind). We present the vast data on characteristics of the mentioned tests obtained by the method of mathematical modeling in several tables. We discuss unsolved problems of the d-guaranteed discrimination of hypotheses with the minimal number of observations and approaches to their solution.

97 MATHEMATICS AND COMPUTING↗

General-Surrogate Adaptive Sampling Using Interquartile Range for Design Space Exploration

Abstract A surrogate model is a common tool to approximate system response at untested points for design space exploration. Adaptive sampling has been studied for improving the accuracy of surrogates iteratively by introducing additional samples (simulations and experiments). New samples are often selected based on the estimated uncertainty in the design space. While some surrogates such as kriging have readily available uncertainty models for their predictions, other surrogates do not. Consequently, there have been studies of using the process of leaving-samples-out (LSO) used in cross-validation tools to estimate prediction uncertainty, such as the universal prediction distribution (UPD). In this paper, an adaptive sampling scheme for general surrogates is proposed based on LSO, similar to cross-validation and interquartile range (IQR). Multiple submodels are first developed from LSO. The uncertainty is then estimated from the IQR of these surrogates at a given point. New samples are added iteratively at the point with maximum IQR for design space exploration. The proposed scheme is illustrated using kriging, radial basis function, and neural network surrogates. The proposed scheme is evaluated using four algebraic test functions. Multiple sets of initial samples were produced to account for randomness. For these test functions, the proposed scheme was found to be more accurate and robust than kriging with its own uncertainty model. The proposed scheme was more accurate than the UPD for three out of the four test functions. For a fixed number of samples, the IQR-based adaptive sampling also proved to be more accurate than all-at-once sampling in most cases even when the estimated uncertainty was only mildly correlated with prediction errors.

Engineering↗

Polynomial chaos representation of databases on manifolds

Characterizing the polynomial chaos expansion (PCE) of a vector-valued random variable with probability distribution concentrated on a manifold is a relevant problem in data-driven settings. The probability distribution of such random vectors is multimodal in general, leading to potentially very slow convergence of the PCE. In this paper, we build on a recent development for estimating and sampling from probabilities concentrated on a diffusion manifold. The proposed methodology constructs a PCE of the random vector together with an associated generator that samples from the target probability distribution which is estimated from data concentrated in the neighborhood of the manifold. The method is robust and remains efficient for high dimension and large datasets. The resulting polynomial chaos construction on manifolds permits the adaptation of many uncertainty quantification and statistical tools to emerging questions motivated by data-driven queries.

97 MATHEMATICS AND COMPUTING↗

Theory and implementation of a very high throughput true random number generator in field programmable gate array

The contribution of this paper is proposing a new entropy extraction mechanism based on sampling phase jitter in ring oscillators to make a high throughput true random number generator in a field programmable gate array (FPGA) practical. Starting from experimental observation and analysis of the entropy source in FPGA, a multi-phase sampling method is exploited to harvest the clock jitter with a maximum entropy and fast sampling speed. This parametrized design is implemented in a Xilinx Artix-7 FPGA, where the carry chains in the FPGA are explored to realize the precise phase shifting. The generator circuit is simple and resource-saving, so that multiple generation channels can run in parallel to scale the output throughput for specific applications. The prototype integrates 64 circuit units in the FPGA to provide a total output throughput of 7.68 Gbps, which meets the requirement of current high-speed quantum key distribution systems. The randomness evaluation, as well as its robustness to ambient temperature, confirms that the new method in a purely digital fashion can provide high-speed high-quality random bit sequences for a variety of embedded applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Maximum a posteriori Ly α estimator (MAPLE): band power and covariance estimation of the 3D Ly α forest power spectrum

We present a novel maximum a posteriori estimator to jointly estimate band powers and the covariance of the three-dimensional power spectrum (P3D) of Ly $\alpha$ forest flux fluctuations, called MAPLE. Our Wiener-filter based algorithm reconstructs a window-deconvolved P3D in the presence of complex survey geometries typical for Ly $\alpha$ surveys that are sparsely sampled transverse to and densely sampled along the line of sight. We demonstrate our method on idealized Gaussian random fields with two selection functions: (i) a sparse sampling of 30 background sources per square degree designed to emulate the current Dark Energy Spectroscopic Instrument; (ii) a dense sampling of 900 background sources per square degree emulating the upcoming Prime Focus Spectrograph Galaxy Evolution Survey. Our proof-of-principle shows promise, especially since the algorithm can be extended to marginalize jointly over nuisance parameters and contaminants, i.e. offsets introduced by continuum fitting. Our code is implemented in JAX and is publicly available on GitHub.

79 ASTRONOMY AND ASTROPHYSICS↗

Noise Radar Approach for Interrogating SAW Sensors Using Software Defined Radio

Passive, wireless surface acoustic wave (SAW) sensor systems can be approached from a radar perspective, where the SAW device is thought of as a cooperative target. Here, this paper investigates the use of a commercial-off-the-shelf software defined radio to interrogate wireless SAW sensors with a randomly generated interrogation pulse. The USRP B200mini is utilized as the transceiver platform with custom field-programmable gate array (FPGA) modifications to generate the random interrogation waveform and provide synchronization and buffering to the received signal. Each transmit sample bit in the FPGA is fed by an independent linear-feedback shift register, which generates pseudo-random I and Q samples for the interrogation pulse. An RF daughterboard has also been developed and integrated with the B200mini to increase the transmit power, provide filtering of the RF signals, and switch a signal antenna between the transmit and receive channels. Radio control and matched filter correlator post-processing are accomplished using Python. Design and implementation details for the FPGA modifications, RF daughterboard, and post-processing are discussed. Lastly, the system is demonstrated by wirelessly interrogating SAW temperature sensors at 915 MHz.

47 OTHER INSTRUMENTATION↗

Using the Monte Carlo Method to Evaluate the Reliability of Screening Multifamily Housing for Radon

When screening for radon in a multifamily housing complex using a fixed sample density (e.g., testing 1 in 10 (10%) or 1 in 4 units (25%)), the statistical confidence is dependent upon the assumed elevated radon frequency. For example, testing 25% of units in a complex estimated to have eight units with elevated radon levels will provide 90% confidence. However, if it is assumed that, in the same complex, there are only three units with elevated radon levels, the confidence drops to around 58% for the same sample density. Furthermore, in the previous example, if elevated radon levels are not found during the screening, all that can be stated is that the screening provides 90% confidence that there are no more than seven units in the complex with elevated radon levels. To more fully illustrate this uncertainty, ten separate multifamily housing radon data sets with 1 to 10 units with radon levels ≥4 pCi/L (Table 1) were selected for analysis using the Monte Carlo statistical method. Unlike other mathematically based statistical approaches, the Monte Carlo statistical method relies on repeated analysis of randomly selected data. from a 100% sampled complex at various sample densities. Success for each simulation is defined as finding at least one unit with elevated radon levels. In this statistical method, confidence in the overarching conclusion can be greatly enhanced by repeating the simulated screening hundreds or even thousands of times. For this study, each of the ten data sets was simulated 1,000 times. For each simulation, the data set was randomized three times before the fixed percentage of data was selected.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Spatial patterns in occupancy and density of larval lampreys in freshwater habitats restored to a Stage 0 condition

Abstract We examined occupancy and density of larval lampreys ( Entosphenus tridentatus and Lampetra spp.) in two rivers in Oregon (USA) restored to a Stage 0 condition 1–5 years prior, using a multiscale occupancy model and a zero‐inflated Poisson mixture model. We sampled lampreys using backpack electrofishing in randomly distributed, paired, 1‐m 2 quadrats and recorded environmental data. Probabilities of occupancy and density were higher when water velocity was low, the substrate was noncompacted, and sediment was dominated by fines (<4 mm). At mean water depth (0.34 m) and velocity (0.09 m/s), estimated densities in occupied quadrats were 4.8 lampreys/m 2 (95%: 3.4–6.9) when the substrate was compacted, and fines were not dominant, and 21.1 lampreys/m 2 (95%: 17.7–25.3) when the substrate was noncompacted and fines were dominant. Probabilities of detecting occupancy in a 1‐m 2 quadrat sampled by backpack electrofishing were 0.76 (95%: 0.64–0.87) when captured after visual observation and 0.80 (95%: 0.71–0.88) with blind sweeps (i.e., constantly moving the net regardless of observation). The probability of capturing a single lamprey in a quadrat sampled by blind sweeps was 0.32 (95%: 0.27–0.37). Sampling in paired 1‐m 2 quadrats facilitated concurrent examination of patterns in occupancy and density while accounting for capture probability, which could aid temporal monitoring of restored habitats. To the best of our knowledge, this is the first study to document occupancy and estimate densities of larval lampreys in habitats that underwent valley floor restoration to Stage 0. We observed both lamprey genera within 5 years of restoration. Aquatic restoration that increases low‐velocity, noncompacted, fine sediment habitats could benefit lampreys.

Harris, Julianne E.↗

Model's sparse representation based on reduced mixed GMsFE basis methods

In this paper, we propose a model's sparse representation based on reduced mixed generalized multiscale finite element (GMsFE) basis methods for elliptic PDEs with random inputs. A typical application for the elliptic PDEs is the flow in heterogeneous random porous media. Mixed generalized multiscale finite element method (GMsFEM) is one of the accurate and efficient approaches to solve the flow problem in a coarse grid and obtain the velocity with local mass conservation. When the inputs of the PDEs are parameterized by the random variables, the GMsFE basis functions usually depend on the random parameters. This leads to a large number degree of freedoms for the mixed GMsFEM and substantially impacts on the computation efficiency. In order to overcome the difficulty, we develop reduced mixed GMsFE basis methods such that the multiscale basis functions are independent of the random parameters and span a low-dimensional space. To this end, a greedy algorithm is used to find a set of optimal samples from a training set scattered in the parameter space. Reduced mixed GMsFE basis functions are constructed based on the optimal samples using two optimal sampling strategies: basis-oriented cross-validation and proper orthogonal decomposition. Although the dimension of the space spanned by the reduced mixed GMsFE basis functions is much smaller than the dimension of the original full order model, the online computation still depends on the number of coarse degree of freedoms. To significantly improve the online computation, we integrate the reduced mixed GMsFE basis methods with sparse tensor approximation and obtain a sparse representation for the model's outputs. The sparse representation is very efficient for evaluating the model's outputs for many instances of parameters. To illustrate the efficacy of the proposed methods, we present a few numerical examples for elliptic PDEs with multiscale and random inputs. In particular, a two-phase flow model in random porous media is simulated by the proposed sparse representation method.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Effective pair potential for random fcc CoCrFeMnNi alloys

The single-phase equiatomic CoCrFeMnNi alloy is a random solid solution of five elements on the face-centered cubic lattice, whose pure constituents crystallize in very different structures and exhibit diverse magnetic properties. Due to the randomness of the alloy, 80% of nearest neighbor bonds are between unlike elements and thus the details of bonding in pure structures are less important. The elastic moduli of this alloy give rise to small Cauchy pressure C 12 - C 44 , which suggests that the dominant part of bonding may be described by a simple pair potential. We test this hypothesis by developing a long-range Lennard-Jones potential in which the equilibrium crystal structures of pure constituents are taken as reference. The standard mixing rules for regular solutions are then adopted to obtain parameters for bonds between unlike elements in the quinary system. The transferability of this potential to quaternary CoCrFeNi, ternary CoCrNi, and binary FeNi alloys is investigated and the predictions compared with experiments and density functional theory calculations. By sampling over a large number of random configurations, we investigate the effect of compositional randomness on misfit volumes, energies of point defects and stacking faults, and the dislocation friction stresses experienced by moving edge and screw dislocations.

Materials Science↗

Efficient Probabilistic Prediction and Uncertainty Quantification of Tropical Cyclone–Driven Storm Tides and Inundation

Abstract This study proposes and assesses a methodology to obtain high-quality probabilistic predictions and uncertainty information of near-landfall tropical cyclone–driven (TC-driven) storm tide and inundation with limited time and resources. Forecasts of TC track, intensity, and size are perturbed according to quasi-random Korobov sequences of historical forecast errors with assumed Gaussian and uniform statistical distributions. These perturbations are run in an ensemble of hydrodynamic storm tide model simulations. The resulting set of maximum water surface elevations are dimensionality reduced using Karhunen–Loève expansions and then used as a training set to develop a polynomial chaos (PC) surrogate model from which global sensitivities and probabilistic predictions can be extracted. The maximum water surface elevation is extrapolated over dry points incorporating energy head loss with distance to properly train the surrogate for predicting inundation. We find that the surrogate constructed with third-order PCs using elastic net penalized regression with leave-one-out cross validation provides the most robust fit across training and test sets. Probabilistic predictions of maximum water surface elevation and inundation area by the surrogate model at 48-h lead time for three past U.S. landfalling hurricanes (Irma in 2017, Florence in 2018, and Laura in 2020) are found to be reliable when compared to best track hindcast simulation results, even when trained with as few as 19 samples. The maximum water surface elevation is most sensitive to perpendicular track-offset errors for all three storms. Laura is also highly sensitive to storm size and has the least reliable prediction. Significance Statement The purpose of this study is to develop and evaluate a methodology that can be used to provide high-quality probabilistic predictions of hurricane-induced storm tide and inundation with limited time and resources. This is important for emergency management purposes during or after the landfall of hurricanes. Our results show that sampling forecast errors using quasi-random sequences combined with machine learning techniques that fit polynomial functions to the data are well suited to this task. The polynomial functions also have the benefit of producing exact sensitivity indices of storm tide and inundation to the forecasted hurricane properties such as path, intensity, and size, which can be used for uncertainty estimation. The code implementing the presented methodology is publicly available on GitHub.

54 ENVIRONMENTAL SCIENCES↗

Generating log-normal mock catalog of galaxies in redshift space

We present a public code to generate a mock galaxy catalog in redshift space assuming a log-normal probability density function (PDF) of galaxy and matter density fields. We draw galaxies by Poisson-sampling the log-normal field, and calculate the velocity field from the linearised continuity equation of matter fields, assuming zero vorticity. This procedure yields a PDF of the pairwise velocity fields that is qualitatively similar to that of N-body simulations. We check fidelity of the catalog, showing that the measured two-point correlation function and power spectrum in real space agree with the input precisely. We find that a linear bias relation in the power spectrum does not guarantee a linear bias relation in the density contrasts, leading to a cross-correlation coefficient of matter and galaxies deviating from unity on small scales. We also find that linearising the Jacobian of the real-to-redshift space mapping provides a poor model for the two-point statistics in redshift space. That is, non-linear redshift-space distortion is dominated by non-linearity in the Jacobian. The power spectrum in redshift space shows a damping on small scales that is qualitatively similar to that of the well-known Fingers-of-God (FoG) effect due to random velocities, except that the log-normal mock does not include random velocities. This damping is a consequence of non-linearity in the Jacobian, and thus attributing the damping of the power spectrum solely to FoG, as commonly done in the literature, is misleading.

79 ASTRONOMY AND ASTROPHYSICS↗

Disk Density Tuning of a Maximal Random Packing

We introduce an algorithmic framework for tuning the spatial density of disks in a maximal random packing, without changing the sizing function or radii of disks. Starting from any maximal random packing such as a Maximal Poisson-disk Sampling (MPS), we iteratively relocate, inject (add), or eject (remove) disks, using a set of three successively more-aggressive local operations. We may achieve a user-defined density, either more dense or more sparse, almost up to the theoretical structured limits. The tuned samples are conflict-free, retain coverage maximality, and, except in the extremes, retain the blue noise randomness properties of the input. We change the density of the packing one disk at a time, maintaining the minimum disk separation distance and the maximum domain coverage distance required of any maximal packing. These properties are local, and we can handle spatially-varying sizing functions. Using fewer points to satisfy a sizing function improves the efficiency of some applications. We apply the framework to improve the quality of meshes, removing non-obtuse angles; and to more accurately model fiber reinforced polymers for elastic and failure simulations.

97 MATHEMATICS AND COMPUTING↗

Detector Calibration to Quantify Random Summing in HPGe Spectroscopy

While calibrating a High Purity Germanium (HPGe) Radiation Detector for Xenon-133 (133Xe) the process of random summing occurs which leads to excess counts in the 160.6keV peak from random summing of the 81keV photons at the 162keV energy. Multiple samples of 133Xe with varying levels of radioactivity were assayed to determine a relationship between the occurrence of random summing and the net area of the 160.6keV peak. When the calculated efficiencies in the 160.6keV peak were compared to the theoretical efficiency obtained from a multi-energy calibration at 160.6keV, the amount of random summing could be estimated as excess observed efficiency and correlated to the sample activity. While a trend is apparent in the data, the mechanisms that contribute to the trend are still being studied so the data can be accurately correlated.

07 ISOTOPE AND RADIATION SOURCES↗

Observational needs for estimating Alaskan soil carbon stocks under current and future climate

Abstract Representing land surface spatial heterogeneity when designing observation networks is a critical scientific challenge. Here we present a geospatial approach that utilizes the multivariate spatial heterogeneity of soil‐forming factors—namely, climate, topography, land cover types, and surficial geology—to identify observation sites to improve soil organic carbon (SOC) stock estimates across the State of Alaska, USA. Standard deviations in existing SOC samples indicated that 657, 870, and 906 randomly distributed pedons would be required to quantify the average SOC stocks for 0–1 m, 0–2 m, and whole‐profile depths, respectively, at a confidence interval of 5 kg C m −2 . Using the spatial correlation range of existing SOC samples, we identified that 309, 446, and 484 new observation sites are needed to estimate current SOC stocks to 1 m, 2 m, and whole‐profile depths, respectively. We also investigated whether the identified sites might change under future climate by using eight decadal (2020–2099) projections of precipitation, temperature, and length of growing season for three representative concentration pathway (RCP 4.5, 6.0, and 8.5) scenarios of the Intergovernmental Panel on Climate Change. These analyses determined that 12 to 41 additional sites (906 + 12 to 41; depending upon the emission scenarios) would be needed to capture the impact of future climate on Alaskan whole‐profile SOC stocks by 2100. The identified observation sites represent spatially distributed locations across Alaska that captures the multivariate heterogeneity of soil‐forming factors under current and future climatic conditions. This information is needed for designing monitoring networks and benchmarking of Earth system model results.

54 ENVIRONMENTAL SCIENCES↗

Improving the accuracy of freight mode choice models: A case study using the 2017 CFS PUF data set and ensemble learning techniques

Here, the US Census Bureau has collected two rounds of experimental data from the Commodity Flow Survey, providing shipment-level characteristics of nationwide commodity movements, published in 2012 (i.e., Public Use Microdata) and in 2017 (i.e., Public Use File). With this information, data-driven methods have become increasingly valuable for understanding detailed patterns in freight logistics. In this study, we used the 2017 Commodity Flow Survey Public Use File data set to explore building a high-performance freight mode choice model, considering three main improvements: (1) constructing local models for each separate commodity/industry category; (2) extracting useful geographical features, particularly the derived distance of each freight mode between origin/destination zones; and (3) applying additional ensemble learning methods such as stacking or voting to combine results from local and unified models for improved performance. The proposed method achieved over 92% accuracy without incorporating external information, an over 19% increase compared to directly fitting Random Forests models over 10,000 samples. Furthermore, SHAP (Shapely Additive Explanations) values were computed to explain the outputs and major patterns obtained from the proposed model. The model framework could enhance the performance and interpretability of existing freight mode choice models.

42 ENGINEERING↗

Understanding the bias introduced in quantum dot blinking using change point analysis

Quantum dots are semiconductor crystals that are less than 100 nanometers in size; that is, between 1 billionth and 100 billionths of a meter. They can be composed of one semiconductor material or a core of one semiconductor surrounded by a shell of another. The quantum dots studied in this work consisted of a cadmium selenide core surrounded by a cadmium sulfide shell. When a quantum dot is illuminated with light, some of it can be absorbed and excites the quantum dot to a higher energy state. To relax back down to its resting state, light can be emitted in the form of fluorescence. The nature of the fluorescence that is emitted from a single quantum dot differs from that which is emitted from a bulk sample (usually a solid film or a solution of quantum dots). While in bulk samples the fluorescence over time fluctuates randomly about some average, maintaining a continuous average intensity, single quantum dot fluorescence switches between two or more intensities. This phenomenon is referred to as quantum dot blinking, and its origin is of significant relevance to solar cell, light emitting diode and biological tracking applications. Quantum dot blinking can be studied by exciting an isolated quantum dot with light and recording the ensuing fluorescence using sensitive detectors. This is done over many minutes, resulting in a fluorescence intensity (in counts per second) versus time trajectory. These trajectories must be further analyzed in order to understand the nature of the blinking behavior. Conventionally, a bin and threshold analysis is used, whereby the arrival times of fluorescent photons are binned to reduce the signal noise, and a threshold is used to separate the trajectory into periods of high and low fluorescence. In this study, the effects of bin size and threshold on the blinking kinetics were investigated, and the assumption that there is only one bright and one dark state was tested. To do so, a statistically rigorous method called change point analysis was needed which does not require binning and which can determine the number of intensity levels present. Blinking in 17 quantum dots was studied using both analysis methods. The primary parameter that was compared between the two methods is called a truncation time. Increasing the bin size was found to generally lead to a larger truncation time while increasing the threshold always decreased the truncation time. Using the change point analysis method, 12 out of 17 quantum dots were found to exhibit more than two intensity levels. Lastly, the assumption that only two intensity levels exist was found to significantly affect the blinking statistics: when individual levels were combined into one bright level, the truncation time would increase. The change point analysis method was found to be more suitable for studying multilevel blinking in quantum dots than the conventional bin and threshold method, since the effects of binning and thresholding can be alleviated and the two-level assumption relaxed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗