Search NASA⌕ Search

SEARCH · Search NASA

Results for “random sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

MAPPER – A NOVEL CAPABILITY TO SUPPORT NUCLEAR MODEL VALIDATION AND MAPPING OF BIASES AND UNCERTAINTIES

This paper overviews the initial results of a new project at the Oak Ridge National Laboratory -- supported via an internal seed funding program -- focused on the development of a novel computational capability, called MAPPER, to support model validation. The MAPPER development aims to eliminate the need for empirical criteria, such as similarity indices, often employed to identify applicable experiments for given application conditions. To achieve that, MAPPER employs an information-theoretic-based approach, based on the Kullback-Leibler (KL) divergence principle, to combine responses of available or to-be-built experiments with application responses of interest using a training set of samples generated using randomized execution of the experiments and the application high fidelity analysis models. These samples are condensed using reduced order modeling techniques in the form of a joint probability distribution function (PDF) connecting each application response of interest with a new effective experimental response. The initial focus of the MAPPER capability will be to support the confirmatory analysis required for criticality safety analysis of storage facilities which require k-eff biases to be known for safe operation. This paper reports some of the initial results obtained with MAPPER as applied to a set of critical experiments for which existing similarity-based methods have been shown to provide inaccurate estimates of the biases.

Mertyurek, Ugur↗

Using Parameter Sweep in WaterTAP to Analyze New Water Treatment Technologies

We describe a powerful and generalized parameter sweep tool in this report that was originally developed to analyze the performance of existing and novel water treatment models being developed in WaterTAP. Since WaterTAP is built upon IDAES and Pyomo, the parameter sweep tool can be used to systematically explore and debug the behavior of most Pyomo and IDAES numerical models. In order to enable meaningful analyses, the parameter sweep tool has been designed with the following features: 1) Model flexibility: The parameter sweep tool does not enforce any restrictions on the types of models that can be used with it. As long as a Pyomo model can be solved and the parameter is active and mutable, the tool only needs functions that describe how to run the model, the sweep parameters, and the output quantities of interest. 2) Flexible sampling: The parameter sweep tool has inbuilt functions to generate samples from a random distribution or a multidimensional Euclidean space. Furthermore, the users have to ability to supply samples generated from a tool of their choice. 3) Multiple sweep types: A user can choose from one of 3 types of parameter sweeps depending on their needs. 4) Detailed outputs: Outputs generated by the parameter sweep tool can be stored in detailed H5 file or user-friendly CSV files for post processing. 5) Parallel computing: The parameter sweep supports shared and distributed memory parallel computing to enable the use of high performance computers (HPC) for large-scale analyses. 6) Modular: The parameter sweep tool is self-contained and can easily be integrated within an outer-loop analysis or as desired by the user. 7) Ease of use: The tool is well documented and a simple sweep can be easily executed by following the online documentation in a few lines of code. We demonstrate the use of the parameter sweep tool on a simple water treatment system from the WaterTAP repository and show its parallel scaling performance on an Apple laptop and NREL's Eagle HPC. The parameter sweep tool is actively being used with models currently being developed within WaterTAP and we expect its use to grow beyond it to other IDAES and Pyomo models.

97 MATHEMATICS AND COMPUTING↗

Three-level sampler having automated thresholds

A three-level sampler is described that has its thresholds controlled automatically so as to track changes in the statistics of the random process being sampled. In particular, the mean value is removed and the ratio of the standard deviation of the random process to the threshold is maintained constant. The system is configured in such a manner that slow drifts in the level comparators and digital-to-analog converters are also removed. The ratio of the standard deviation to threshold level may be chosen within the constraints of the ratios of two integers N and M. These may be chosen to minimize the quantizing noise of the sampled process.

Jurgens, R. F.↗

Fermionic Partial Tomography via Classical Shadows

Here we propose a tomographic protocol for estimating any k-body reduced density matrix (k-RDM) of an n-mode fermionic state, a ubiquitous step in near-term quantum algorithms for simulating many-body physics, chemistry, and materials. Our approach extends the framework of classical shadows, a randomized approach to learning a collection of quantum-state properties, to the fermionic setting. Our sampling protocol uses randomized measurement settings generated by a discrete group of fermionic Gaussian unitaries, implementable with linear-depth circuits. We prove that estimating all k-RDM elements to additive precision ϵ requires on the order of ($^{n}_{k}$)k 3/2 log(n)/ϵ 2 repeated state preparations, which is optimal up to the logarithmic factor. Furthermore, numerical calculations show that our protocol offers a substantial improvement in constant overheads for k ≥ 2, as compared to prior deterministic strategies. We also adapt our method to particle-number symmetry, wherein the additional circuit depth may be halved at the cost of roughly 2–5 times more repetitions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An Overdetermined System for Improved Autocorrelation Based Spectral Moment Estimator Performance

Autocorrelation based spectral moment estimators are typically derived using the Fourier transform relationship between the power spectrum and the autocorrelation function along with using either an assumed form of the autocorrelation function, e.g., Gaussian, or a generic complex form and applying properties of the characteristic function. Passarelli has used a series expansion of the general complex autocorrelation function and has expressed the coefficients in terms of central moments of the power spectrum. A truncation of this series will produce a closed system of equations which can be solved for the central moments of interest. The autocorrelation function at various lags is estimated from samples of the random process under observation. These estimates themselves are random variables and exhibit a bias and variance that is a function of the number of samples used in the estimates and the operational signal-to-noise ratio. This contributes to a degradation in performance of the moment estimators. This dissertation investigates the use autocorrelation function estimates at higher order lags to reduce the bias and standard deviation in spectral moment estimates. In particular, Passarelli's series expansion is cast in terms of an overdetermined system to form a framework under which the application of additional autocorrelation function estimates at higher order lags can be defined and assessed. The solution of the overdetermined system is the least squares solution. Furthermore, an overdetermined system can be solved for any moment or moments of interest and is not tied to a particular form of the power spectrum or corresponding autocorrelation function. As an application of this approach, autocorrelation based variance estimators are defined by a truncation of Passarelli's series expansion and applied to simulated Doppler weather radar returns which are characterized by a Gaussian shaped power spectrum. The performance of the variance estimators determined from a closed system is shown to improve through the application of additional autocorrelation lags in an overdetermined system. This improvement is greater in the narrowband spectrum region where the information is spread over more lags of the autocorrelation function. The number of lags needed in the overdetermined system is a function of the spectral width, the number of terms in the series expansion, the number of samples used in estimating the autocorrelation function, and the signal-to-noise ratio. The overdetermined system provides a robustness to the chosen variance estimator by expanding the region of spectral widths and signal-to-noise ratios over which the estimator can perform as compared to the closed system.

Keel, Byron M.↗

Midmorning Point Sampling May Not Accurately Represent Nitrous Oxide Emissions Following Fertilizer Applications

A common approach for measuring N 2 O emissions is to collect midmorning or early evening gas samples from experiments utilizing the chamber-based flux methodology. However, due to high spatial and temporal variability, N 2 O estimates based on midmorning or early evening sampling may not provide accurate estimates of total emissions. This study determined the impact of sampling collection timing on the precision and accuracy of N 2 O emissions estimates. Nitrous oxide emissions, air and soil temperatures, and soil moisture were measured for 21 d following the application of 224 kg urea-N ha –1 on 20 Sept. 2017, 11 Oct. 2017, and 1 May 2018, at six time intervals (0130–0230, 0530–0630, 0930–1030, 1330–1430, 1730–1830, and 2130–2230 h) over a 24-h period. Based on multiple daily measurements, point samples collected between 0930 and 1030 h (midmorning) were inconsistent in their ability to predict N 2 O emissions. However, samples collected between 2130 and 2230 h (early evening) were similar to average emissions. The number of randomly collected point samples to be within 20% of the mean 80% of the time over a 21-d period ranged from 13 samples for fertilizer applied on 20 Sept. 2017 to 48 samples for fertilizer applied on 11 Oct. 2017. This research indicates that management and climatic variability affect N 2 O emissions, and that accurate sampling protocols vary across management and climates. To reduce uncertainty, N 2 O sampling protocol should be tested under conditions likely to occur and where possible, near-continuous measurement systems should be adopted.

54 ENVIRONMENTAL SCIENCES↗

Randomized Projection for Rank-Revealing Matrix Factorizations and Low-Rank Approximations

Rank-revealing matrix decompositions provide an essential tool in spectral analysis of matrices, including the Singular Value Decomposition (SVD) and related low-rank approximation techniques. QR with Column Pivoting (QRCP) is usually suitable for these purposes, but it can be much slower than the unpivoted QR algorithm. For large matrices, the difference in performance is due to increased communication between the processor and slow memory, which QRCP needs in order to choose pivots during decomposition. Our main algorithm, Randomized QR with Column Pivoting (RQRCP), uses randomized projection to make pivot decisions from a much smaller sample matrix, which we can construct to reside in a faster level of memory than the original matrix. This technique may be understood as trading vastly reduced communication for a controlled increase in uncertainty during the decision process. Furthermore, for rank-revealing purposes, the selection mechanism in RQRCP produces results that are the same quality as the standard algorithm, but with performance near that of unpivoted QR (often an order of magnitude faster for large matrices). Additionally, we also propose two formulas that facilitate further performance improvements. The first efficiently updates sample matrices to avoid computing new randomized projections. The second avoids large trailing updates during the decomposition in truncated low-rank approximations. Our truncated version of RQRCP also provides a key initial step in our truncated SVD approximation, TUXV. These advances open up a new performance domain for large matrix factorizations that will support efficient problem-solving techniques for challenging applications in science, engineering, and data analysis.

97 MATHEMATICS AND COMPUTING↗

Node-degree aware edge sampling mitigates inflated classification performance in biomedical random walk-based graph representation learning

Motivation: Graph representation learning is a family of related approaches that learn low-dimensional vector representations of nodes and other graph elements called embeddings. Embeddings approximate characteristics of the graph and can be used for a variety of machine-learning tasks such as novel edge prediction. For many biomedical applications, partial knowledge exists about positive edges that represent relationships between pairs of entities, but little to no knowledge is available about negative edges that represent the explicit lack of a relationship between two nodes. For this reason, classification procedures are forced to assume that the vast majority of unlabeled edges are negative. Existing approaches to sampling negative edges for training and evaluating classifiers do so by uniformly sampling pairs of nodes. Results: We show here that this sampling strategy typically leads to sets of positive and negative examples with imbalanced node degree distributions. Using representative heterogeneous biomedical knowledge graph and random walk-based graph machine learning, we show that this strategy substantially impacts classification performance. If users of graph machine-learning models apply the models to prioritize examples that are drawn from approximately the same distribution as the positive examples are, then performance of models as estimated in the validation phase may be artificially inflated. We present a degree-aware node sampling approach that mitigates this effect and is simple to implement. Availability and implementation: Our code and data are publicly available at https://github.com/monarch-initiative/negativeExampleSelection.

59 BASIC BIOLOGICAL SCIENCES↗

Imbalanced Learning for Functional State Assessment

This paper presents results of several imbalanced learning techniques applied to operator functional state assessment where the data is highly imbalanced, i.e., some function states (majority classes) have much more training samples than other states (minority classes). Conventional machine learning techniques usually tend to classify all data samples into majority classes and perform poorly for minority classes. In this study, we implemented five imbalanced learning techniques, including random undersampling, random over-sampling, synthetic minority over-sampling technique (SMOTE), borderline-SMOTE and adaptive synthetic sampling (ADASYN) to solve this problem. Experimental results on a benchmark driving lest dataset show thai accuracies for minority classes could be improved dramatically with a cost of slight performance degradations for majority classes,

Li, Feng↗

Envisioning the Future of International Earth Observations Collaboration: Area and Map Accuracy Estimation by Sampling

- Maps have errors, sometimes a lot of errors ⇒ obtaining information directly from map problematic; any use of the map will benefit from information about errors/uncertainty - IPCC: unbiasedness and uncertainty - By randomly drawing a sample from the study area, observing reference conditions at drawn locations, and constructing estimators – easily estimate areas and map accuracy ± uncertainty - Sampling design and analysis, relatively easy – collecting reference observations is not. Cloud-based solutions, e.g. AREA2, Collect Earth Online, facilitate the collection of reference observations - More research and guidance needed!

Pontus Olofsson↗

The correspondence of surface climate parameters with satellite and terrain data

One of the goals of the research was to develop a ground sampling stragegy for calibrating remotely sensed measurements of surface climate parameters. The initial sampling strategy involved the stratification of the terrain based on important ancillary surface variables such as slope, exposure, insolation, geology, drainage, fire history, etc. For a spatially heterogeneous population, sampling error is reduced and efficiency increased by stratification of the landscape into more homogeneous sub-areas and by employing periodic random spacing of samples. These concepts were applied in the initial stratification of the study site for the purpose of locating and allocating instrumentation.

Dozier, Jeff↗

Coarse-Grained Density Functional Theory Predictions via Deep Kernel Learning

Scalable electronic predictions are critical for soft materials design. Recently, the Electronic Coarse-Graining (ECG) method was introduced to renormalize all-atom quantum chemical (QC) predictions to coarse-grained (CG) resolutions using deep neural networks (DNNs). While DNNs can learn complex representations that prove challenging for kernel-based methods, they are susceptible to overfitting and the overconfidence of uncertainty estimations. Here, we develop ECG within a GPU-accelerated Deep Kernel Learning (DKL) framework to enable CG QC predictions using range-separated hybrid density functional theory (DFT), obtaining a 107 speedup relative to naive all-atom QC. By treating the predicted electronic properties as random Gaussian Processes, DKL incorporates CG mapping degeneracy by learning the distribution of electronic energies as a function of CG configuration. DKL-ECG accurately reproduces molecular orbital energies from range-separated DFT while facilitating efficient training via active learning using the uncertainties provided by DKL. Further, we show that while active learning algorithms enable efficient sampling of a more diverse configurational space relative to random sampling, all explored query methods exhibit comparable performance for the examined system. We attribute this result to the significant overlap of the feature space and output property distributions across multiple temperatures.

97 MATHEMATICS AND COMPUTING↗

Compositional inhomogeneities in a single Icelandic tholeiite flow

New trace element analyses of 25 basalt samples from a vertical traverse in an 11 m thick flow of Icelandic tholeiite show compositional differences which exceed analytical uncertainties and are random with respect to height. These variations suggest a short-range segregation model in which the amounts of phenocrysts, groundmass materials, and residual liquid vary randomly in different samples of the flow; a least-squares method is applied to determine if these variations reflect different proportions of crystallizing phases and residual liquid. Monte Carlo computations indicate that short-range segregation results in inhomogeneity of a magnitude of interflow compositional differences; this causes incoherence in elements with different geochemical behaviors while preserving coherence in elements of similar behavior.

Lindstrom, M. M.↗

Changes in the Optical Properties of Simulated Shuttle Waste Water Deposits: Urine Darkening

Manned spacecraft have historically dumped the crew generated waste water overboard, into the environment in which the spacecraft operates, sometimes depositing the waste water on the external spacecraft surfaces. The change in optical properties of wastewater deposited on spacecraft external surfaces, from exposure to space environmental effects, is not well understood. This study used nonvolatile residue (NVR) from Human Urine to simulate wastewater deposits and documents the changes in the optical properties of the NVR deposits after exposure to ultra violet(UV)radiation. Twenty four NVR samples of, 0-angstromes/sq cm to 1000-angstromes/sq cm, and one sample contaminated with 1 to 2-mg/sq cm were exposed to UV radiation over the course of approximately 6151 equivalent sun hours (ESH). Random changes in sample mass, NVR, solar absorbance, and infrared emission were observed during the study. Significant changes in the UV transmittance were observed for one sample contaminated at the mg/sq cm level.

Albyn, Keith↗

Changes in the Optical Properties of Simulated Shuttle Waste Water Deposits- Urine Darkening

Manned spacecraft have historically dumped the crew generated waste waster overboard, into the environment in which the spacecraft operates, sometimes depositing the waste water on the external spacecraft surfaces. The change in optical properties of wastewater deposited on spacecraft external surfaces, from exposure to space environmental effects, is not well understood. This study used nonvolatile residue (NVR) from Human Urine to simulate wastewater deposits and documents the changes in the optical properties of the NVR deposits after exposure to ultra violet (UV) radiation. Twenty NVR samples of, 0-angstromes/sq cm to 1000-angstromes/sq cm, and one sample contaminated with 1 to 2-mg/sq cm were exposed to UV radiation over the course of approximately 6151 equivalent sun hours (ESH). Random changes in sample mass, NVR, solar absorbance, and infrared emission were observed during the study. Significant changes in the UV transmittance were observed for one sample contaminated at the mg/sq cm level.

Albyn, Keith↗

Rapid Identification of X-ray Diffraction Patterns Based on Very Limited Data by Interpretable Convolutional Neural Networks

Large volumes of data from material characterizations call for rapid and automatic data analysis to accelerate materials discovery. Herein, we report a convolutional neural network (CNN) that was trained based on theoretical data and very limited experimental data for fast identification of experimental X-ray diffraction (XRD) patterns of metal–organic frameworks (MOFs). To augment the data for training the model, noise was extracted from experimental data and shuffled; then it was merged with the main peaks that were extracted from theoretical spectra to synthesize new spectra. For the first time, one-to-one material identification was achieved. Theoretical MOFs patterns (1012) were augmented to a whole data set of 72 864 samples. It was then randomly shuffled and split into training (58 292 samples) and validation (14 572 samples) data sets at a ratio of 4:1. For the task of discriminating, the optimized model showed the highest identification accuracy of 96.7% for the top 5 ranking on a test data set of 30 hold-out samples. Neighborhood component analysis (NCA) on the experimental XRD samples shows that the samples from the same material are clustered in groups in the NCA map. Analysis on the class activation maps of the last CNN layer further discloses the mechanism by which the CNN model successfully identifies individual MOFs from the XRD patterns. Furthermore, this CNN model trained by the data augmentation technique would not only open numerous potential applications for identifying XRD patterns for different materials, but also pave avenues to autonomously analyze data by other characterization tools such as FTIR, Raman, and NMR spectroscopies.

36 MATERIALS SCIENCE↗

ENVIRONMENTS OF QSOs AT REDSHIFT 0.9-1.3

We analyze new deep g- and i-band imaging of 16 QSOs in the redshift range 0.9-1.3 with the Canada-France-Hawaii Telescope. The principal points of interest are the symmetry and signs of tidal effects in the QSO hosts and nearby (companion) galaxies. The sample measures are compared with similar measures on randomly selected field galaxy samples. Asymmetry measures are made for all objects to g {approx} 22, and magnitudes of all galaxies 2 mag fainter. The QSOs are found in denser environments than the field, and are somewhat offset from the centroid of their surrounding galaxies. The QSO hosts appear more disturbed than other galaxies. While the QSO companions and field galaxies have the same average asymmetry, the distribution of asymmetry values is different. QSO companions within 15'' are fainter than average field galaxies. We discuss scenarios that are consistent with these and other measured quantities.

79 ASTRONOMY AND ASTROPHYSICS↗