Search NASA⌕ Search

SEARCH · Search NASA

Results for “Sampling error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Analysis of solid uranium particulates on cotton swipes with an automated microextraction-ICP-MS system

Here, an automated microextraction method coupled to an inductively coupled plasma – mass spectrometer (ICP-MS) was developed for the direct analysis of solid uranium particulates on the surface of cotton swipes. The microextraction probe extracts particulates from the sample surface, in a flowing solvent, and directs the removed analyte to an ICP-MS for isotopic determination. The automated system utilizes a mechanical XY stage that is software controlled with the capability of saving and returning to specific locations and a camera focused to the swipe surface for optimal viewing of the extracted locations (i.e., material present). Here, particulates (n = 135) were extracted and measured by ICP-MS, including 35 depleted uranyl nitrate hexahydrate (UN) (used for mass bias corrections), 50 uranyl fluoride (UO 2 F 2 ), and 50 uranyl acetate (UAc) particulates. Blank extractions were performed on the cotton swipes between triplicate sample analyses. Between each swipe extraction, the probe was sent between two wells containing 10% and 5% HNO 3 to clean the probe head and to eliminate any analyte carryover between particulates. The measured 235 U/ 238 U and 234 U/ 238 U isotope ratios for the UO 2 F 2 particulates were 0.00725(8) and 0.000054(4), a percent relative difference (% RD) of –0.041% and –1.7% from the reference isotope ratios determined in-lab through multi-collector ICP-MS analysis of dissolved aliquots of the U material. The UAc samples had a measured 235 U/ 238 U isotope ratio of 0.00206(7), a –0.96% relative difference from the reference value of 0.00208(1). The 234 U/ 238 U and 236 U/ 238 U isotope ratios were 0.000008(1) and 0.000031(4), –5.1% RD and –4.3% RD, respectively. The automated sample stage enabled seamless and rapid particle analysis, leading to a significant increase in throughput versus what was previously possible. Additionally, the saved location capability reduced user sampling error as sampling locations were easily stored and recalled. Analysis of U particles on the swipe surface – including blanks, mass bias, and triplicate extractions – was completed in less than an hour without any sample preparation necessary.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

BEYONDPLANCK X. Planck Low Frequency Instrument frequency maps with sample-based error propagation

We present Planck Low Frequency Instrument (LFI) frequency sky maps derived within the BEYONDPLANCK framework. This framework draws samples from a global posterior distribution that includes instrumental, astrophysical, and cosmological parameters, and the main product is an entire ensemble of frequency sky map samples, each of which corresponds to one possible realization of the various modeled instrumental systematic corrections, including correlated noise, time-variable gain, as well as far sidelobe and bandpass corrections. This ensemble allows for computationally convenient end-to-end propagation of low-level instrumental uncertainties into higher-level science products, including astrophysical component maps, angular power spectra, and cosmological parameters. We show that the two dominant sources of LFI instrumental systematic uncertainties are correlated noise and gain fluctuations, and the products presented here support – for the first time – full Bayesian error propagation for these effects at full angular resolution. We compared our posterior mean maps with traditional frequency maps delivered by the Planck Collaboration, and find generally good agreement. The most important quality improvement is due to significantly lower calibration uncertainties in the new processing, as we find a fractional absolute calibration uncertainty at 70 GHz of Δg 0 /g 0 = 5 x 10 -5 , which is nominally 40 times smaller than that reported by Planck 2018. However, we also note that the original Planck 2018 estimate has a nontrivial statistical interpretation, and this further illustrates the advantage of the new framework in terms of producing self-consistent and well-defined error estimates of all involved quantities without the need of ad hoc uncertainty contributions. We describe how low-resolution data products, including dense pixel-pixel covariance matrices, may be produced from the posterior samples directly, without the need for computationally expensive analytic calculations or simulations. We conclude that posterior-based frequency map sampling provides unique capabilities in terms of low-level systematics modeling and error propagation, and may play an important role for future Cosmic Microwave Background (CMB) B-mode experiments aiming at nanokelvin precision.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Using Eye Tracking to Elucidate the Mechanisms Underlying Stimulation-Enhanced Visual Target Detection

Transcranial direct current stimulation (tDCS) is a noninvasive form of brain stimulation that involves passing a weak electrical current between electrodes on the scalp to modulate underlying neural tissue. TDCS has been shown to modulate cognition in a variety of domains, including memory, attention, and visual processing. Prior work from our laboratory has shown positive effects of tDCS on learning to detect target objects hidden in complex naturalistic visual scenes and learn rules for categorizing images, though the mechanism for these benefits remains unknown. One possibility is that tDCS optimizes visual search by modulating visual attention or via the reduction in search errors. One method of quantifying visual attention is to use eye tracking to record search patterns to determine if and how visual search is adjusted under verum stimulation conditions. Eye tracking data allows classification of errors into error types, including sampling errors (failing to look in the relevant region), recognition errors (looking at the critical portion of a scene, but failing to recognize it as such as evidenced by visual fixation), and decision-making errors (fixating on the relevant portion of a scene, but making the wrong determination). Our results indicate that the benefit tDCS confers on visual search for targets stems from the reduction in decision-making errors when targets are present (Cohen’s d = 0.86). Also reported is a replication of previous findings showing a tDCS-dependent improvement in learning this task, learning score (Cohen’s d = 0.88); d’ (Cohen’s d = 1.00). This provides support for moving tDCS into the application space by pairing it with analysts who are concerned with the type of search error that is corrected via stimulation.

attention↗
DOE OSTI2021

Distributionally Safe Path Planning: Wasserstein Safe RRT

In this paper, we propose a Wasserstein metric-based random path planning algorithm. Wasserstein Safe RRT (W-Safe RRT) provides finite-sample probabilistic guarantees on the safety of a returned path in an uncertain obstacle environment. Vehicle and obstacle states are modeled as distributions based upon state and model observations. Additionally, we define limits on distributional sampling error so the Wasserstein distance between a vehicle state distribution and obstacle distributions can be bounded. This enables the algorithm to return safe paths with a confidence bound through combining finite sampling error bounds with calculations of the Wasserstein distance between discrete distributions. W-Safe RRT is compared against a baseline minimum encompassing ball algorithm, which ensures balls that minimally encompass discrete state and obstacle distributions do not overlap. The improved performance is verified in a 3D environment using single, multi, and rotating non-convex obstacle cases, with and without forced obstacle error in adversarial directions, showing that W-Safe RRT can handle poorly modeled complex environments.

42 ENGINEERING↗
DOE OSTI2023

A Stochastic Covariance Shrinkage Approach in Ensemble Transform Kalman Filtering

The Ensemble Kalman Filters (EnKF) employ a Monte-Carlo approach to represent covariance information, and are affected by sampling errors in operational settings where the number of model realizations is much smaller than the model state dimension. To alleviate the effects of these errors EnKF relies on model-specific heuristics such as covariance localization, which takes advantage of the spatial locality of correlations among the model variables. This work proposes an approach to alleviate sampling errors that utilizes a locally averaged-in-time dynamics of the model, described in terms of a climatological covariance of the dynamical system. We use this covariance as the target matrix in covariance shrinkage methods, and develop a stochastic covariance shrinkage approach where synthetic ensemble members are drawn to enrich both the ensemble subspace and the ensemble transformation. We additionally provide for a way in which this methodology can be localized similar to the state-of-the-art LETKF method, and that for a certain model setup, our methodology significantly outperforms it.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Analysis of Three Types of Collocated Disdrometer Measurements at the ARM Southern Great Plains Observatory

To better provide U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility’s disdrometer deployment strategy and support ARM precipitation-related projects, this study analyzes 18 months of drop size distribution (DSD) observations from six collocated disdrometers deployed at the ARM Southern Great Plains (SGP) site. Emphasis is placed on quantifying the uncertainties related to DSD and rainfall properties using different types of disdrometers and different pairing concepts. The instrument sampling errors are also discussed, which improves our understanding of instrument-specific impacts on rainfall measurements. The key findings are as follows: 1) All the disdrometers show consistent behaviors overall regarding accumulated precipitation, mean rainfall rate, DSD parameters, and radar reflectivity values; and 2) Strong agreement is shown between three disdrometer types in terms of their DSDs for mid-size drop range (D = 1 mm-4 mm). The two-dimensional video disdrometer performance meets expectations as the most accurate unit among all. The paired disdrometer shows a reduced statistical sampling error in terms of drop counts and other DSD properties. A concept of deploying two or more collocated disdrometers side by side is recommended for future ARM field campaigns.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Enabling phase quantification of anhydrous cements via Raman imaging

The phase composition of Portland cements is typically determined using conventional techniques like X-ray Diffraction (XRD) Rietveld analysis, optical microscopy point counting, and electron microscopy. However, these techniques have several limitations that may affect their accuracy in certain sample-specific scenarios. Here, we report a highly accurate phase quantification of 11 different types of commercial, anhydrous cements using a new and complementary technique: Raman imaging. Specifically, for the 4 principal phases, composition from our extensive data (250,000 Raman spectra per sample, error < 0.71%) and those obtained from XRD Rietveld and supplier data have high coefficients of determination (R{sup 2} > 0.98, mean deviation <2%). Additionally, we also quantify 8 secondary phases present in cement clinkers (gypsum, anhydrite, bassanite, syngenite, dolomite, calcite, quartz, and portlandite) with a high degree of confidence, thereby demonstrating that Raman imaging is a highly versatile tool for anhydrous phase quantification in a broad variety of cements.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Flow-based likelihoods for non-Gaussian inference

We investigate the use of data-driven likelihoods to bypass a key assumption made in many scientific analyses, which is that the true likelihood of the data is Gaussian. In particular, we suggest using the optimization targets of flow-based generative models, a class of models that can capture complex distributions by transforming a simple base distribution through layers of nonlinearities. We call these flow-based likelihoods (FBL). We analyze the accuracy and precision of the reconstructed likelihoods on mock Gaussian data, and show that simply gauging the quality of samples drawn from the trained model is not a sufficient indicator that the true likelihood has been learned. We nevertheless demonstrate that the likelihood can be reconstructed to a precision equal to that of sampling error due to a finite sample size. We then apply FBLs to mock weak lensing convergence power spectra, a cosmological observable that is significantly non-Gaussian (NG). We find that the FBL captures the NG signatures in the data extremely well, while other commonly used data-driven likelihoods, such as Gaussian mixture models and independent component analysis, fail to do so. This suggests that works that have found small posterior shifts in NG data with data-driven likelihoods such as these could be underestimating the impact of non-Gaussianity in parameter constraints. By introducing a suite of tests that can capture different levels of NG in the data, we show that the success or failure of traditional data-driven likelihoods can be tied back to the structure of the NG in the data. Here, unlike other methods, the flexibility of the FBL makes it successful at tackling different types of NG simultaneously. Because of this, and consequently their likely applicability across datasets and domains, we encourage their use for inference when sufficient mock data are available for training.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Propagating sample variance uncertainties in redshift calibration: simulations, theory, and application to the COSMOS2015 data

ABSTRACT Cosmological analyses of galaxy surveys rely on knowledge of the redshift distribution of their galaxy sample. This is usually derived from a spectroscopic and/or many-band photometric calibrator survey of a small patch of sky. The uncertainties in the redshift distribution of the calibrator sample include a contribution from shot noise, or Poisson sampling errors, but, given the small volume they probe, they are dominated by sample variance introduced by large-scale structures. Redshift uncertainties have been shown to constitute one of the leading contributions to systematic uncertainties in cosmological inferences from weak lensing and galaxy clustering, and hence they must be propagated through the analyses. In this work, we study the effects of sample variance on small-area redshift surveys, from theory to simulations to the COSMOS2015 data set. We present a three-step Dirichlet method of resampling a given survey-based redshift calibration distribution to enable the propagation of both shot noise and sample variance uncertainties. The method can accommodate different levels of prior confidence on different redshift sources. This method can be applied to any calibration sample with known redshifts and phenotypes (i.e. cells in a self-organizing map, or some other way of discretizing photometric space), and provides a simple way of propagating prior redshift uncertainties into cosmological analyses. As a worked example, we apply the full scheme to the COSMOS2015 data set, for which we also present a new, principled SOM algorithm designed to handle noisy photometric data. We make available a catalogue of the resulting resamplings of the COSMOS2015 galaxies.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Direct determination of cellulosic glucan content in starch-containing samples

A simple and highly selective analytical procedure is presented for the determination of cellulosic glucan content in samples that contain both cellulose and starch. This method eliminates the unacceptably large compounding errors of current two-measurement methods. If both starch and cellulose are present before analytical hydrolysis, both will be hydrolyzed to glucose causing bias and inaccuracy in the method. To prevent this interference, the removal of starch prior to cellulosic quantification is crucial. The method presented here is a concise in-series procedure with minimal measurements, eliminating large compounding errors. Sample preparation consists of a starch extraction employing enzymatic hydrolysis followed by a simple filtration and wash. The samples are then subjected to a two-stage acid hydrolysis. The concentration of glucose is determined by ion exchange high-performance liquid chromatography with a Pb 2+ column and a refractive index detector. The cellulosic glucan content is calculated based on the initial dry weight of the starting material. Data for the native biomass materials studied show excellent reproducibility, with coefficients of variance of 3.0% or less associated with the method. This selectivity for cellulosic glucan by the procedure was validated with several analytical techniques such as liquid chromatography coupled with mass spectrometry (LC–MS), Raman spectroscopy, and nuclear magnetic resonance.

09 BIOMASS FUELS↗
DOE OSTI2025

LTAU-FF: Loss Trajectory Analysis for Uncertainty in atomistic Force Fields

Model ensembles are effective tools for estimating prediction uncertainty in deep learning atomistic force fields. However, their widespread adoption is hindered by high computational costs and overconfident error estimates. In this work, we address these challenges by leveraging distributions of per-sample errors obtained during training and employing a distance-based similarity search in the model latent space. Our method, which we call LTAU (Loss Trajectory Analysis for Uncertainty), efficiently estimates the full probability distribution function of errors for any test point using the logged training errors, achieving speeds that are 2–3 orders of magnitudes faster than typical ensemble methods and allowing it to be used for tasks where training or evaluating multiple models would be infeasible. We apply LTAU towards estimating parametric uncertainty in atomistic force fields (LTAU-FF), demonstrating that it produces well-calibrated confidence intervals and predicts errors that correlate strongly with the true errors for data near the training domain. Furthermore, we show that the errors predicted by LTAU-FF can be used in practical applications for detecting out-of-domain data, tuning model performance, and predicting failure during simulations. We believe that LTAU will be a valuable tool for uncertainty quantification in atomistic force fields and is a promising method that should be further explored in other domains of machine learning.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Benchmark calculations of radiative forcing by greenhouse gases

Changes in concentrations of greenhouse gases lead to changes in radiative fluxes throughout the atmosphere. The value of this change, the instantaneous radiative forcing, varies across climate models, due partly to differences in the distribution of clouds, humidity, and temperature across models, and partly due to errors introduced by approximate treatments of radiative transfer. This paper describes an experiment within the Radiative Forcing Model Intercomparision Project that uses benchmark calculations made with line–by–line models to identify parameterization error in the representation of absorption and emission by greenhouse gases. Clear–sky instantaneous forcing by greenhouse gases is computed using a set of 100 profiles, selected from a re–analysis of present–day conditions, that represent the global annual mean forcing from pre–industrial times to the present–day with sampling errors of less than 0.01 W m –2 . Six contributing line–by–line models agree in their estimate of this forcing to within 0.025 W m –2 while even recently–developed parameterizations have typical errors four or more times larger, suggesting both that the samples reveal true differences among line–by–line models and that parameterization error will be readily identifiable. Agreement among line–by–line models is better in the longwave than in the shortwave where differing treatments of the water vapor vapor continuum affect estimates of forcing by carbon dioxide and methane. The impacts of clouds on instantaneous radiative forcing are estimated from climate model simulations. Here, the adjustment due to stratospheric temperature change by assuming fixed dynamical heating. Adjustments are large only for ozone and for carbon dioxide, for which stratospheric cooling introduces modest non–linearity.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Idealized simulation study of the relationship of disdrometer sampling statistics with the precision of precipitation rate measurement

Due to the discretized nature of rain, the measurement of a continuous precipitation rate by disdrometers is subject to statistical sampling errors. Here, Monte Carlo simulations are employed to obtain the precision of rain detection and rate as a function of disdrometer collection area and compared with World Meteorological Organization guidelines for a 1 min sample interval and 95 % probability. To meet these requirements, simulations suggest that measurements of light rain with rain rates R ≤ 0.50 mm h-1 require a collection area of at least 6 cm × 6 cm, and for R = 1 mm h -1 , the minimum collection area is 13 cm × 13 cm. For R = 0.01 mm h -1 , a collection area of 2 cm × 2 cm is sufficient to detect a single drop. Simulations are compared with field measurements using a new hotplate device, the Differential Emissivity Imaging Disdrometer. The field results suggest an even larger plate may be required to meet the stated accuracy, likely in part due to non-Poissonian hydrometeor clustering.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.

11 physics-informed neural networks↗
DOE OSTI2026

Adaptive Sampling-Based Bi-Fidelity Stochastic Trust Region Method for Stochastic Derivative-Free Optimization

Bi-fidelity stochastic optimization has gained increasing attention as an efficient approach to reduce computational costs by leveraging a low-fidelity (LF) model to optimize an expensive high-fidelity (HF) objective. In this paper, we propose ASTRO-BFDF, an adaptive sampling trust-region method specifically designed for unconstrained bi-fidelity stochastic derivative-free optimization problems. In ASTRO-BFDF, the LF function serves two purposes: (i) to identify better iterates for the HF function when the optimization process indicates a high correlation between them and (ii) to reduce the variance of the HF function estimates using bi-fidelity Monte Carlo (BFMC). The algorithm dynamically determines sample sizes while adaptively choosing between crude Monte Carlo and BFMC to balance the trade-off between optimization and sampling errors. We prove that the iterates generated by ASTRO-BFDF converge to a first-order stationary point almost surely. Additionally, we demonstrate the effectiveness of the proposed algorithm through numerical experiments on synthetic benchmarks and simulation optimization problems involving discrete event systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Permutationally Invariant Polynomial Expansions with Unrestricted Complexity

A general strategy is presented for constructing and validating permutationally invariant polynomial (PIP) expansions for chemical systems of any stoichiometry. Demonstrations are made for three categories of gas-phase dynamics and kinetics: collisional energy-transfer trajectories for predicting pressure-dependent kinetics, three-body collisions for describing transient van der Waals adducts relevant to atmospheric chemistry, and nonthermal reactivity via quasiclassical trajectories. In total, 30 systems are considered with up to 15 atoms and 39 degrees of freedom. Permutational invariance is enforced in PIP expansions with as many as 13 million terms and 13 permutationally distinct atom types by taking advantage of petascale computational resources. The quality of the PIP expansions is demonstrated through the systematic convergence of in-sample and out-of-sample errors with respect to both the number of training data and the order of the expansion, and these errors are shown to predict errors in the dynamics for both reactive and nonreactive applications. Here, the parallelized code distributed as part of this work enables the automation of PIP generation for complex systems with multiple channels and flexible user-defined symmetry constraints and for automatically removing unphysical unconnected terms from the basis set expansions, all of which are required for simulating complex reactive systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Comparison of Conventional and Constrained Variational Methods for Computing Large-Scale Budgets and Forcing Fields

Analyses of atmospheric heat and moisture budgets serve as an effective tool to study convective characteristics over a region and to provide large-scale forcing fields for various modeling applications. This paper examines two popular methods for computing large-scale atmospheric budgets: the conventional budget method (CBM) using objectively gridded analyses based primarily on radiosonde data and the constrained variational analysis (CVA) approach which supplements vertical profiles of atmospheric fields with measurements at the top of the atmosphere and at the surface to conserve mass, water, energy, and momentum. Successful budget computations are dependent on accurate sampling and analyses of the thermodynamic state of the atmosphere and the divergence field associated with convection and the large-scale circulation that influences it. Utilizing analyses generated from data taken during Dynamics of the Madden-Julian Oscillation (DYNAMO) field campaign conducted over the central Indian Ocean from October to December 2011, we evaluate the merits of these budget approaches and examine their limitations. While many of the shortcomings of the CBM, in particular effects of sampling errors in sounding data, are effectively minimized with CVA, accurate large-scale diagnostics in CVA are dependent on reliable background fields and rainfall constraints. Finally, for the DYNAMO analyses examined, the operational model fields used as the CVA background state provided wind fields that accurately resolved the vertical structure of convection in the vicinity of Gan Island. However, biases in the model thermodynamic fields were somewhat amplified in CVA resulting in a convective environment much weaker than observed.

54 ENVIRONMENTAL SCIENCES↗