Search NASA⌕ Search

SEARCH · Search NASA

Results for “Sampling error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Skylab water balance error analysis

Estimates of the precision of the net water balance were obtained for the entire Skylab preflight and inflight phases as well as for the first two weeks of flight. Quantitative estimates of both total sampling errors and instrumentation errors were obtained. It was shown that measurement error is minimal in comparison to biological variability and little can be gained from improvement in analytical accuracy. In addition, a propagation of error analysis demonstrated that total water balance error could be accounted for almost entirely by the errors associated with body mass changes. Errors due to interaction between terms in the water balance equation (covariances) represented less than 10% of the total error. Overall, the analysis provides evidence that daily measurements of body water changes obtained from the indirect balance technique are reasonable, precise, and relaible. The method is not biased toward net retention or loss.

Leonard, J. I.↗

Recent Cooling of the Upper Ocean

We observe a net loss of 3.2 (+/- 1.1) x 1022 J of heat from the upper ocean between 2003 and 2005. Using a broad array of in situ ocean measurements, we present annual estimates of global upper-ocean heat content anomaly from 1993 through 2005. Including the recent downturn, the average warming rate for the entire 13-year period is 0.33 +/- 0.23 W/m2 (of the Earth's total surface area). A new estimate of sampling error in the heat content record suggests that both the recent and previous global cooling events are significant and unlikely to be artifacts of inadequate ocean sampling.

global cooling↗

The effect of numbers of noise events on people's reactions to noise - An analysis of existing survey data

Even though there are surveys in which annoyance decreases as the number of events increases above about 150 a day, the available evidence is not considered strong enough to reject the conventional assumption that reactions are related to the logarithm of the number of events. The data do not make it possible to reject the conventional assumption that the effects of the number of events and the peak noise level are additive. It is found that even when equivalent questionnaire items and definitions of noise events could be used, differences between the surveys' estimates of the effect of the number of events remained large. Three explanations are suggested for inconsistent estimates. The first has to do with errors in specifying the values of noise parameters, the second with the effects of unmeasured acoustical and area characteristics that are correlated with noise level or number, and the third with large sampling errors deriving from community differences in response to noise. It is concluded that significant advances in the knowledge about the effects of the number of noise events can be made only if surveys include large numbers of study areas.

Fields, J. M.↗

Idealized simulation study of the relationship of disdrometer sampling statistics with the precision of precipitation rate measurement

Due to the discretized nature of rain, the measurement of a continuous precipitation rate by disdrometers is subject to statistical sampling errors. Here, Monte Carlo simulations are employed to obtain the precision of rain detection and rate as a function of disdrometer collection area and compared with World Meteorological Organization guidelines for a 1 min sample interval and 95 % probability. To meet these requirements, simulations suggest that measurements of light rain with rain rates R ≤ 0.50 mm h-1 require a collection area of at least 6 cm × 6 cm, and for R = 1 mm h -1 , the minimum collection area is 13 cm × 13 cm. For R = 0.01 mm h -1 , a collection area of 2 cm × 2 cm is sufficient to detect a single drop. Simulations are compared with field measurements using a new hotplate device, the Differential Emissivity Imaging Disdrometer. The field results suggest an even larger plate may be required to meet the stated accuracy, likely in part due to non-Poissonian hydrometeor clustering.

54 ENVIRONMENTAL SCIENCES↗

Analysis of the Continuous Stellar Tracking Attitude Reference (CSTAR) attitude rate processor

The Continuous Stellar Tracking Attitude Reference (CSTAR) system is an in-house project for Space Station to provide high accuracy, drift free attitude and angular rate information for the GN&C system. The outputs of the solid state star trackers are processed to provide attitude information; rate data is then derived from the attitude. Rate derivation is based on discrete time polynomial approximation techniques. This gives simple algorithms which allow for interpolation by other users. Attitude rate is modeled as a constant with low amplitude, low frequency sinusoids superimposed. The rate processor is parameterized to account for the effects of random errors, sample rate, data processing rate and perturbation frequency. The baseline system may be characterized as follows: the three sigma attitude accuracy is 0.01 degrees, the three sigma rate accuracy is 0.0001 degrees per second, the sample rate is 100 Hertz, the sampled signal is bandlimited to 0.5 Hertz, and the data processing rate is 10 Hertz. The above system requires a differentiator of length 127. This will track rate perturbations of frequencies less than 0.01 Hertz with low systematic errors.

Uhde-Lacovara, J.↗

Radiative properties of Cirrus clouds: FIRE IFO case October 28, 1986

A description of the radiative properties of two cirrus clouds sampled on 10/28/88 in the FIRE cirrus IFO is presented. The clouds are characterized in terms of the broadband infrared effective emittance, cloud fractional absorptance, shortwave heating rate, cloud albedo and vertical velocity. The broadband fluxes used in these calculations were obtained from measurements made by pyranometers and pyrgeometers. The shortwave irradiances were corrected to a horizontal plane and normalized to the same time by taking into account Sabreliner flight information (i.e., pitch, roll, heading and angle of attack), as well as sun-earth geometry considerations. Since only one aircraft was used, broadband fluxes at different levels in the cloud were not measured simultaneously. As a result, sampling errors may occur due to the nonsteady state of the cloud field or due to the possibility that the flight legs were not flown directly above or below each other. To minimize these errors and to simplify the analysis, the necessary variables were averaged and the averages used in the calculations. The downwelling shortwave and longwave irradiances were used as selection criteria to remove cloud free data encountered along the data sampling leg.

Hein, Paul F.↗

Artificial neural network implementation of a near-ideal error prediction controller

A theory has been developed at the University of Virginia which explains the effects of including an ideal predictor in the forward loop of a linear error-sampled system. It has been shown that the presence of this ideal predictor tends to stabilize the class of systems considered. A prediction controller is merely a system which anticipates a signal or part of a signal before it actually occurs. It is understood that an exact prediction controller is physically unrealizable. However, in systems where the input tends to be repetitive or limited, (i.e., not random) near ideal prediction is possible. In order for the controller to act as a stability compensator, the predictor must be designed in a way that allows it to learn the expected error response of the system. In this way, an unstable system will become stable by including the predicted error in the system transfer function. Previous and current prediction controller include pattern recognition developments and fast-time simulation which are applicable to the analysis of linear sampled data type systems. The use of pattern recognition techniques, along with a template matching scheme, has been proposed as one realizable type of near-ideal prediction. Since many, if not most, systems are repeatedly subjected to similar inputs, it was proposed that an adaptive mechanism be used to 'learn' the correct predicted error response. Once the system has learned the response of all the expected inputs, it is necessary only to recognize the type of input with a template matching mechanism and then to use the correct predicted error to drive the system. Suggested here is an alternate approach to the realization of a near-ideal error prediction controller, one designed using Neural Networks. Neural Networks are good at recognizing patterns such as system responses, and the back-propagation architecture makes use of a template matching scheme. In using this type of error prediction, it is assumed that the system error responses be known for a particular input and modeled plant. These responses are used in the error prediction controller. An analysis was done on the general dynamic behavior that results from including a digital error predictor in a control loop and these were compared to those including the near-ideal Neural Network error predictor. This analysis was done for a second and third order system.

Mcvey, Eugene S.↗

Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.

11 physics-informed neural networks↗

Estimation of the global average temperature with optimally weighted point gauges

This paper considers the minimum mean squared error (MSE) incurred in estimating an idealized Earth's global average temperature with a finite network of point gauges located over the globe. We follow the spectral MSE formalism given by North et al. (1992) and derive the optimal weights for N gauges in the problem of estimating the Earth's global average temperature. Our results suggest that for commonly used configurations the variance of the estimate due to sampling error can be reduced by as much as 50%.

Hardin, James W.↗

Interannual variability and predictability of 500 mb geopotential heights over the Northern Hemisphere

The interannual variability of monthly mean 500 mb heights in a 15-year sample of observed data is compared to the variance expected from sampling errors associated with high-frequency fluctuations using the analysis of variance approach. The monthly mean 'signal' stands out significantly from the 'noise' over a substantial fraction of the Northern Hemisphere during the winter. The expected spectrum of variance at very low frequencies is assumed to be white at frequencies lower than per (30 days) rather than the per (96 days) cutoff used by Madden. This difference is justified by observing that the effective time between independent samples T(0) is relatively insensitive to changes in the maximum lag over which the local autocorrelation is integrated to calculate T(0). Further non-randomness in the variance of 500 mb heights is evidenced by the correlation between monthly mean height and contemporaneous daily variability.

Shukla, J.↗

Dynamically stratified Monte Carlo forecasting

A new method for performing Monte Carlo forecasts is introduced. The method, called dynamic stratification, selects initial perturbations based on a stratification of the error distribution. A simple implementation is presented in which the error distribution used for the stratification is estimated from a linear model derived from a large ensemble of 12-h forecasts with the full dynamic model. The stratification thus obtained is used to choose a small subsample of initial states with which to perform the dynamical Monte Carlo forecasts. Several test cases are studied using a simple two-level general circulation model with uncertain initial conditions. It is found that the method provides substantial reductions in the sampling error of the forecast mean and variance when compared to the more traditional approach of choosing the initial perturbations at random. The degree of improvement, however, is sensitive to the nature of the initial error distribution and to the base state. In practice the method may be viable only if the computational burden involved in obtaining an adequate estimate of the error distribution is shared with the data-assimilation procedure.

Schubert, Siegfried↗

Adaptive Sampling-Based Bi-Fidelity Stochastic Trust Region Method for Stochastic Derivative-Free Optimization

Bi-fidelity stochastic optimization has gained increasing attention as an efficient approach to reduce computational costs by leveraging a low-fidelity (LF) model to optimize an expensive high-fidelity (HF) objective. In this paper, we propose ASTRO-BFDF, an adaptive sampling trust-region method specifically designed for unconstrained bi-fidelity stochastic derivative-free optimization problems. In ASTRO-BFDF, the LF function serves two purposes: (i) to identify better iterates for the HF function when the optimization process indicates a high correlation between them and (ii) to reduce the variance of the HF function estimates using bi-fidelity Monte Carlo (BFMC). The algorithm dynamically determines sample sizes while adaptively choosing between crude Monte Carlo and BFMC to balance the trade-off between optimization and sampling errors. We prove that the iterates generated by ASTRO-BFDF converge to a first-order stationary point almost surely. Additionally, we demonstrate the effectiveness of the proposed algorithm through numerical experiments on synthetic benchmarks and simulation optimization problems involving discrete event systems.

97 MATHEMATICS AND COMPUTING↗

Permutationally Invariant Polynomial Expansions with Unrestricted Complexity

A general strategy is presented for constructing and validating permutationally invariant polynomial (PIP) expansions for chemical systems of any stoichiometry. Demonstrations are made for three categories of gas-phase dynamics and kinetics: collisional energy-transfer trajectories for predicting pressure-dependent kinetics, three-body collisions for describing transient van der Waals adducts relevant to atmospheric chemistry, and nonthermal reactivity via quasiclassical trajectories. In total, 30 systems are considered with up to 15 atoms and 39 degrees of freedom. Permutational invariance is enforced in PIP expansions with as many as 13 million terms and 13 permutationally distinct atom types by taking advantage of petascale computational resources. The quality of the PIP expansions is demonstrated through the systematic convergence of in-sample and out-of-sample errors with respect to both the number of training data and the order of the expansion, and these errors are shown to predict errors in the dynamics for both reactive and nonreactive applications. Here, the parallelized code distributed as part of this work enables the automation of PIP generation for complex systems with multiple channels and flexible user-defined symmetry constraints and for automatically removing unphysical unconnected terms from the basis set expansions, all of which are required for simulating complex reactive systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Comparison of Conventional and Constrained Variational Methods for Computing Large-Scale Budgets and Forcing Fields

Analyses of atmospheric heat and moisture budgets serve as an effective tool to study convective characteristics over a region and to provide large-scale forcing fields for various modeling applications. This paper examines two popular methods for computing large-scale atmospheric budgets: the conventional budget method (CBM) using objectively gridded analyses based primarily on radiosonde data and the constrained variational analysis (CVA) approach which supplements vertical profiles of atmospheric fields with measurements at the top of the atmosphere and at the surface to conserve mass, water, energy, and momentum. Successful budget computations are dependent on accurate sampling and analyses of the thermodynamic state of the atmosphere and the divergence field associated with convection and the large-scale circulation that influences it. Utilizing analyses generated from data taken during Dynamics of the Madden-Julian Oscillation (DYNAMO) field campaign conducted over the central Indian Ocean from October to December 2011, we evaluate the merits of these budget approaches and examine their limitations. While many of the shortcomings of the CBM, in particular effects of sampling errors in sounding data, are effectively minimized with CVA, accurate large-scale diagnostics in CVA are dependent on reliable background fields and rainfall constraints. Finally, for the DYNAMO analyses examined, the operational model fields used as the CVA background state provided wind fields that accurately resolved the vertical structure of convection in the vicinity of Gan Island. However, biases in the model thermodynamic fields were somewhat amplified in CVA resulting in a convective environment much weaker than observed.

54 ENVIRONMENTAL SCIENCES↗

Estimating the Likelihood of GHG Concentration Scenarios From Probabilistic Integrated Assessment Model Simulations

The climate scenarios that form the basis for current climate risk assessments have no assigned probabilities, and this impedes the analysis of future climate risks. This paper proposes an approach to estimate the probability of carbon dioxide (CO 2 ) concentration scenarios used in key climate change modeling experiments. It computes the CO 2 emissions compatible with the concentrations prescribed by Coupled Model Intercomparison Project Phase 5 (CMIP5) and CMIP6 experiments. The distribution of these compatible cumulative emissions is interpreted as the likelihood of future emissions given a concentration pathway. Using Bayesian analysis, the probability of each pathway can be estimated from a probabilistic sample of future emissions. The approach is demonstrated with five probabilistic CO 2 emission simulation ensembles from four Integrated Assessment Models (IAM), leading to independent estimates of the likelihood of the CO 2 concentration of Representative Concentration Pathways (RCP) and Shared Socioeconomic Pathways (SSP). Results suggest that SSP5-8.5 is unlikely for the second half of the 21st century, but offer no clear consensus on which of the remaining scenarios is most likely. Estimates of likelihoods of CO 2 concentrations associated with RCP and SSP scenarios are affected by sampling errors, differences in emission sources simulated by the IAMs, and a lack of a common experimental framework for IAM simulations. These shortcomings, along with a small IAM ensemble size, limit the applicability of the results presented here. Novel joint IAM and the Earth System Model experiments are needed to deliver actionable probabilistic climate risk assessments.

54 ENVIRONMENTAL SCIENCES↗

Quantifying and Visualizing Uncertainty for Source Localisation in Electrocardiographic Imaging

Electrocardiographic imaging (ECGI) presents a clinical opportunity to noninvasively understand the sources of arrhythmias for individual patients. To help increase the effectiveness of ECGI, we provide new ways to visualise associated measurement and modelling errors. Here, we study source localisation uncertainty in two steps: First, we perform Monte Carlo simulations of a simple inverse ECGI source localisation model with error sampling to understand the variations in ECGI solutions. Second, we present multiple visualisation techniques, including confidence maps, level-sets, and topology-based visualisations, to better understand uncertainty in source localization. Our approach offers a new way to study uncertainty in the ECGI pipeline.

47 OTHER INSTRUMENTATION↗

Benchmarking Optimizers for Qumode State Preparation with Variational Quantum Algorithms

Quantum state preparation involves preparing a target state from an initial system, a process integral to applications such as quantum machine learning and solving systems of linear equations. Recently, there has been a growing interest in qumodes due to advancements in the field and their potential applications. However there is a notable gap in the literature specifically addressing this area. This paper aims to bridge this gap by providing performance benchmarks of various optimizers used in state preparation with Variational Quantum Algorithms. We conducted extensive testing across multiple scenarios, including different target states, both ideal and sampling simulations, and varying numbers of basis gate layers. Our evaluations offer insights into the complexity of learning each type of target state and demonstrate that some optimizers perform better than others in this context. Notably, the Powell optimizer was found to be exceptionally robust against sampling errors, making it a preferred choice in scenarios prone to such inaccuracies. Additionally, the Simultaneous Perturbation Stochastic Approximation optimizer was distinguished for its efficiency and ability to handle increased parameter dimensionality effectively.

Kan, Shuwen [Fordham University]↗

Incorporation of aerosol into the COSPv2 satellite lidar simulator for climate model evaluation

Abstract. Atmospheric aerosol has substantial impacts on climate, air quality and biogeochemical cycles, and its concentrations are highly variable in space and time. A key variability to evaluate within models that simulate aerosol is the vertical distribution, which influences atmospheric heating profiles and aerosol–cloud interactions, to help constrain aerosol residence time and to better represent the magnitude of simulated impacts. To ensure a consistent comparison between modeled and observed vertical distribution of aerosol, we implemented an aerosol lidar simulator within the Cloud Feedback Model Intercomparison Project (CFMIP) Observation Simulator Package version 2 (COSPv2). We assessed the attenuated total backscattered (ATB) signal and the backscatter ratios (SRs) at 532 nm in the U.S. Department of Energy's Energy Exascale Earth System Model version 1 (E3SMv1). The simulator performs the computations at the same vertical resolution as the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), making use of aerosol optics from the E3SMv1 model as inputs and assuming that aerosol is uniformly distributed horizontally within each model grid box. The simulator applies a cloud masking and an aerosol detection threshold to obtain the ATB and SR profiles that would be observed above clouds by CALIOP with its aerosol detection capability. Our analysis shows that the aerosol distribution simulated at a seasonal timescale is generally in good agreement with observations. Over the Southern Ocean, however, the model does not produce the SR maximum as observed in the real world. Comparison between clear-sky and all-sky SRs shows little differences, indicating that the cloud screening by potentially incorrect model clouds does not affect the mean aerosol signal averaged over a season. This indicates that the differences between observed and simulated SR values are due not to sampling errors, but to deficiencies in the representation of aerosol in models. Finally, we highlight the need for future applications of lidar observations at multiple wavelengths to provide insights into aerosol properties and distribution and their representation in Earth system models.

54 ENVIRONMENTAL SCIENCES↗