Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

Stokhos v 1.0

A Trilinos package for applying stochastic Galerkin uncertainty quantification methods to large-scale C++ application codes, primarily stochastic partial differential equations. Stokhos is intended for use in estimating uncertainties for general scientific computations and is based on published algorithms. It provides no capability for implementing those computations itself. Estimating uncertainties and errors from solution algorithms or simulations, primarily simulations of partial differential equations, arising from uncertainties or errors in solution algorithm or simulation input data, including statistical moments, probabilities, and coefficients of variation.

Source record↗

CV4Quantum

CV4Quantum is a statistical technique for reducing the sampling overhead in probabilistic error cancellation, which is an error mitigation technique used in quantum computing. CV4Quantum is based on the control variates method, which is a Monte Carlo variance reduction technique. This repository contains the code and data associated with a demonstration of CV4Quantum using simulation experiments.

Shyamsundar, Prasanth [Fermi National Accelerator ↗

Data Assimilation - Advances and Applications

This presentation provides an overview of data assimilation (model calibration) for complex computer experiments. Calibration refers to the process of probabilistically constraining uncertain physics/engineering model inputs to be consistent with observed experimental data. An initial probability distribution for these parameters is updated using the experimental information. Utilization of surrogate models and empirical adjustment for model form error in code calibration form the basis for the statistical methodology considered. The role of probabilistic code calibration in supporting code validation is discussed. Incorporation of model form uncertainty in rigorous uncertainty quantification (UQ) analyses is also addressed. Design criteria used within a batch sequential design algorithm are introduced for efficiently achieving predictive maturity and improved code calibration. Predictive maturity refers to obtaining stable predictive inference with calibrated computer codes. These approaches allow for augmentation of initial experiment designs for collecting new physical data. A standard framework for data assimilation is presented and techniques for updating the posterior distribution of the state variables based on particle filtering and the ensemble Kalman filter are introduced.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Scalable, In-situ Data Clustering Data Analysis for Extreme Scale Scientific Computing (Final Report)

The objective of this project is to address challenges in the design and development of scalable in-situ data clustering and analytics algorithms and software. Our goal is to develop parallel software consisting of a set of spatio-temporal data clustering and anomaly detection functions, both of which are very important for large-scale analysis and have wide applicability for in-situ runs as well as post-processing analysis. Our design principles for in-situ analysis consider the following: (1) identify parts of the computation can be done close to the data within the nodes, while it is still in memory; (2) extract analysis components can (and should) be performed in remote staging and analysis nodes; (3) develop error-bound approximation methods for applications tolerable for small errors; (4) identify the type of derived distributions and statistics, for spatio-temporal data, that can be kept locally in order to both accelerate computations and meet energy constraints in subsequent iterations and phases; (5) use a self-describing data format so that data can be consistent and understood among local storage (memory and SSDs) and at staging and analysis nodes, thereby providing portability and flexibility; (6) develop service-oriented functions that can schedule in-situ and post-hoc analysis tasks based on the dynamic requirements of applications. Our development focus is to produce the parallel data analysis software/library that will be scalable, reusable, extensible, and generic for applications in different disciplines. The software will be able to run in-situ with the simulations as well as post-hoc analysis. This approach will satisfy many synergistic requirements for data intensive applications executed on data coming from instruments and experiments. In particular, the proposed multilevel approach is directly applicable to perform design tradeoffs for running part of the algorithms near the instruments and the rest on remote (analysis) systems.

97 MATHEMATICS AND COMPUTING↗

Implementing machine learning methods on QICK hardware for qubit readout & control

Quantum readout and control is a fundamental aspect of quantum computing that requires accurate measurement of qubit states. Errors emerge in all stages, from initialization to readout, and identifying errors in post-processing necessitates resource-intensive statistical analysis. In our work, we use a lightweight fully-connected neural network (NN) to classify states of a transmon system with no prior processing. Our NN accelerator yields higher fidelities (92%) than the classical matched filter method (84%). By exploiting the natural parallelism of NNs and their placement near the source of data on field-programmable gate arrays (FPGAs), we can achieve ultra-low latency on the Quantum Instrumentation Control Kit (QICK). Integrating machine learning methods on QICK opens several pathways for efficient real-time processing of quantum circuits.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A collection of sub-daily pressure and temperature observations for the early instrumental period with a focus on the "year without a summer" 1816

The eruption of Mount Tambora (Indonesia) in April 1815 is the largest documented volcanic eruption in history. It is associated with a large global cooling during the following year, felt particularly in parts of Europe and North America, where the year 1816 became known as the "year without a summer". This paper describes an effort made to collect surface meteorological observations from the early instrumental period, with a focus on the years of and immediately following the eruption (1815–1817). Although the collection aimed in particular at pressure observations, correspondent temperature observations were also recovered. Some of the series had already been described in the literature, but a large part of the data, recently digitised from original weather diaries and contemporary magazines and newspapers, is presented here for the first time. The collection puts together more than 50 sub-daily series from land observatories in Europe and North America and from ships in the tropics. The pressure observations have been corrected for temperature and gravity and reduced to mean sea level. Moreover, an additional statistical correction was applied to take into account common error sources in mercury barometers. To assess the reliability of the corrected data set, the variance in the pressure observations is compared with modern climatologies, and single observations are used for synoptic analyses of three case studies in Europe. All raw observations will be made available to the scientific community in the International Surface Pressure Databank.

54 ENVIRONMENTAL SCIENCES↗

Some after-dinner reflections on system identification

The growth of the field of system identification is discussed along with changes in methodology which have taken place in recent years. The similarity between pattern recognition and system identification is pointed out, involving the modelling in the latter and the feature selection problem in the former. It is stated that once a model is formulated, including the disturbances and measurement errors, the parameter finding can be formulated as a statistical estimation problem. The various techniques and their application are discussed.

Balakrishnan, A. V.↗

The effects of transmitter/receiver clock time base instability on coherent communication system performance

The purpose of this paper is to present a model and associated analysis of the deleterious effects which both transmitter and receiver data clock time-base instability have on bit error probability. The types of time-base instability modeled and analyzed include bit jitter (epoch jitter), bit jitter rate (time interval jitter) and data asymmetry. The bit error probability is determined as a function of the statistical characteristics of the time-base instability, the data transition density, the signal-to-noise ratio in the bit rate bandwidth and the mechanizations of both the data bit detector and bit synchronizer. Numerical results are provided.

Chie, C. M.↗

Precision of the calibration of the AXAF engineering test article (VETA) mirrors

Measurements of the VETA encircled energies have been performed at 5 energies within 16 radii ranging from 0.05 to 200 arcseconds. We report here on the analysis of the accuracy of those measurements. A common 'error tree' structure applies, and we present representative numbers for the larger terms. At 0.277, 1.5, and 2.07 keV, and for radii of 3 arcsec and larger, our measurements have estimated 1 sigma errors of 0.6 to 1.5 percent. Effects of measurement statistics and of the VETA test mount limit the accuracy at smaller angles, and modulation by the counter window support structure together with the imperfect position repeatability limit the accuracy for the 0.93 and 2.3 keV energies. We expect to mitigate these limitations when calibrating the complete AXAF flight mirror assembly.

Schwartz, D. A.↗

Precision of the calibration of the AXAF Engineering Test Article (VETA) mirrors

Measurements of the VETA encircled energies have been performed at 5 energies within 16 radii ranging from 0.05 to 200 arcseconds. We report here on the analysis of the accuracy of those measurements. A common 'error tree' structure applies, and we present representative numbers for the larger terms. At 0.277, 1.5, and 2.07 keV, and for radii of 3 arcsec and larger, our measurements have estimated 1 sigma errors of 0.6 to 1.5 percent. Effects of measurement statistics and of the VETA test mount limit the accuracy at smaller angles, and modulation by the counter window support structure together with the imperfect position repeatability limit the accuracy for the 0.93 and 2.3 keV energies. We expect to mitigate these limitations when calibrating the complete AXAF flight mirror assembly.

Schwartz, D. A.↗

Experimental analysis of thread movement in bolted connections due to vibrations

The objective of this study was to identify the main design parameters contributing to loosening of bolts due to vibration and to identify their relative importance and degree of contribution to bolt loosening. Vibration testing was conducted on a shaketable with a controlled-random input in the dynamic testing laboratory of the Structural Test Division of MSFC. Test specimens which contained one test bolt were vibrated for a fixed amount of time and percentage of pre-load loss was measured. Each specimen tested implemented some combination of eleven design parameters as dictated by the design of experiment methodology employed. The eleven design parameters were: bolt size (diameter), lubrication on bolt, hole tolerance, initial pre-load, nut locking device, grip length, thread pitch, lubrication between mating materials, class of fit, joint configuration and mass of configuration. These parameters were chosen for this experiment because they are believed to be the design parameters having the greatest impact on bolt loosening. Two values of each design parameter were used and each combination of parameters tested was subjected to two different directions of vibration and two different g-levels of vibration. One replication was made for each test to gain some indication of experimental error and repeatability and to give some degree of statistical credibility to the data, resulting in a total of 96 tests being performed. The results of the investigation indicated that nut locking devices, joint configuration, fastener size, and mass of configuration were significant in bolt loosening due to vibration. The results of this test can be utilized to further research the complex problem of bolt loosening due to vibration.

Ramey, G. ED↗

Experimental analysis of thread movement in bolted connections due to vibrations

This is the final report of research project NAS8-39131 #33 sponsored by NASA's George C. Marshall Space Flight Center (MSFC) and carried out by the Civil Engineering Department of Auburn University (Auburn, Alabama) and personnel of MSFC. The objective of this study was to identify the main design parameters contributing to the loosening of bolts due to vibration and to identify their relative importance and degree of contribution to bolt loosening. Vibration testing was conducted on a shaketable with a controlled-random input in the dynamic testing laboratory of the Structural Test Division of MSFC. Test specimens which contained one test bolt were vibrated for a fixed amount of time and a percentage of pre-load loss was measured. Each specimen tested implemented some combination of eleven design parameters as dictated by the design of experiment methodology employed. The eleven design parameters were: bolt size (diameter), lubrication on bolt, hole tolerance, initial pre-load, nut locking device, grip length, thread pitch, lubrication between mating materials, class of fit, joint configuration, and mass of configuration. These parameters were chosen for this experiment because they are believed to be the design parameters having the greatest impact on bolt loosening. Two values of each design parameter were used and each combination of parameters tested was subjected to two different directions of vibration and two different g-levels of vibration. One replication was made for each test to gain some indication of experimental error and repeatability and to give some degree of statistical credibility to the data, resulting in a total of 96 tests being performed. The results of the investigation indicated that nut locking devices, joint configuration, fastener size, and mass of configuration were significant in bolt loosening due to vibration. The results of this test can be utilized to further research the complex problem of bolt loosening due to vibration.

Ramsey, G. ED↗

Moisture Forecast Bias Correction in GEOS DAS

Data assimilation methods rely on numerous assumptions about the errors involved in measuring and forecasting atmospheric fields. One of the more disturbing of these is that short-term model forecasts are assumed to be unbiased. In case of atmospheric moisture, for example, observational evidence shows that the systematic component of errors in forecasts and analyses is often of the same order of magnitude as the random component. we have implemented a sequential algorithm for estimating forecast moisture bias from rawinsonde data in the Goddard Earth Observing System Data Assimilation System (GEOS DAS). The algorithm is designed to remove the systematic component of analysis errors and can be easily incorporated in an existing statistical data assimilation system. We will present results of initial experiments that show a significant reduction of bias in the GEOS DAS moisture analyses.

Dee, D.↗

Hazard Assessment from Storm Tides and Rainfall on a Tidal River Estuary

Here, we report on methods and results for a model-based flood hazard assessment we have conducted for the Hudson River from New York City to Troy/Albany at the head of tide. Our recent work showed that neglecting freshwater flows leads to underestimation of peak water levels at up-river sites and neglecting stratification (typical with two-dimensional modeling) leads to underestimation all along the Hudson. As a result, we use a three-dimensional hydrodynamic model and merge streamflows and storm tides from tropical and extratropical cyclones (TCs, ETCs), as well as wet extratropical cyclone (WETC) floods (e.g. freshets, rain-on-snow events). We validate the modeled flood levels and quantify error with comparisons to 76 historical events. A Bayesian statistical method is developed for tropical cyclone streamflows using historical data and consisting in the evaluation of (1) the peak discharge and its pdf as a function of TC characteristics, and (2) the temporal trend of the hydrograph as a function of temporal evolution of the cyclone track, its intensity and the response characteristics of the specific basin. A k-nearest-neighbors method is employed to determine the hydrograph shape. Out of sample validation tests demonstrate the effectiveness of the method. Thus, the combined effects of storm surge and runoff produced by tropical cyclones hitting the New York area can be included in flood hazard assessment. Results for the upper Hudson (Albany) suggest a dominance of WETCs, for the lower Hudson (at New York Harbor) a case where ETCs are dominant for shorter return periods and TCs are more important for longer return periods (over 150 years), and for the middle-Hudson (Poughkeepsie) a mix of all three flood events types is important. However, a possible low-bias for TC flood levels is inferred from a lower importance in the assessment results, versus historical event top-20 lists, and this will be further evaluated as these preliminary methods and results are finalized. Future funded work will quantify the influences of sea level rise and flood adaptation plans (e.g. surge barriers). It would also be valuable to examine how streamflows from tropical cyclones and wet cool-season storms will change, as this factor will dominate at upriver locations.

Hazard assessment↗

Introducing Multisensor Satellite Radiance-Based Evaluation for Regional Earth System Modeling

Earth System modeling has become more complex, and its evaluation using satellite data has also become more difficult due to model and data diversity. Therefore, the fundamental methodology of using satellite direct measurements with instrumental simulators should be addressed especially for modeling community members lacking a solid background of radiative transfer and scattering theory. This manuscript introduces principles of multisatellite, multisensor radiance-based evaluation methods for a fully coupled regional Earth System model: NASA-Unified Weather Research and Forecasting (NU-WRF) model. We use a NU-WRF case study simulation over West Africa as an example of evaluating aerosol-cloud-precipitation-land processes with various satellite observations. NU-WRF-simulated geophysical parameters are converted to the satellite-observable raw radiance and backscatter under nearly consistent physics assumptions via the multisensor satellite simulator, the Goddard Satellite Data Simulator Unit. We present varied examples of simple yet robust methods that characterize forecast errors and model physics biases through the spatial and statistical interpretation of various satellite raw signals: infrared brightness temperature (Tb) for surface skin temperature and cloud top temperature, microwave Tb for precipitation ice and surface flooding, and radar and lidar backscatter for aerosol-cloud profiling simultaneously. Because raw satellite signals integrate many sources of geophysical information, we demonstrate user-defined thresholds and a simple statistical process to facilitate evaluations, including the infrared-microwave-based cloud types and lidar/radar-based profile classifications.

Planetary Boundary Layer↗

Estimating Software Reliability for Space Launch Vehicles in Probabilistic Risk Assessment (PRA)

It is acutely recognized in the Probabilistic Risk assessment (PRA) field that software plays a defining role in overall system reliability for all modern systems across a wide variety of industries. Regardless if the software is embedded firmware for working components or elements, part of a Human-Machine-Interface, or automated command and control logic, the success of the software to fulfill its function under nominal and off-nominal environments will be a dominant contributor to system reliability. It is also recognized that software reliability prediction and estimation is one of the more challenging and questionable aspects of any PRA or system analyses due to the nature of software and its integration with physics based systems. Irrespective of this dichotomy, any incorporation of software reliability methods requires that the contributions are accountable, quantitative, and tractable. This paper provides a brief overview of software reliability methods, establishes some minimum requirements that the methods should incorporate for completeness, and provides a logic structure for applying software reliability. Model resolution will be discussed that supports current testing plans and trade studies. We will provide initial recommendations for use in the NASA PRA and present a future dynamic option for software and PRA. Space Launch Vehicle Software is recognized to be reliable in static conditions, yet relatively vulnerable to a set of failure modes in changing environments/flight phases. Two quantitative methods were chosen to incorporate software reliability into a Space Launch Vehicle PRA accounting for phase adjustments. One method predicts latent software failure using statistical methods, and the second provides estimates of coding errors and software operating system failures based on test and historical data, respectively. Software uncertainty will also be discussed. We determined that recommendations for PRA software reliability should be modeled at the software module level where multiple software components compose a module and combinations of the software architecture can lead to a functional failure.

Novack, Steven↗

Estimating Software Reliability for Space Launch Vehicles in Probabilistic Risk Assessment (PRA)

It is acutely recognized in the Probabilistic Risk Assessment (PRA) field that software plays a defining role in overall system reliability for all modern systems across a wide variety of industries. Regardless of whether the software is embedded firmware for working components or elements, part of a Human-Machine-Interface, or automated command and control logic, the success of the software to fulfill its function under nominal and off-nominal environments will be a dominant contributor to system reliability. It is also recognized that software reliability prediction and estimation is one of the more challenging and questionable aspects of any PRA or system analyses due to the nature of software and its integration with physics based systems. Irrespective of this dichotomy, any incorporation of software reliability methods requires that the contributions are accountable, quantitative, and tractable. This paper provides a brief overview of software reliability methods, establishes some minimum requirements that the methods should incorporate for completeness, and provides a logic structure for applying software reliability. Model resolution will be discussed that supports current testing plans and trade studies. We will provide initial recommendations for use in the National Aeronautics and Space Administration (NASA) PRA and present a future dynamic option for software and PRA. Space Launch Vehicle software is recognized to be reliable in static conditions, yet relatively vulnerable to a set of failure modes in changing environments/flight phases. Two quantitative methods were chosen to incorporate software reliability into a Space Launch Vehicle PRA accounting for phase adjustments. One method predicts latent software failure using statistical methods, and the second provides estimates of coding errors and software operating system failures based on test and historical data. Software uncertainty will also be discussed. It is determined that recommendations for PRA software reliability should be modeled at the software module level where multiple software components compose a module and combinations of the software architecture can lead to a functional failure.

Steven D. Novack↗

A Demonstration that Correcting for Completeness and Reliability Is Critical for Robust Occurrence Rates

A measurement of planetary occurrence rates based on a planet catalog should be robust against details of how initial detections were classified as planets or false positives. This is accomplished by supplying the catalog’s rate of missed planets (completeness) and rate of non-planets incorrectly called planets (reliability). The final Kepler data release (DR25) includes products that can be used with the DR25 planet candidate catalog to correct for completeness and reliability in occurrence rate estimates. This is made possible by the Kepler Robovetter, which algorithmically and uniformly selects planets based on a variety of metrics and thresholds. Completeness, reliability, and occurrence rates potentially depend on these Robovetter thresholds. We study the impact of varying these vetting thresholds using the techniques of Bryson et al. 2019 (arXiv:1906.03575). We explore sets of thresholds that result in more or fewer planets (trading off completeness for reliability), as well as thresholds tuned to pass DR25 false positives identified as possible planets by the Kepler False Positive Working Group. We find that when correcting only for completeness, and not reliability, the resulting occurrence rates have a strong dependence on these threshold sets. For example, the value of SAG13 eta-Earth varies by over a factor of 4 when not corrected for reliability. However, when correcting for both completeness and reliability, occurrence rates using our threshold sets are statistically indistinguishable, with differences being well inside 1-sigma error bars. We present occurrence rates integrated over several period-radius ranges. For example, SAG13 eta-Earth is consistent with 0.127 (+0.094)(-0.054) (from Bryson et al. 2019) for all the Robovetter threshold sets. This result emphasizes the importance of correcting occurrence rates for both completeness and reliability. This suggests that inconsistent completeness and reliability correction may be a significant contributor to the large variation of occurrence rates in recent literature. We plan to make the Robovetter results for our threshold sets available, and encourage the community to use them to examine whether other occurrence rate methods yield similarly robust results.

Bryson, S.↗