Search NASA⌕ Search

SEARCH · Search NASA

Results for “errors and uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Navigation Prediction Performance During OSIRIS-REx Proximity Operations at (101955) Bennu

The OSIRIS-REx (Origins, Spectral Interpretation, Resource Identification and Security–Regolith Explorer) Orbit Determination team performed covariance analyses prior to the commencement of proximity operations (ProxOps) at (101955) Bennu to determine the expected predicted trajectory performance in order to meet trajectory knowledge requirements throughout each phase of the mission. One of the primary requirements placed on the predicted trajectory performance was based on the performance during orbital phases leading up to the maneuver to initiate the Touch-and-Go (TAG) trajectory descent. Throughout ProxOps the nominal force models being used to predict the spacecraft trajectory were updated in an effort to improve the prediction performance. The most significant models that contributed to prediction performance were of solar radiation pressure, thermal reradiation of the spacecraft, predicted attitude errors, and desaturation maneuvers. Efforts were made throughout all of ProxOps to monitor, trend, predict, and update spacecraft modeling to improve the prediction performance. These efforts were vital to reduce the spacecraft knowledge errors necessary to achieve a TAG target smaller than pre-launch analysis allowed due to the rough terrain of Bennu. Increased precision in predicted trajectory errors allowed for refined uncertainties to be used for future phase planning throughout the mission. The navigation team successfully predicted the spacecraft trajectory throughout all of ProxOps achieving predicted trajectories errors less than originally analyzed.

Jason M. Leonard↗

The Reduction of Random Uncertainty in Differential Temperature Measurements Using Common Leg Thermocouples

The uncertainty quantification of random error is considered for common leg thermocouples (i.e., where one thermoelement is shared along the length of the TC for all other TC junctions present). The uncertainty is presented for both a common leg and individual, separate leg thermocouples. For Type K thermocouples a reduction in uncertainty by up to 3x is capable when differential temperatures, ?T, are within 150°C, and diminishes to little to no improvement above 150°C.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

A novel network-based approach to determining measurement representation error for model evaluation of aerosol microphysical properties

Atmospheric aerosol size and abundance influence radiative effects and climate change. To date, efforts to constrain global climate models’ radiative forcing with in situ aerosol observations have been hamstrung by uncertainty. One source of error, the regional “representation error,” arises when accurate but sparse single-point measurements of atmospheric aerosol distributions are compared with a model value, assuming that the single-point measurement is representative of the model domain. The Portable Optical Particle Spectrometer network in the Southern Great Plains (POPSnet-SGP) campaign has demonstrated that a network of nearly autonomous aerosol instruments operating at ambient temperature and relative humidity (with low measurement error) may be used to quantify measurement representation error and investigate the factors introducing heterogeneity in aerosol distributions across a rural, continental background region. Measurements were made using Portable Optical Particle Spectrometer (POPS) instruments at several sites for five months across the Department of Energy’s Aerosol Radiation Measurement Southern Great Plains (ARM-SGP) User Facility in the central USA. Measurement representation error decreased with longer averaging periods (20-40 % between 1 sec and 1 day), varied between sites by 10 – 20 % for aerosol concentration 140 – 2500 nm in diameter (N_140), and was higher for aerosols > 400 nm in diameter (N_400). Our measurements also show the influence of local meteorology on aerosol surface area (A_140) and size distributions: A_140 is positively correlated with wind speed and relative humidity, negatively correlated with precipitation, and lower given westerly winds. Based on this study, we conclude that the POPSnet approach provides considerably more insight into the spatial variability in the aerosol population that can be used to constrain climate models than would be available from similar networks of PM 2.5 monitors.

54 ENVIRONMENTAL SCIENCES↗

Wavefront-Error Performance Characterization for the James Webb Space Telescope (JWST) Integrated Science Instrument Module (ISIM) Science Instruments

The science instruments (SIs) comprising the James Webb Space Telescope (JWST) Integrated Science Instrument Module (ISIM) were tested in three cryogenic-vacuum test campaigns in the NASA Goddard Space Flight Center (GSFC)'s Space Environment Simulator (SES). In this paper, we describe the results of optical wavefront-error performance characterization of the SIs. The wavefront error is determined using image-based wavefront sensing (also known as phase retrieval), and the primary data used by this process are focus sweeps, a series of images recorded by the instrument under test in its as-used configuration, in which the focal plane is systematically changed from one image to the next. High-precision determination of the wavefront error also requires several sources of secondary data, including 1) spectrum, apodization, and wavefront-error characterization of the optical ground-support equipment (OGSE) illumination module, called the OTE Simulator (OSIM), 2) plate scale measurements made using a Pseudo-Nonredundant Mask (PNRM), and 3) pupil geometry predictions as a function of SI and field point, which are complicated because of a tricontagon-shaped outer perimeter and small holes that appear in the exit pupil due to the way that different light sources are injected into the optical path by the OGSE. One set of wavefront-error tests, for the coronagraphic channel of the Near-Infrared Camera (NIRCam) Longwave instruments, was performed using data from transverse translation diversity sweeps instead of focus sweeps, in which a sub-aperture is translated andor rotated across the exit pupil of the system.Several optical-performance requirements that were verified during this ISIM-level testing are levied on the uncertainties of various wavefront-error-related quantities rather than on the wavefront errors themselves. This paper also describes the methodology, based on Monte Carlo simulations of the wavefront-sensing analysis of focus-sweep data, used to establish the uncertainties of the wavefront error maps.

wavefront error↗

Validation Metrics for Deterministic and Probabilistic Data

Computational modeling and simulation are paramount to modern science. Computational models often replace physical experiments that are prohibitively expensive, dangerous, or occur at extreme scales. Thus, it is critical that these models accurately represent and can be used as replacements for reality. This paper provides an analysis of metrics that may be used to determine the validity of a computational model. While some metrics have a direct physical meaning and a long history of use, others, especially those that compare probabilistic data, are more difficult to interpret. Furthermore, the process of model validation is often application-specific, making the procedure itself challenging and the results difficult to defend. We therefore provide guidance and recommendations as to which validation metric to use, as well as how to use and decipher the results. Furthermore an example is included that compares interpretations of various metrics and demonstrates the impact of model and experimental uncertainty on validation processes.

97 MATHEMATICS AND COMPUTING↗

Gamma ray burst astrometry 2: Numerical tests

Since the announcement of the discovery of sources of gamma ray radiation in 1973, many more reports of such bursts have been published. Numerous artificial satellites have been equipped with gamma ray detectors including GRO. Unfortunately, almost no progress has been made in identifying the sources of this high energy radiation. Only one visible counterpart is known. It is suspected that this is a consequence of the methods currently used to define gamma ray burst source 'error boxes'. An alternative procedure was proposed in 1988 by Taff. Herein, Monte Carlo simulations are reported of the efficacy of this technique using realistic burst timing uncertainties and satellite location errors as well as a variety of satellite constellations. Since these are controlled numerical experiments, the dependence is examined of the statistics of the errors in the deduced burst wavefront normal as a function of the timing inconsistencies, detector location standard deviations, and especially the number and distribution of the detectors. The results clearly show that an arc minute prediction of a unique burst location is routinely obtainable once there are at least two interplanetary detectors.

Taff, L. G.↗

Inference of Ice Cloud Properties from High-spectral Resolution Infrared Observations

The theoretical basis is explored for inferring the microphysical properties of ice crystal from high-spectral resolution infrared observations. A radiative transfer model is employed to simulate spectral radiances to address relevant issues. The extinction and absorption efficiencies of individual ice crystals, assumed as hexagonal columns for large particles and droxtals for small particles, are computed from a combination of the finite- difference time-domain (FDTD) technique and a composite method. The corresponding phase functions are computed from a combination of FDTD and an improved geometric optics method (IGOM). Bulk scattering properties are derived by averaging the single- scattering properties of individual particles for 30 particle size distributions developed from in situ measurements and for additional four analytical Gamma size distributions for small particles. The non-sphericity of ice crystals is shown to have a significant impact on the radiative signatures in the infrared (IR) spectrum; the spherical particle approximation for inferring ice cloud properties may result in an overest&ation of the optical thickness and an inaccurate retrieval of effective particle size. Furthermore, we show that the error associated with the use of the Henyey-Greenstein phase function can be as larger as 1 K in terms of brightness temperature for larger particle effective size at some strong scattering wavenumbers. For small particles, the difference between the two phase functions is much less, with brightness temperatures generally differing by less than 0.4 K. The simulations undertaken in this study show that the slope of the IR brightness temperature spectrum between 790-960/cm is sensitive to the effective particle size. Furthermore, a strong sensitivity of IR brightness temperature to cloud optical thickness is noted within the l050-1250/cm region. Based on this spectral feature, a technique is presented for the simultaneous retrieval of the visible optical thickness and effective particle size from high spectral resolution infrared data under ice cloudy con&tion. The error analysis shows that the uncertainty of the retrieved optical thickness and effective particle size has a small range of variation. The error for retrieving particle size in conjunction with an uncertainty of 5 K in cloud'temperature, or a surface temperature uncertainty of 2.5 K, is less than 15%. The corresponding e m r in the uncertainty of optical thickness is within 5-2096, depending on the value of cloud optical thickness. The applicability of the technique is demonstrated using the aircraft-based High- resolution Interferometer Sounder (HIS) data from the Subsonic Aircraft: Contrail and Cloud Effects Special Study (SUCCESS) in 1996 and the First ISCCP Regional Experiment - Arctic Clouds Experiment (FIRE-ACE) in 1998.

Huang, Hung-Lung↗

Sensitivity of satellite-derived net shortwave irradiance at the Earth's surface to radiometric calibration

The effect of radiometric calibration uncertainties on satellite-derived net shortwave irradiance at the Earth's surface was examined. Net shortwave irradiance sensitivity to calibration is expressed as a function of two basic components that depend on surface and cloud albedo sensitivities, respectively. The analysis of these sensitivities for a wide range of atmospheric and surface conditions, as well as radiation geometries, shows that a 10 percent uncertainty in the calibration induces up to 40 W/sqm errors in instantaneous net shortwave irradiance (negative when the calibration uncertainty is positive). The maximum relative errors are obtained in overcast conditions when cloud albedos are high. On a monthly time scale, the induced error becomes typically 13 W/sqm in the tropics and 16 W/sqm in higher latitude regions during summer. The error almost vanishes at high latitudes during winter. A 10 percent positive uncertainty in the calibration gives a net shortwave irradiance error similar to that induced by the 3 hr sampling of the ISCCP Project.

Gautier, C.↗

Incorporating Uncertainty of Wind Power Generation Forecast into Power System Operation, Dispatch, and Unit Commitment Procedures

An approach to evaluate the uncertainties of the balancing capacity, ramping capability, and ramp duration requirements is proposed. The approach includes three steps: forecast data acquisition, statistical analysis of retrospective information, and prediction of grid balancing requirements for a specified time horizon and a given confidence level. An assessment of the capacity and ramping requirements is performed using a specially developed probabilistic algorithm based on histogram analysis, incorporating sources of uncertainty - both continuous (wind and load forecast errors) and discrete (forced generator outages and start-up failures). A new method called the 'flying-brick' technique is developed to evaluate the look-ahead required generation performance envelope for the worst case scenario within a user-specified confidence level. A self-validation process is used to validate the accuracy of the confidence intervals. To demonstrate the validity of the developed uncertainty assessment methods and its impact on grid operation, a framework for integrating the proposed methods with an EMS system is developed. Demonstration through EMS integration illustrates the applicability of the proposed methodology and the developed tool for actual grid operation and paves the road for integration with EMS systems in control rooms.

17 WIND ENERGY↗

Dependence of direct detection signals on the WIMP velocity distribution

The signals expected in WIMP direct detection experiments depend on the ultra-local dark matter distribution. Observations probe the local density, circular speed and escape speed, while simulations find velocity distributions that deviate significantly from the standard Maxwellian distribution. We calculate the energy, time and direction dependence of the event rate for a range of velocity distributions motivated by recent observations and simulations, and also investigate the uncertainty in the determination of WIMP parameters. The dominant uncertainties are the systematic error in the local circular speed and whether or not the MW has a high density dark disc. In both cases there are substantial changes in the mean differential event rate and the annual modulation signal, and hence exclusion limits and determinations of the WIMP mass. The uncertainty in the shape of the halo velocity distribution is less important, however it leads to a ∼ 5% systematic error in the WIMP mass. The detailed direction dependence of the event rate is sensitive to the velocity distribution. However the numbers of events required to detect anisotropy and confirm the median recoil direction do not change substantially.

79 ASTRONOMY AND ASTROPHYSICS↗

Application of a Novel Dose-Uncertainty Model for Dose-Uncertainty Analysis in Prostate Intensity-Modulated Radiotherapy

Purpose: To analyze dose uncertainty using a previously published dose-uncertainty model, and to assess potential dosimetric risks existing in prostate intensity-modulated radiotherapy (IMRT). Methods and Materials: The dose-uncertainty model provides a three-dimensional (3D) dose-uncertainty distribution in a given confidence level. For 8 retrospectively selected patients, dose-uncertainty maps were constructed using the dose-uncertainty model at the 95% CL. In addition to uncertainties inherent to the radiation treatment planning system, four scenarios of spatial errors were considered: machine only (S1), S1 + intrafraction, S1 + interfraction, and S1 + both intrafraction and interfraction errors. To evaluate the potential risks of the IMRT plans, three dose-uncertainty-based plan evaluation tools were introduced: confidence-weighted dose-volume histogram, confidence-weighted dose distribution, and dose-uncertainty-volume histogram. Results: Dose uncertainty caused by interfraction setup error was more significant than that of intrafraction motion error. The maximum dose uncertainty (95% confidence) of the clinical target volume (CTV) was smaller than 5% of the prescribed dose in all but two cases (13.9% and 10.2%). The dose uncertainty for 95% of the CTV volume ranged from 1.3% to 2.9% of the prescribed dose. Conclusions: The dose uncertainty in prostate IMRT could be evaluated using the dose-uncertainty model. Prostate IMRT plans satisfying the same plan objectives could generate a significantly different dose uncertainty because a complex interplay of many uncertainty sources. The uncertainty-based plan evaluation contributes to generating reliable and error-resistant treatment plans.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers

Restricted Boltzmann Machines (RBMs) have been proposed for developing neural networks for a variety of unsupervised machine learning applications such as image recognition, drug discovery, and materials design. The Boltzmann probability distribution is used as a model to identify network parameters by optimizing the likelihood of predicting an output given hidden states trained on available data. Training such networks often requires sampling over a large probability space that must be approximated during gradient based optimization. Quantum annealing has been proposed as a means to search this space more efficiently which has been experimentally investigated on D-Wave hardware. D-Wave implementation requires selection of an effective inverse temperature or hyperparameter (β) within the Boltzmann distribution which can strongly influence optimization. Here, we show how this parameter can be estimated as a hyperparameter applied to D-Wave hardware during neural network training by maximizing the likelihood or minimizing the Shannon entropy. We find both methods improve training RBMs based upon D-Wave hardware experimental validation on an image recognition problem. Neural network image reconstruction errors are evaluated using Bayesian uncertainty analysis which illustrate more than an order magnitude lower image reconstruction error using the maximum likelihood over manually optimizing the hyperparameter. The maximum likelihood method is also shown to out-perform minimizing the Shannon entropy for image reconstruction.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Analysis of the NASA Glenn 8x6 Supersonic Wind Tunnel

This paper presents methods and results of a detailed measurement uncertainty analysis that was performed for the 8- by 6-foot Supersonic Wind Tunnel located at the NASA Glenn Research Center. The statistical methods and engineering judgments used to estimate elemental uncertainties are described. The Monte Carlo method of propagating uncertainty was selected to determine the uncertainty of calculated variables of interest. A detailed description of the Monte Carlo method as applied for this analysis is provided. Detailed uncertainty results for the uncertainty in average free stream Mach number as well as other variables of interest are provided. All results are presented as random (variation in observed values about a true value), systematic (potential offset between observed and true value), and total (random and systematic combined) uncertainty. The largest sources contributing to uncertainty are determined and potential improvement opportunities for the facility are investigated.

Error↗

A strawman targeting technique for spinner spacecraft in the presence of pointing uncertainty

A graphical method that allows the selection of the attitude orientation of a spinner spacecraft prior to the application of a single fixed magnitude velocity change to effect a desired orbit transfer is presented. The selection of the final pointing vector along or opposite to which the desired Delta-V is applied, takes into account pointing errors due to initial attitude determination uncertainty and execution errors introduced during the rhumb line precession of the spin axis. The characterization of the target space in terms of any achieved orbit parameters of interest as well as the final pointing uncertainty is sufficient to determine the right final attitude that insures satisfaction of mission requirements.

Kechichian, J. A.↗

SALT2 versus SALT3: updated model surfaces and their impacts on type Ia supernova cosmology

ABSTRACT For the past decade, SALT2 has been the most common model used to fit Type Ia supernova (SN Ia) light curves for dark energy analyses. Recently, the SALT3 model was released, which upgraded a number of model features but has not yet been used for measurements of dark energy. Here, we evaluate the impact of switching from SALT2 to SALT3 for a SN cosmology analysis. We train SALT2 and SALT3 on an identical training sample of 1083 well-calibrated Type Ia supernovae, ensuring that any differences found come from the underlying model framework. We publicly release the results of this training (the SALT ‘surfaces’). We then run a cosmology analysis on the public Dark Energy Survey 3-Yr Supernova data sample (DES-SN3YR), and on realistic simulations of those data. We provide the first estimate of the SN + CMB systematic uncertainty arising from the choice of SALT model framework (i.e. SALT2 versus SALT3), Δw = + 0.001 ± 0.005 – a negligible effect at the current level of dark energy analyses. We also find that the updated surfaces are less sensitive to photometric calibration uncertainties than previous SALT2 surfaces, with the average spectral energy density dispersion reduced by a factor of two over optical wavelengths. This offers an opportunity to reduce the contribution of calibration errors to SN cosmology uncertainty budgets.

79 ASTRONOMY AND ASTROPHYSICS↗

Adjoint-Based, Three-Dimensional Error Prediction and Grid Adaptation

Engineering computational fluid dynamics (CFD) analysis and design applications focus on output functions (e.g., lift, drag). Errors in these output functions are generally unknown and conservatively accurate solutions may be computed. Computable error estimates can offer the possibility to minimize computational work for a prescribed error tolerance. Such an estimate can be computed by solving the flow equations and the linear adjoint problem for the functional of interest. The computational mesh can be modified to minimize the uncertainty of a computed error estimate. This robust mesh-adaptation procedure automatically terminates when the simulation is within a user specified error tolerance. This procedure for estimating and adapting to error in a functional is demonstrated for three-dimensional Euler problems. An adaptive mesh procedure that links to a Computer Aided Design (CAD) surface representation is demonstrated for wing, wing-body, and extruded high lift airfoil configurations. The error estimation and adaptation procedure yielded corrected functions that are as accurate as functions calculated on uniformly refined grids with ten times as many grid points.

Park, Michael A.↗

Analytical Assessment of Simultaneous Parallel Approach Feasibility from Total System Error

In a simultaneous paired approach to closely-spaced parallel runways, a pair of aircraft flies in close proximity on parallel approach paths. The aircraft pair must maintain a longitudinal separation within a range that avoids wake encounters and, if one of the aircraft blunders, avoids collision. Wake avoidance defines the rear gate of the longitudinal separation. The lead aircraft generates a wake vortex that, with the aid of crosswinds, can travel laterally onto the path of the trail aircraft. As runway separation decreases, the wake has less distance to traverse to reach the path of the trail aircraft. The total system error of each aircraft further reduces this distance. The total system error is often modeled as a probability distribution function. Therefore, Monte-Carlo simulations are a favored tool for assessing a "safe" rear-gate. However, safety for paired approaches typically requires that a catastrophic wake encounter be a rare one-in-a-billion event during normal operation. Using a Monte-Carlo simulation to assert this event rarity with confidence requires a massive number of runs. Such large runs do not lend themselves to rapid turn-around during the early stages of investigation when the goal is to eliminate the infeasible regions of the solution space and to perform trades among the independent variables in the operational concept. One can employ statistical analysis using simplified models more efficiently to narrow the solution space and identify promising trades for more in-depth investigation using Monte-Carlo simulations. These simple, analytical models not only have to address the uncertainty of the total system error but also the uncertainty in navigation sources used to alert an abort of the procedure. This paper presents a method for integrating total system error, procedure abort rates, avionics failures, and surveillance errors into a statistical analysis that identifies the likely feasible runway separations for simultaneous paired approaches.

Madden, Michael M.↗

Error Analysis And Propagation In Metabolomics Data Aanalysis

Error analysis plays a fundamental role in describing the uncertainty in experimental results. It has several fundamental uses in metabolomics including experimental design, quality control of experiments, the selection of appropriate statistical methods, and the determination of uncertainty in results. Furthermore, the importance of error analysis has grown with the increasing number, complexity, and heterogeneity of measurements characteristic of ‘omics research. The increase in data complexity is particularly problematic for metabolomics, which has more heterogeneity than other omics technologies due to the much wider range of molecular entities detected and measured. This review introduces the fundamental concepts of error analysis as they apply to a wide range of metabolomics experimental designs and it discusses current methodologies for determining the propagation of uncertainty in appropriate metabolomics data analysis. These methodologies include analytical derivation and approximation techniques, Monte Carlo error analysis, and error analysis in metabolic inverse problems. Current limitations of each methodology with respect to metabolomics data analysis are also discussed.

59 BASIC BIOLOGICAL SCIENCES↗