Search NASA⌕ Search

SEARCH · Search NASA

Results for “errors and uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Perspectives on Systematic Cloud Microphysics Scheme Development With Machine Learning

Cloud microphysics—the collection of processes that govern the small‐scale formation, evolution, and interactions of liquid droplets and ice crystals in clouds and precipitation—remains a major source of uncertainty in weather and climate models. Although too small in scale to be explicitly resolved in any large‐eddy simulation, weather, or climate model, the representation of cloud microphysical processes has significant impact at the climate scale. Current microphysical schemes are limited by both parametric uncertainty, linked to uncertainty in physical parameter values, and structural uncertainty, arising from incomplete physical understanding of the processes at play or approximations made for computational efficiency. Recent advances in the application of machine learning (ML) to the physical sciences show significant potential for minimizing these limitations by leveraging high‐fidelity simulations and observations. Here we outline the challenges that must be addressed to apply ML toward cloud microphysics scheme development. This perspectives paper synthesizes recent progress in using data‐driven methods, including ML, to improve cloud microphysics parameterizations and highlights opportunities to address key uncertainties. We discuss the roles of aleatoric (irreducible, or statistical) and epistemic (reducible, or systematic) errors in contributing to microphysics parameterization uncertainty. ML can leverage observations to improve microphysical schemes via bottom‐up and top‐down constraints. Methods such as differentiable programming and ML‐enhanced sampling strategies and the creation of large scale benchmark data sets promise to bridge the gap between observations and models and to improve the consistency of cloud microphysical representation across temporal and spatial scales.

Lamb, Kara D. [Columbia Univ., New York, NY (Unite↗

GPS aiding of ocean current determination

The navigational accuracy of an oceangoing vessel using conventional GPS p-code data is examined. The GPS signal is transmitted over two carrier frequencies in the L-band at 1575.42 and 1227.6 MHz. Achievable navigational uncertainties of differenced positional estimates are presented as a function of the parameters of the problem, with particular attention given to the effect of sea-state, user equivalent range error, uncompensated antenna motion, varying delay intervals, and reduced data rate examined in the unaided mode. The unmodeled errors resulting from satellite ephemeris uncertainties are shown to be negligible for the GPS-NDS (Navigation Development) satellites. Requirements are met in relatively calm seas, but accuracy degradation by a factor of at least 2 must be anticipated in heavier sea states. The aided mode of operation is examined, and it is shown that requirements can be met by using an inertial measurement unit (IMU) to aid the GPS receiver operation. Since the use of an IMU would mean higher costs, direct Doppler from the GPS satellites is presented as a viable alternative.

Mohan, S. N.↗

Best Practices of Uncertainty Estimation for the National Solar Radiation Database (NSRDB 1998-2015): Preprint

It is essential to apply a traceable and standard approach to determine the uncertainty of solar resource data. Solar resource data are used for all phases of solar energy conversion projects, from the conceptual phase to routine solar power plant operation, and to determine performance guarantees of solar energy conversion systems. These guarantees are based on the available solar resource derived from a measurement station or modeled data set such as the National Solar Radiation Database (NSRDB). Therefore, quantifying the uncertainty of these data sets provides confidence to financiers, developers, and site operators of solar energy conversion systems and ultimately reduces deployment costs. In this study, we implemented the Guide to the Expression of Uncertainty in Measurement (GUM) 1 to quantify the overall uncertainty of the NSRDB data. First, we start with quantifying measurement uncertainty, then we determine each uncertainty statistic of the NSRDB data, and we combine them using the root-sum-of-the-squares method. The statistics were derived by comparing the NSRDB data to the seven measurement stations from the National Oceanic and Atmospheric Administration's Surface Radiation Budget Network, National Renewable Energy Laboratory's Solar Radiation Research Laboratory, and the Atmospheric Radiation Measurement program's Southern Great Plains Central Facility, in Billings, Oklahoma. The evaluation was conducted for hourly values, daily totals, monthly mean daily totals, and annual mean monthly mean daily totals. Varying time averages assist to capture the temporal uncertainty of the specific modeled solar resource data required for each phase of a solar energy project; some phases require higher temporal resolution than others. Overall, by including the uncertainty of measurements of solar radiation made at ground stations, bias, and root mean square error, the NSRDB data demonstrated expanded uncertainty of 17 percent - 29 percent on hourly and an approximate 5 percent - 8 percent annual bases.

14 SOLAR ENERGY↗

Study of B to pi l nu and B to rho l nu Decays and Determination of |V_ub|

We present an analysis of exclusive charmless semileptonic B-meson decays based on 377 million B{bar B} pairs recorded with the BABAR detector at the {Upsilon} (4S) resonance. We select four event samples corresponding to the decay modes B{sup 0} {yields} {pi}{sup -}{ell}{sup +}{nu}, B{sup +} {yields} {pi}{sup 0}{ell}{sup +}{nu}, B{sup 0} {yields} {rho}{sup -}{ell}{sup +}{nu}, and B{sup +} {yields} {rho}{sup 0}{ell}{sup +}{nu}, and find the measured branching fractions to be consistent with isospin symmetry. Assuming isospin symmetry, we combine the two B {yields} {pi}{ell}{nu} samples, and similarly the two B {yields} {rho}{ell}{nu} samples, and measure the branching fractions {Beta}(B{sup 0} {yields} {pi}{sup -}{ell}{sup +}{nu}) = (1.41 {+-} 0.05 {+-} 0.07) x 10{sup -4} and {Beta}(B{sup 0} {yields} {rho}{sup 0}{ell}{sup +}{nu}) = (1.75 {+-} 0.15 {+-} 0.27) x 10{sup -4}, where the errors are statistical and systematic. We compare the measured distribution in q{sup 2}, the momentum transfer squared, with predictions for the form factors from QCD calculations and determine the CKM matrix element |V{sub ub}|. Based on the measured partial branching fraction for B {yields} {pi}{ell}{nu} in the range q{sup 2} < 12 GeV{sup 2} and the most recent LCSR calculations we obtain |V{sub ub}| = (3.78 {+-} 0.13{sub -0.40}{sup +0.55}) x 10{sup -3}, where the errors refer to the experimental and theoretical uncertainties. From a simultaneous fit to the data over the full q{sup 2} range and the FNAL/MILC lattice QCD results, we obtain |V{sub ub}| = (2.95 {+-} 0.31) x 10{sup -3} from B {yields} {pi}{ell}{nu}, where the error is the combined experimental and theoretical uncertainty.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Standardized Software for Wind Load Forecast Error Analyses and Predictions Based on Wavelet-ARIMA Models - Applications at Multiple Geographically Distributed Wind Farms

Given the multi-scale variability and uncertainty of wind generation and forecast errors, it is a natural choice to use time-frequency representation (TFR) as a view of the corresponding time series represented over both time and frequency. Here we use wavelet transform (WT) to expand the signal in terms of wavelet functions which are localized in both time and frequency. Each WT component is more stationary and has consistent auto-correlation pattern. We combined wavelet analyses with time series forecast approaches such as ARIMA, and tested the approach at three different wind farms located far away from each other. The prediction capability is satisfactory -- the day-ahead prediction of errors match the original error values very well, including the patterns. The observations are well located within the predictive intervals. Integrating our wavelet-ARIMA (‘stochastic’) model with the weather forecast model (‘deterministic’) will improve our ability significantly to predict wind power generation and reduce predictive uncertainty.

uncertainty analysis, wind generation forecast, wa↗

Uncertainty relation revisited from quantum estimation theory

We use quantum estimation theory to formulate bounds of errors in quantum measurement for arbitrary quantum states and observables in a finite-dimensional Hilbert space. We prove that the measurement errors of two noncommuting observables satisfy Heisenberg-type uncertainty relation, find the achievable bound, and propose a strategy to achieve it.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Climate Absolute Radiance and Refractivity Observatory (CLARREO) Pathfinder Intercalibration Data Analysis Strategy

One of the prime science objectives of NASA’s Climate Absolute Radiance and Refractivity Observatory (CLARREO) Pathfinder (CPF) mission is to acquire unprecedentedly accurate Système Internationale (SI)-traceable Earth-view measurements that can be used as reference for intercalibrating the Clouds and the Earth’s Radiant Energy System (CERES) and Visible Infrared Imaging Radiometer Suite (VIIRS) instruments onboard NOAA-20 satellite. The hyperspectral nature of CPF measurements will significantly reduce spectrally induced biases when intercalibrating multiband or broadband satellite instruments with CPF. This advancement eliminates the requirement for spectral band adjustment factors, representing a substantial improvement in sensor intercalibration studies. The CPF intercalibration team is aiming to achieve a maximum intercalibration methodology uncertainty of 0.3 % (k=1). Our studies have revealed that the most significant contribution to the targeted uncertainty budget originates from the combined effects of spatial and temporal matching errors. Spatial matching error arises from discrepancies in CPF and target instrument pixel resolution and geolocation uncertainty, while temporal matching error is caused by changes in scene radiances over time, occurring between when the target and reference instruments observe the same scenes. To estimate the maximum expected uncertainty contribution from these sources, spatial and temporal matching noise analyses were conducted using algorithmically filtered Landsat 9 Operational Land Imager (OLI) and Geostationary Operational Environmental Satellite (GOES)-16 ABI CONUS scan data as proxies for CPF and target instruments. In the upcoming conference presentation, we will elaborate on the methodology employed in these experiments, provide details of the data filtering algorithms, and present results of the spatial and temporal matching uncertainty analyses.

Intercalibration↗

Catalytic resonance theory for parametric uncertainty of programmable catalysis

Microkinetic models are useful tools for screening catalytic materials; however, errors in their input parameters can lead to significant uncertainty in model predictions of catalyst performance. Here, in this work, we investigate the impact of linear scaling and Brønsted-Evans-Polanyi relation parametric uncertainty on microkinetic predictions of programmable-catalyst performance. Two case studies are considered: a generic A-to-B prototype reaction and the oxygen evolution reaction (OER). The results show that error-unaware models can accurately predict trends and, for the prototype reaction, values of optimal waveform parameters. The specific model parameters driving output uncertainty are identified via variance-based global sensitivity analysis. However, predictions of dynamic rate enhancement can decrease when uncertainty is propagated into the models. In both cases, we identify operating conditions where the programmable catalyst achieves a rate enhancement of at least one order of magnitude despite parametric uncertainty in the model, supporting programmable catalysis as a viable strategy for exceeding the Sabatier limit.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Orbit determination error analysis and comparison of station-keeping costs for Lissajous and halo-type libration point orbits and sensitivity analysis using experimental design techniques

Spacecraft in orbit near libration point L1 in the Sun-Earth system are excellent platforms for research concerning solar effects on the terrestrial environment. One spacecraft mission launched in 1978 used an L1 orbit for nearly 4 years, and future L1 orbital missions are also being planned. Orbit determination and station-keeping are, however, required for these orbits. In particular, orbit determination error analysis may be used to compute the state uncertainty after a predetermined tracking period; the predicted state uncertainty levels then will impact the control costs computed in station-keeping simulations. Error sources, such as solar radiation pressure and planetary mass uncertainties, are also incorporated. For future missions, there may be some flexibility in the type and size of the spacecraft's nominal trajectory, but different orbits may produce varying error analysis and station-keeping results. The nominal path, for instance, can be (nearly) periodic or distinctly quasi-periodic. A periodic 'halo' orbit may be constructed to be significantly larger than a quasi-periodic 'Lissajous' path; both may meet mission requirements, but perhaps the required control costs for these orbits are probably different. Also for this spacecraft tracking and control simulation problem, experimental design methods can be used to determine the most significant uncertainties. That is, these methods can determine the error sources in the tracking and control problem that most impact the control cost (output); it also produces an equation that gives the approximate functional relationship between the error inputs and the output.

Gordon, Steven C.↗

Comparing Consider-Covariance Analysis with Sigma-Point Consider Filter and Linear-Theory Consider Filter Formulations

Recent literature in applied estimation theory reflects growing interest in the sigma-point (also called unscented ) formulation for optimal sequential state estimation, often describing performance comparisons with extended Kalman filters as applied to specific dynamical problems [c.f. 1, 2, 3]. Favorable attributes of sigma-point filters are described as including a lower expected error for nonlinear even non-differentiable dynamical systems, and a straightforward formulation not requiring derivation or implementation of any partial derivative Jacobian matrices. These attributes are particularly attractive, e.g. in terms of enabling simplified code architecture and streamlined testing, in the formulation of estimators for nonlinear spaceflight mechanics systems, such as filter software onboard deep-space robotic spacecraft. As presented in [4], the Sigma-Point Consider Filter (SPCF) algorithm extends the sigma-point filter algorithm to the problem of consider covariance analysis. Considering parameters in a dynamical system, while estimating its state, provides an upper bound on the estimated state covariance, which is viewed as a conservative approach to designing estimators for problems of general guidance, navigation and control. This is because, whether a parameter in the system model is observable or not, error in the knowledge of the value of a non-estimated parameter will increase the actual uncertainty of the estimated state of the system beyond the level formally indicated by the covariance of an estimator that neglects errors or uncertainty in that parameter. The equations for SPCF covariance evolution are obtained in a fashion similar to the derivation approach taken with standard (i.e. linearized or extended) consider parameterized Kalman filters (c.f. [5]). While in [4] the SPCF and linear-theory consider filter (LTCF) were applied to an illustrative linear dynamics/linear measurement problem, in the present work examines the SPCF as applied to nonlinear sequential consider covariance analysis, i.e. in the presence of nonlinear dynamics and nonlinear measurements. A simple SPCF for orbit determination, exemplifying an algorithm hosted in the guidance, navigation and control (GN&C) computer processor of a hypothetical robotic spacecraft, was implemented, and compared with an identically-parameterized (standard) extended, consider-parameterized Kalman filter. The onboard filtering scenario examined is a hypothetical spacecraft orbit about a small natural body with imperfectly-known mass. The formulations, relative complexities, and performances of the filters are compared and discussed.

Lisano, Michael E.↗

Assessing Uncertainties of a Geophysical Approach to Estimate Surface Fine Particulate Matter Distributions from Satellite-Observed Aerosol Optical Depth

Health impact analyses are increasingly tapping the broad spatial coverage of satellite aerosol optical depth (AOD) products to estimate human exposure to fine particulate matter (PM2.5). We use a forward geophysical approach to derive ground-level PM2.5 distributions from satellite AOD at 1 km2(exp) resolution for 2011 over the northeastern US by applying relationships between surface PM2.5 and column AOD (calculated offline from speciated mass distributions) from a regional air quality model (CMAQ; 12×12 km2(exp) horizontal resolution). Seasonal average satellite-derived PM2.5 reveals more spatial detail and best captures observed surface PM2.5 levels during summer. At the daily scale, however, satellite-derived PM2.5 is not only subject to measurement uncertainties from satellite instruments, but more importantly to uncertainties in the relationship between surface PM2.5 and column AOD. Using 11 ground-based AOD measurements within 10 km of surface PM2.5 monitors, we show that uncertainties in modeled PM2.5∕AOD can explain more than 70 % of the spatial and temporal variance in the total uncertainty in daily satellite-derived PM2.5 evaluated at PM2.5 monitors. This finding implies that a successful geophysical approach to deriving daily PM2.5 from satellite AOD requires model skill at capturing day-to-day variations in PM2.5∕AOD relationships. Overall, we estimate that uncertainties in the modeled PM2.5∕AOD lead to an error of 11 µg m−3(exp) in daily satellite-derived PM2.5, and uncertainties in satellite AOD lead to an error of 8 µg m−3(exp). Using multi-platform ground, airborne, and radiosonde measurements, we show that uncertainties of modeled PM2.5∕AOD are mainly driven by model uncertainties in aerosol column mass and speciation, while model representation of relative humidity and aerosol vertical profile shape contributes some systematic biases. The parameterization of aerosol optical properties, which determines the mass extinction efficiency, also contributes to random uncertainty, with the size distribution being the largest source of uncertainty and hygroscopicity of inorganic salt the second largest. Future efforts to reduce uncertainty in geophysical approaches to derive surface PM2.5 from satellite AOD would thus benefit from improving model representation of aerosol vertical distribution and aerosol optical properties, to narrow uncertainty in satellite-derived PM2.5.

aerosol optical depth↗

Satellite Orbital Drag During Magnetic Storms

We investigate satellite orbital drag effects at lowEarth orbit associated with thermosphere heating during magnetic storms caused by coronal mass ejections. CHAllenge Minisatellite Payload (CHAMP) and Gravity Recovery And Climate Experiment (GRACE) neutral density data are used to compute orbital drag. Stormtoquiet density comparisons are performed with background densities obtained by the JacchiaBowman 2008 (JB2008) empirical model. Our storms are grouped in different categories regarding their intensities as indicated by minimum values of the SYMH index. We then perform superposed epoch analyses with storm main phase onset as zero epoch time. In general, we find that orbital drag effects are larger for CHAMP (lower altitudes) in comparison to GRACE (higher altitudes). Results show that storm time drag effects manifest first at high latitudes, but for extreme storms, particularly observed by GRACE, stronger orbital drag effects occur during early main phase at low/equatorial latitudes, probably due to heating propagation from high latitudes. We find that storm time orbital decay along the satellites' path generally increases with storm intensity, being stronger and faster for the most extreme events. For these events, orbital drag effects decrease faster probably due to elevated cooling effects caused by nitric oxide, which introduce modeled density uncertainties during storm recovery phase. Errors associated with total orbit decay introduced by JB2008 are generally the largest for the strongest storms and increase during storm times, particular during recovery phases. We discuss the implication of these uncertainties for the prediction of collision between space objects at lowEarth orbit during magnetic storms.

Oliveira, D. M.↗

Bayesian strategies for uncertainty quantification of the thermodynamic properties of materials

Reliable models of the thermodynamic properties of materials are critical for industrially relevant applications that require a good understanding of equilibrium phase diagrams, thermal and chemical transport, and microstructure evolution. The goal of thermodynamic models is to capture data from both experimental and computational studies and then make reliable predictions when extrapolating to new regions of parameter space. These predictions will be impacted by artifacts present in real data sets such as outliers, systematic errors, and unreliable or missing uncertainty bounds. Such issues increase the probability of the thermodynamic model producing erroneous predictions. We present a Bayesian framework for the selection, calibration, and quantification of uncertainty of thermodynamic property models. The modular framework addresses numerous concerns regarding thermodynamic models including thermodynamic consistency, robustness to outliers, and systematic errors by the use of hyperparameter weightings and robust Likelihood and Prior distribution choices. Furthermore, the framework’s inherent transparency (e.g. our choice of probability functions and associated parameters) enables insights into the complex process of thermodynamic assessment. We introduce these concepts through examples where the true property model is known. Additionally, we demonstrate the utility of the framework through the creation of a property model from a large set of experimental specific heat and enthalpy measurements of Hafnium metal from 0 to 4900K.

36 MATERIALS SCIENCE↗

Measurements of the Downward Longwave Radiation Spectrum over the Antarctic Plateau and Comparisons with a Line-by-Line Radiative Transfer Model for Clear Skies

A 1-year field program was conducted at South Pole Station in 1992 to measure the downward infrared radiance spectrum at a resolution of 1/ cm over the spectral range 550-1667 cm-'. The atmosphere over the Antarctic Plateau is the coldest and driest on Earth, where in winter, surface temperatures average about -60 C, the total column water vapor is as low as 300 pm of precipitable water, and the clear-sky downward longwave flux is usually less than 80 W/sq m. Three clear-sky test cases are selected, one each for summer, winter, and spring, for which high- quality radiance data are available.as well as ancillary data to construct model atmospheres from radiosondes, ozonesondes, and other measurements. The model atmospheres are used in conjunction with the line-by-line radiative transfer model (LBLRTM) to compare model calculations with the spectral radiance measurements. The high-resolution calculations of LBLRTM (approx. = 0.001/ cm) are matched to the lower-resolution measurements (1/ cm) by adjusting their spectral resolution and by applying a correction for the finite field of view of the interferometer. In summer the uncertainties in temperature and water vapor profiles dominate the radiance error in the LBLRTM calculations. In winter the uncertainty in viewing zenith angle becomes important as well as the choice of atmospheric levels in the strong near-surface temperature inversion. The spectral radiance calculated for each of the three test cases generally agrees with that measured, to within twice the total estimated radiance error, thus validating LBLRTM to this level of accuracy for Antarctic conditions. However, the discrepancy exceeds twice the estimated error in the gaps between spectral lines in the region 1250-1500/ cm, where emission is dominated by the foreign-broadened water vapor continuum.

Walden, Von P.↗

Uncertainty Quantification for JPL Retrievals

We define the notions of verification, validation, and uncertainty quantification (VVUQ), and place them in the context of retrievals of Earth science data. Uncertainty quantification (UQ) is the process of characterizing the uncertainty of a measurement system relative to the true, physical quantity it measures. UQ is needed when measurements are used for scientific inference, assimilated into models with other data, and used for decision-making and risk analysis. Many measurements come with measures of standard error and bias, but these uncertainty measures are often inaccurate, due to the operational need to assume crisp values for parameters which are in fact uncertain, as well as the failure of technical assumptions needed by operational error-estimation approaches. UQ provides a way to study which assumptions fail to hold, and a tool to improve the measurement. We describe a particular, broadly-applicable UQ setup that has been successful for JPL retrievals including OCO-2, and provide recommendations for furthering the UQ state of the practice at JPL.

Turmon, Michael↗

Effects of exposure estimation errors on estimated exposure-response relations for PM2.5

Highlights: • Recent literature has identified associations between concentrations of fine particulate matter (PM2.5) in ambient air and adverse health effects at estimated exposure concentrations below current air ambient quality standards. • The models and analyses used do not usually quantify uncertainty about exposure estimates. • Realistic errors in exposure estimates can be estimated from available air quality monitoring stations by predicting concentrations at each station from concentrations at neighboring stations. • Exposure estimation errors are large enough to obscure low-dose nonlinearities or thresholds in the true concentration-response (C-R) function, artificially making them appear to be linear at low doses. • Better estimates of C-R functions will require modeling exposure distributions and estimation errors, rather than just estimating average exposure concentrations. Associations between fine particulate matter (PM2.5) exposure concentrations and a wide variety of undesirable outcomes, from autism and auto theft to elderly mortality, suicide, and violent crime, have been widely reported. Influential articles have argued that reducing National Ambient Air Quality Standards for PM2.5 is desirable to reduce these outcomes. Yet, other studies have found that reducing black smoke and other particulate matter by as much as 70% and dozens of micrograms per cubic meter has not detectably affected all-cause mortality rates even after decades, despite strong, statistically significant positive exposure concentration-response (C-R) associations between them. This paper examines whether this disconnect between association and causation might be explained in part by ignored estimation errors in estimated exposure concentrations. We use EPA air quality monitor data from the Los Angeles area of California to examine the shapes of estimated C-R functions for PM2.5 when the true C-R functions are assumed to be step functions with well-defined response thresholds. The estimated C-R functions mistakenly show risk as smoothly increasing with concentrations even well below the response thresholds, thus incorrectly predicting substantial risk reductions from reductions in concentrations that do not affect health risks. We conclude that ignored estimation errors obscure the shapes of true C-R functions, including possible thresholds, possibly leading to unrealistic predictions of the changes in risk caused by changing exposures. Instead of estimating improvements in public health per unit reduction (e.g., per 10 µg/m{sup 3} decrease) in average PM2.5 concentrations, it may be essential to consider how interventions change the distributions of exposure concentrations.

54 ENVIRONMENTAL SCIENCES↗

Update on a short-distance $D^0$-meson mixing calculation with $N_f=2+1$ flavors

We present an update on our calculation of the short-distance $D^0$-meson mixing hadronic matrix elements. The analysis is performed on the MILC collaboration's $N_f=2+1$ asqtad configurations. We use asqtad light valence quarks and the Sheikoleslami-Wohlert action with the Fermilab interpretation for the valence charm quark. SU(3), partially quenched, rooted, staggered heavy-meson chiral perturbation theory is used to extrapolate to the chiral-continuum limit. Systematic errors arising from the chiral-continuum extrapolation, heavy-quark discretization, and quark-mass uncertainties are folded into the statistical errors from the chiral-continuum fits with methods of Bayesian inference. A preliminary error budget for all five operators is presented.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗