Search NASA⌕ Search

SEARCH · Search NASA

Results for “Bias and Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Equivalent GPS measurements for efficient estimation process

Dual-frequency pseudorange and carrier phase data streams can be analytically combined into a single equivalent data stream, reducing the data volume and computing time in the filtering process for parameter estimation by a factor of 2 to 4. The resulting single data stream is that of carrier phase measurements with both data noise and bias uncertainty strictly defined. Based on these analytical formulas the equivalent GPS measurements can be formed by simple and efficient numerical calculations without any degradation in data strength. Formulation for the equivalent GPS measurements and their covariances are given in closed form; and a numerical simulation is performed to demonstrate the validity and effectiveness of the equivalent measurements.

Wu, S. C.↗

An optimal GPS data processing technique

A formula is derived to optimally combine dual-frequency GPS (Global Positioning System) pseudorange and carrier phase data streams into a single equivalent data stream, reducing the data volume and computing time in the filtering process for parameter estimation by a factor of four. The resulting single data stream is that of carrier phase measurements with both data noise and bias uncertainty strictly defined. With this analytical formula the single stream of equivalent GPS measurements can be efficiently formed by simple numerical calculations without any degradation in data strength. The formulation for the optimally combined GPS data and their covariances are given in closed form. Carrier phase ambiguity resolution, when feasible, is improved due to the preservation of the full data strength with the optimal data combining process.

Wu, S. C.↗

An optimal GPS data processing technique for precise positioning

A mathematical formula to optimally combine dual-frequency GPS pseudorange and carrier phase (integrated Doppler) data streams into a single data stream is derived in closed form. The data combination reduces the data volume and computing time in the filtering process for parameter estimation by a factor of 4 while preserving the full data strength for precise positioning. The resulting single data stream is that of carrier phase measurements with both data noise and bias uncertainty strictly defined. With this mathematical formula the single stream of optimally combined GPS measurements can be efficiently formed by simple numerical calculations. Carrier phase ambiguity resolution, when feasible, is strengthened due to the preserved full data strength with the optimally combined data and the resulting longer wavelength for the ambiguity to be resolved.

Wu, Sien-Chong↗

Calibration improvements to electronically scanned pressure systems and preliminary statistical assessment

Orifice-to-orifice inconsistencies in data acquired with an electronically-scanned pressure system at the beginning of a wind tunnel experiment forced modifications to the standard, instrument calibration procedures. These modifications included a large increase in the number of calibration points which would allow a critical examination of the calibration curve-fit process, and a subsequent post-test reduction of the pressure data. Evaluation of these data has resulted in an improved functional representation of the pressure-voltage signature for electronically-scanned pressures sensors, which can reduce the errors due to calibration curve fit to under 0.10 percent of reading compared to the manufacturer specified 0.10 percent of full scale. Application of the improved calibration function allows a more rational selection of the calibration set-point pressures. These pressures should be adjusted to achieve a voltage output which matches the physical shape of the pressure-voltage signature of the sensor. This process is conducted in lieu of the more traditional approach where a calibration pressure is specified and the resulting sensor voltage is recorded. The fifteen calibrations acquired over the two-week duration of the wind tunnel test were further used to perform a preliminary, statistical assessment of the variation in the calibration process. The results allowed the estimation of the bias uncertainty for a single instrument calibration; and, they form the precursor for more extensive and more controlled studies in the laboratory.

Everhart, Joel L.↗

NASA GPM GV Science Requirements

An important scientific objective of the NASA portion of the GPM Mission is to generate quantitatively-based error characterization information along with the rainrate retrievals emanating from the GPM constellation of satellites. These data must serve four main purposes: (1) they must be of sufficient quality, uniformity, and timeliness to govern the observation weighting schemes used in the data assimilation modules of numerical weather prediction models; (2) they must extend over that portion of the globe accessible by the GPM core satellite to which the NASA GV program is focused - (approx.65 degree inclination); (3) they must have sufficient specificity to enable detection of physically-formulated microphysical and meteorological weaknesses in the standard physical level 2 rainrate algorithms to be used in the GPM Precipitation Processing System (PPS), i.e., algorithms which will have evolved from the TRMM standard physical level 2 algorithms; and (4) they must support the use of physical error modeling as a primary validation tool and as the eventual replacement of the conventional GV approach of statistically intercomparing surface rainrates fiom ground and satellite measurements. This approach to ground validation research represents a paradigm shift vis-&-vis the program developed for the TRMM mission, which conducted ground validation largely as a statistical intercomparison process between raingauge-derived or radar-derived rainrates and the TRMM satellite rainrate retrievals -- long after the original satellite retrievals were archived. This approach has been able to quantify averaged rainrate differences between the satellite algorithms and the ground instruments, but has not been able to explain causes of algorithm failures or produce error information directly compatible with the cost functions of data assimilation schemes. These schemes require periodic and near-realtime bias uncertainty (i.e., global space-time distributed conditional accuracy of the retrieved rainrates) and local error covariance structure (i.e., global space-time distributed error correlation information for the local 4-dimensional space-time domain -- or in simpler terms, the matrix form of precision error). This can only be accomplished by establishing a network of high quality-heavily instrumented supersites selectively distributed at a few oceanic, continental, and coastal sites. Economics and pragmatics dictate that the network must be made up of a relatively small number of sites (6-8) created through international cooperation. This presentation will address some of the details of the methodology behind the error characterization approach, some proposed solutions for expanding site-developed error properties to regional scales, a data processing and communications concept that would enable rapid implementation of algorithm improvement by the algorithm developers, and the likely available options for developing the supersite network.

Smith, E.↗

Ice Growth Measurements from Image Data to Support Ice-Crystal and Mixed-Phase Accretion Testing

This paper describes the imaging techniques as well as the analysis methods used to measure the ice thickness and growth rate in support of ice-crystal icing tests performed at the National Research Council of Canada (NRC) Research Altitude Test Facility (RATFac). A detailed description of the camera setup, which involves both still and video cameras, as well as the analysis methods using the NASA Spotlight software, are presented. Two cases, one from two different test entries, showing significant ice growth are analyzed in detail describing the ice thickness and growth rate which is generally linear. Estimates of the bias uncertainty are presented for all measurements. Finally some of the challenges related to the imaging and analysis methods are discussed as well as methods used to overcome them.

Struk, Peter, M↗

Ice Growth Measurements from Image Data to Support Ice Crystal and Mixed-Phase Accretion Testing

This paper describes the imaging techniques as well as the analysis methods used to measure the ice thickness and growth rate in support of ice-crystal icing tests performed at the National Research Council of Canada (NRC) Research Altitude Test Facility (RATFac). A detailed description of the camera setup, which involves both still and video cameras, as well as the analysis methods using the NASA Spotlight software, are presented. Two cases, one from two different test entries, showing significant ice growth are analyzed in detail describing the ice thickness and growth rate which is generally linear. Estimates of the bias uncertainty are presented for all measurements. Finally some of the challenges related to the imaging and analysis methods are discussed as well as methods used to overcome them.

Struk, Peter M.↗

Assessing Confidence in Pliocene Sea Surface Temperatures to Evaluate Predictive Models

In light of mounting empirical evidence that planetary warming is well underway, the climate research community looks to palaeoclimate research for a ground-truthing measure with which to test the accuracy of future climate simulations. Model experiments that attempt to simulate climates of the past serve to identify both similarities and differences between two climate states and, when compared with simulations run by other models and with geological data, to identify model-specific biases. Uncertainties associated with both the data and the models must be considered in such an exercise. The most recent period of sustained global warmth similar to what is projected for the near future occurred about 3.33.0 million years ago, during the Pliocene epoch. Here, we present Pliocene sea surface temperature data, newly characterized in terms of level of confidence, along with initial experimental results from four climate models. We conclude that, in terms of sea surface temperature, models are in good agreement with estimates of Pliocene sea surface temperature in most regions except the North Atlantic. Our analysis indicates that the discrepancy between the Pliocene proxy data and model simulations in the mid-latitudes of the North Atlantic, where models underestimate warming shown by our highest-confidence data, may provide a new perspective and insight into the predictive abilities of these models in simulating a past warm interval in Earth history.This is important because the Pliocene has a number of parallels to present predictions of late twenty-first century climate.

simulation↗

Explore GPM IMERG and Other Global Precipitation Products with GES DISC GIOVANNI

New features and capabilities in the newly released GIOVANNI allow exploring GPM IMERG (Integrated Multi-satelliE Retrievals for GPM) Early, Late and Final Run global half-hourly and monthly precipitation products as well as other precipitation products distributed by the GES DISC such as TRMM Multi-Satellite Precipitation Analysis (TMPA), MERRA (Modern Era Retrospective-Analysis for Research and Applications), NLDAS (North American Land Data Assimilation Systems), GLDAS (Global Land Data Assimilation Systems), etc. GIOVANNI is a web-based tool developed by the GES DISC (Goddard Earth Sciences and Data Information Services Center) to visualize and analyze Earth science data without having to download data and software. The new interface in GIOVANNI allows searching and filtering precipitation products from different NASA missions and projects and expands the capabilities to inter-compare different precipitation products in one interface. Knowing differences in precipitation products is important to identify issues in retrieval algorithms, biases, uncertainties, etc. Due to different formats, data structures, units and so on, it is not easy to inter-compare precipitation products. Newly added features and capabilities (unit conversion, regridding, etc.) in GIOVANNI make inter-comparisons possible. In this presentation, we will describe these new features and capabilities along with examples.

Giovanni↗

Consistent Evaluation of ACOS-GOSAT, BESD-SCIAMACHY, CarbonTracker, and MACC Through Comparisons to TCCON

Consistent validation of satellite CO2 estimates is a prerequisite for using multiple satellite CO2 measurements for joint flux inversion, and for establishing an accurate long-term atmospheric CO2 data record. Harmonizing satellite CO2 measurements is particularly important since the differences in instruments, observing geometries, sampling strategies, etc. imbue different measurement characteristics in the various satellite CO2 data products. We focus on validating model and satellite observation attributes that impact flux estimates and CO2 assimilation, including accurate error estimates, correlated and random errors, overall biases, biases by season and latitude, the impact of coincidence criteria, validation of seasonal cycle phase and amplitude, yearly growth, and daily variability. We evaluate dry-air mole fraction (X(sub CO2)) for Greenhouse gases Observing SATellite (GOSAT) (Atmospheric CO2 Observations from Space, ACOS b3.5) and SCanning Imaging Absorption spectroMeter for Atmospheric CHartographY (SCIAMACHY) (Bremen Optimal Estimation DOAS, BESD v2.00.08) as well as the CarbonTracker (CT2013b) simulated CO2 mole fraction fields and the Monitoring Atmospheric Composition and Climate (MACC) CO2 inversion system (v13.1) and compare these to Total Carbon Column Observing Network (TCCON) observations (GGG2012/2014). We find standard deviations of 0.9, 0.9, 1.7, and 2.1 parts per million vs. TCCON for CT2013b, MACC, GOSAT, and SCIAMACHY, respectively, with the single observation errors 1.9 and 0.9 times the predicted errors for GOSAT and SCIAMACHY, respectively. We quantify how satellite error drops with data averaging by interpreting according to (error(sup 2) equals a(sup 2) plus b(sup 2) divided by n (with n being the number of observations averaged, a the systematic (correlated) errors, and b the random (uncorrelated) errors). a and b are estimated by satellites, coincidence criteria, and hemisphere. Biases at individual stations have year-to-year variability of 0.3 parts per million, with biases larger than the TCCON predicted bias uncertainty of 0.4 parts per million at many stations. We find that GOSAT and CT2013b under-predict the seasonal cycle amplitude in the Northern Hemisphere (NH) between 46 and 53 degrees North latitude, MACC over-predicts between 26 and 37 degrees North latitude, and CT2013b under-predicts the seasonal cycle amplitude in the Southern Hemisphere (SH). The seasonal cycle phase indicates whether a data set or model lags another data set in time. We find that the GOSAT measurements improve the seasonal cycle phase substantially over the prior while SCIAMACHY measurements improve the phase significantly for just two of seven sites. The models reproduce the measured seasonal cycle phase well except for at Lauder_125HR (CT2013b) and Darwin (MACC). We compare the variability within 1 day between TCCON and models in June-July-August; there is correlation between 0.2 and 0.8 in the NH, with models showing 10-50 percent the variability of TCCON at different stations and CT2013b showing more variability than MACC. This paper highlights findings that provide inputs to estimate flux errors in model assimilations, and places where models and satellites need further investigation, e.g., the SH for models and 45-67 degrees North latitude for GOSAT and CT2013b.

ACOS-GOSAT↗

Irrigation in the Earth System

Irrigation accounts for ~70% of global freshwater withdrawals and ~90% of consumptive water use, driving myriad Earth system impacts. In this Review, we summarize how irrigation currently impacts key components of the Earth system. Estimates suggest that more than 3.6 million km 2 of currently irrigated land, with hot spots in the intensively cultivated US High Plains, California Central Valley, Indo-Gangetic Basin and northern China. Process-based models estimate that ~2,700 ± 540 km 3 irrigation water is withdrawn globally each year, broadly consistent with country-reported values despite these estimates embedding substantial uncertainties. Expansive irrigation has modified surface energy balance and biogeochemical cycling. A shift from sensible to latent heat fluxes, and resulting land–atmosphere feedbacks, generally reduce regional growing season surface temperatures by ~1–3 °C. Irrigation can ameliorate temperature extremes in some regions, but conversely exacerbates moist heat stress. Modelled precipitation responses are more varied, with some intensive cropping regions exhibiting suppressed local precipitation but enhanced precipitation downstream owing to atmospheric circulation interactions. Additionally, irrigation could enhance cropland carbon uptake; however, it can also contribute to elevated methane fluxes in rice systems and mobilize nitrogen loading to groundwater. Cross-disciplinary, integrative research efforts can help advance understanding of these irrigation–Earth system interactions, and identify and reduce uncertainties, biases and limitations.

Climate sciences↗

Creation of the VADER Code in SCALE [Abstract]

The VADER (Validation Analysis Data Evaluation Resource) is a new module in SCALE 6.3 that has been derived from the legacy USLSTATS program. VADER is a tool that allows the determination of bias and bias uncertainty for criticality safety computational methods. The older USLSTATS program, written in Java, existed outside of SCALE and provided tools to calculate only the confidence band with administrative margin (sometimes called USL-1) and the single-sided uniform width closed interval (USL-2). For normality testing it only offered a crude chi- squared normality test that had no user-configurable options and presented a simple pass/no-pass functionality.

97 MATHEMATICS AND COMPUTING↗

An Overview of Wind Energy Production Prediction Bias, Losses, and Uncertainties

The financing of a wind farm directly relates to the preconstruction energy yield assessments which estimate the annual energy production for the farm. The accuracy and the precision of the preconstruction energy estimates can dictate the profitability of the wind project. Historically, the wind industry tended to overpredict the annual energy production of wind farms. Experts have been dedicated to eliminating such prediction errors in the past decade, and recently the industry is recording near-zero average energy prediction bias. Herein, we present an overview of the energy yield assessment errors across the global wind energy industry. We identify a long-term trend of reduction in the overprediction bias, whereas the uncertainty associated with the prediction error is prominent. We also summarize the recent advancements of the wind resource assessment process that justify the bias reduction, including the improvements in modeling and measurement techniques. Additionally, because the energy losses and uncertainties substantially influence the prediction error, we document and examine the estimated and observed loss and uncertainty values from the literature, according to the proposed framework in the International Electrotechnical Commission 61400-15 wind resource assessment standard. From our findings, we highlight the opportunities for the industry to move forward, such as the validation and reduction of prediction uncertainty, and the prevention of energy losses caused by wake effect and environmental events. Overall, this study provides a summary on how the wind energy industry has been quantifying and reducing prediction errors, energy losses, and production uncertainties. Finally, for this work to be as reproducible as possible, we include all of the data used in the analysis in appendices to the manuscript.

literature review↗

Estimating Sampling Biases and Measurement Uncertainties of AIRS-AMSU-A Temperature and Water Vapor Observations Using MERRA Reanalysis

We use MERRA (Modern Era Retrospective-Analysis for Research Applications) temperature and water vapor data to estimate the sampling biases of climatologies derived from the AIRS/AMSU-A (Atmospheric Infrared Sounder/Advanced Microwave Sounding Unit-A) suite of instruments. We separate the total sampling bias into temporal and instrumental components. The temporal component is caused by the AIRS/AMSU-A orbit and swath that are not able to sample all of time and space. The instrumental component is caused by scenes that prevent successful retrievals. The temporal sampling biases are generally smaller than the instrumental sampling biases except in regions with large diurnal variations, such as the boundary layer, where the temporal sampling biases of temperature can be +/- 2 K and water vapor can be 10% wet. The instrumental sampling biases are the main contributor to the total sampling biases and are mainly caused by clouds. They are up to 2 K cold and greater than 30% dry over mid-latitude storm tracks and tropical deep convective cloudy regions and up to 20% wet over stratus regions. However, other factors such as surface emissivity and temperature can also influence the instrumental sampling bias over deserts where the biases can be up to 1 K cold and 10% wet. Some instrumental sampling biases can vary seasonally and/or diurnally. We also estimate the combined measurement uncertainties of temperature and water vapor from AIRS/AMSU-A and MERRA by comparing similarly sampled climatologies from both data sets. The measurement differences are often larger than the sampling biases and have longitudinal variations.

MERRA↗

Sister Rod Destructive Examinations (FY23) Appendix F3: Uncertainty and Conservative Bias in the Cyclic Integrated Reversible-Bending Fatigue Test

The development and application of the Cyclic Integrated Reversible-Bending Fatigue Tester (CIRFT) has been documented over the past 10 years. The CIRFT system was developed in collaboration with the U.S. Nuclear Regulatory Commission (NRC) to address the concern that high-burnup fuel rod fatigue performance was degraded compared to cladding-only behavior. Fatigue data measured by CIRFT on high-burnup fuel rods were then used by the NRC to develop a fatigue response curve for pressurized water reactor fuel rods with Zircaloy-4 cladding in NUREG-2224. Subsequently, CIRFT has been used in the sister rod project to test whether reoriented hydrides associated with vacuum drying influenced the fatigue lifetime, to extend the fatigue testing database to include fuel rods with ZIRLO cladding, and to add to the experience on both Zircaloy-4 and M5 cladding. These data will be used as a reference for subsequent characterization of fuel rods removed from the high-burnup demonstration cask to better understand the effects of long-term dry storage, which can be thought of as a multiyear elevated temperature anneal. The objective of fatigue testing is to provide data that can be used to develop a best-estimate fatigue curve and a conservative fatigue design curve that accounts for uncertainty and can be compared with actual transportation conditions. The process for defining a design fatigue curve for commercial used fuel rods was developed by Oak Ridge National Laboratory (ORNL) in FY22. One issue noted in the fatigue evaluation was that the calculated combined uncertainty in the strain amplitude values determined from the measured data was large. It was proposed then to directly measure the uncertainty in the strain amplitude to either validate the calculated combined uncertainty or update the uncertainty based on the measurement data. Thus, the purpose of this appendix is to document the measured uncertainty in the strain amplitude data. In the process, it was determined that there has been a conservative bias in the calculated strain amplitude that is small enough to be within the measurement uncertainty. This observation is discussed herein, and a case is made to continue to include the conservative bias in the data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

E-Area Low Level Waste Generator Inventory Uncertainty Estimation

This report describes the method used to estimate the uncertainty and bias in the low-level waste inventory, as reported by Waste Generators, for waste disposed in the E-Area Low-Level Waste Facility at SRS. The waste cut uncertainty and bias is summed to calculate the current total uncertainty and bias in each disposal unit in the E-Area Low-Level Waste Facility. This information is used to estimate the future uncertainty and bias when all disposal units are closed. For most waste cuts, there are two areas of inventory uncertainty and bias: in the isotopic characterization of the waste stream and in the measurement of total waste cut activity. Waste stream characterization is accomplished through a combination of process knowledge and analytical measurements. This characterization is documented by a technical baseline that describes the relative quantity of each isotope present in the waste stream. The total activity of each individual waste cut is usually measured directly or is calculated through a ratio of activity per weight or activity per volume. The waste cut total activity is multiplied by the waste stream isotopic fraction to calculate the total isotopic activity present in the waste cut. The waste cut uncertainty and bias is calculated by analyzing the uncertainties and biases in the waste stream characterization and waste cut measurements and adding the uncertainties in quadrature and multiplying the reported isotopic activities by the bias factors. The current isotopic inventory, uncertainty, and bias of a disposal unit is the sum of the currently disposed individual waste cut isotopic activities, uncertainties, and biases. The future uncertainty and bias is estimated based on the average “worst-case” (largest) uncertainties and biases of currently closed and operational disposal units. This report details the method, data sources, and calculation techniques used to calculate these values. It also presents some of the difficulties in working with the reported data and gives examples of the calculations and analysis. The software used to carryout the analysis is included and the location of the complete individual analyses is given. After discussion with waste generators, examination of multiple waste characterization documents, and a review of SRS Manual 1S, the reported ELLWF radionuclide activities are clearly conservative and likely represent reasonable upper bounds for the true activities. However, quantifying the bias and uncertainty in each waste cut requires detailed analysis of the documentation for each waste cut measurement and waste stream characterization.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Comparative Analysis of Standard and Advanced USL Methodologies [Slides]

This presentation is on the comparative analysis of standard and advanced USL methodologies. Each method has a different way to address/account for experimental biases and uncertainties. This study showed why bias and uncertainty predictions by these popular methods differ significantly in some cases. In order to establish confidence to our validation efforts, especially with new reactor concepts, in designing new critical experiments and claiming experimental coverage for our existing applications, we need to understand capabilities of our methods further.

97 MATHEMATICS AND COMPUTING↗

The Dark Energy Camera Plane Survey 2 (DECaPS2): More Sky, Less Bias, and Better Uncertainties

Abstract Deep optical and near-infrared imaging of the entire Galactic plane is essential for understanding our Galaxy’s stars, gas, and dust. The second data release of the Dark Energy Camera (DECam) Plane Survey extends the five-band optical and near-infrared survey of the southern Galactic plane to cover 6.5% of the sky, ∣ b ∣ ≤ 10°, and 6° > ℓ > −124°, complementary to coverage by Pan-STARRS1. Typical single-exposure effective depths, including crowding effects and other complications, are 23.5, 22.6, 22.1, 21.6, and 20.8 mag in g , r , i , z , and Y bands, respectively, with around 1″ seeing. The survey comprises 3.32 billion objects built from 34 billion detections in 21,400 exposures, totaling 260 hr open shutter time on the DECam at Cerro Tololo. The data reduction pipeline features several improvements, including the addition of synthetic source injection tests to validate photometric solutions across the entire survey footprint. A convenient functional form for the detection bias in the faint limit was derived and leveraged to characterize the photometric pipeline performance. A new postprocessing technique was applied to every detection to debias and improve uncertainty estimates of the flux in the presence of structured backgrounds, specifically targeting nebulosity. The images and source catalogs are publicly available at http://decaps.skymaps.info/ .

79 ASTRONOMY AND ASTROPHYSICS↗