Search NASA⌕ Search

SEARCH · Search NASA

Results for “reliability estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Toward Automatic Verification of Goal-Oriented Flow Simulations

We demonstrate the power of adaptive mesh refinement with adjoint-based error estimates in verification of simulations governed by the steady Euler equations. The flow equations are discretized using a finite volume scheme on a Cartesian mesh with cut cells at the wall boundaries. The discretization error in selected simulation outputs is estimated using the method of adjoint-weighted residuals. Practical aspects of the implementation are emphasized, particularly in the formulation of the refinement criterion and the mesh adaptation strategy. Following a thorough code verification example, we demonstrate simulation verification of two- and three-dimensional problems. These involve an airfoil performance database, a pressure signature of a body in supersonic flow and a launch abort with strong jet interactions. The results show reliable estimates and automatic control of discretization error in all simulations at an affordable computational cost. Moreover, the approach remains effective even when theoretical assumptions, e.g., steady-state and solution smoothness, are relaxed.

Simulations↗

Estimating the Concentration of Large Raindrops from Polarimetric Radar and Disdrometer Observations

Estimation of rainfall integral parameters, including radar observables, and empirical relations between them are sensitive to the truncation of the drop size distribution (DSD), particularly at the large drop end. The sensitivity of rainfall integral parameters to the maximum drop diameter (D(sub max)) is exacerbated at C‐band since resonance effects are pronounced for large drops in excess of 5 mm diameter (D). Due to sampling limitations, it is often difficult to reliably estimate D(sub max) with disdrometers. The resulting uncertainties in D(sub max0 potentially increase errors in radar retrieval methods, particularly at C‐band, that rely on disdrometer observations for DSD input to radar models. In fact, D(sub max) is typically an assumed DSD parameter in the development of radar retrieval methods. Because of these very uncertainties, it is difficult to independently confirm disdrometer estimates of D(sub max) with polarimetric radar observations. A couple of approaches can be taken to reduce uncertainty in large drop measurement. Longer integration times can be used for the collection of larger disdrometer samples. However, integration periods must be consistent with a radar resolution volume (RRV) and the temporal and spatial scales of the physical processes affecting the DSD therein. Multiple co‐located disdrometers can be combined into a network to increase the sample size within a RRV. However, over a reasonable integration period, a single disdrometer sample volume is many orders of magnitudes less than a RRV so it is not practical to devise a network of disdrometers that has an equivalent volume to a typical RRV. Since knowledge of DSD heterogeneity and large drop occurrence in time and space is lacking, the specific accuracy or even general representativeness of disdrometer based D(sub max) and large drop concentration estimates within a RRV are currently unknown. To address this complex issue, we begin with a simpler question. Is the frequency of occurrence of large rain drops (D > 5 mm) in disdrometer observations, either stand alone or networked, generally representative and consistent with polarimetric radar observations? We first show from simulations that the concentration of large (D > 5 mm) rain drops (N(sub T5)) can be estimated from polarimetric observations of specific differential phase (K(sub dp)) and differential reflectivity (Z(sub dr)), N(sub T5)=F(K(sub dp),Z(sub dr)), or horizontal reflectivity (Z(sub h)) and Z(sub dr), N(sub T5)=(Z(sub h),Z(sub dr)). We assess the error associated with polarimetric retrieval of N(sub T5), including sensitivity to D(sub max) parameterization assumptions and measurement error in the radar simulations. Polarimetric measurements at S‐band and C‐band will then be used to retrieve estimates of N(sub T5) and compared to disdrometer estimates of N(sub T5). After careful consideration of retrieval error, we will check consistency between disdrometer and polarimetric radar estimates of N(sub T5) and the frequency of occurrence of large rain drops in a variety of precipitating regimes using data from NASA's Global Precipitation Measurement (GPM) Ground Validation (GV) program, including field campaigns such as MC3E (Oklahoma) and IFloodS (Iowa) and extended measurements over Huntsville, Alabama and NASA Wallops Flight Facility in coastal Virginia.

Carey, Lawrence D.↗

Singular spectrum analysis in nonlinear dynamics, with applications to paleoclimatic time series

Two dimensions of a dynamical system given by experimental time series are distinguished. Statistical dimension gives a theoretical upper bound for the minimal number of degrees of freedom required to describe the attractor up to the accuracy of the data, taking into account sampling and noise problems. The dynamical dimension is the intrinsic dimension of the attractor and does not depend on the quality of the data. Singular Spectrum Analysis (SSA) provides estimates of the statistical dimension. SSA also describes the main physical phenomena reflected by the data. It gives adaptive spectral filters associated with the dominant oscillations of the system and clarifies the noise characteristics of the data. SSA is applied to four paleoclimatic records. The principal climatic oscillations and the regime changes in their amplitude are detected. About 10 degrees of freedom are statistically significant in the data. Large noise and insufficient sample length do not allow reliable estimates of the dynamical dimension.

Vautard, R.↗

The abcd Reliability Growth Model

This paper presents a modification of the well-known Duane-Crow reliability growth model. In the abcd reliability growth model, the initial period of exponential decline of the failure rate in the Duane-Crow model may be followed by a period of constant failure rate. Data often show that an exponential decline in failures is followed by a constant failure rate. If a growth model including only the initial period of exponential decline is applied to increasingly longer failure rate data sets, the data will include longer periods of constant failure rate, and the estimated reliability growth rate will decline from an initially high value down toward zero. Using the Duane-Crow model without extending it to include a possible period of constant failure rate may create the mistaken impression that the initial reliability growth continues forever, but at an ever decreasing rate.

Reliability growth↗

The abcd Reliability Growth Model

This paper presents a modification of the well-known Duane-Crow reliability growth model. In the abcd reliability growth model, the initial period of exponential decline of the failure rate in the Duane-Crow model may be followed by a period of constant failure rate. Data often show that an exponential decline in failures is followed by a constant failure rate. If a growth model including only the initial period of exponential decline is applied to increasingly longer failure rate data sets, the data will include longer periods of constant failure rate, and the estimated reliability growth rate will decline from an initially high value down toward zero. Using the Duane-Crow model without extending it to include a possible period of constant failure rate may create the mistaken impression that the initial reliability growth continues forever, but at an ever decreasing rate.

Reliability growth↗

ORDEM2010 and MASTER-2009 Modeled Small Debris Population Comparison

The latest versions of the two premier orbital debris engineering models, NASA s ORDEM2010 and ESA s MASTER-2009, have been publicly released. Both models have gone through significant advancements since inception, and now represent the state-of-the-art in orbital debris knowledge of their respective agencies. The purpose of these models is to provide satellite designers/operators and debris researchers with reliable estimates of the artificial debris environment in near-Earth orbit. The small debris environment within the size range of 1 mm to 1 cm is of particular interest to both human and robotic spacecraft programs. These objects are much more numerous than larger trackable debris but are still large enough to cause significant, if not catastrophic, damage to spacecraft upon impact. They are also small enough to elude routine detection by existing observation systems (radar and telescope). Without reliable detection the modeling of these populations has always coupled theoretical origins with supporting observational data in different degrees. This paper details the 1 mm to 1 cm orbital debris populations of both ORDEM2010 and MASTER-2009; their sources (both known and presumed), current supporting data and theory, and methods of population analysis. Fluxes on spacecraft for chosen orbits are also presented and discussed within the context of each model.

Krisko, Paula H.↗

ORDEM 3.0 and MASTER-2009 Modeled Small Debris Population Comparison

The latest versions of the two premier orbital debris engineering models, NASA's ORDEM 3.0 and ESA's MASTER-2009, have been publicly released within the last year. Both models have gone through significant advancements since inception, and now represent the state-of-the-art in orbital debris knowledge of their respective agencies. The purpose of these models is to provide satellite designers/operators and debris researchers with reliable estimates of the artificial debris environment in near-Earth orbit. The small debris environment within the size range of 1 mm to 1 cm is of particular interest to both human and robotic spacecraft programs. These objects are much more numerous than larger trackable debris but are still large enough to cause significant, if not catastrophic, damage to spacecraft upon impact. They are also small enough to elude routine detection by existing observation systems (radar and telescope). Without reliable detection the modeling of these populations has always coupled theoretical origins with supporting observational data in different degrees. This paper describes the population generation and categorization of both ORDEM 3.0 and MASTER-2009; their sources (both known and presumed), current supporting data and theory, and methods of population verification. Fluxes on spacecraft for chosen orbits are presented and discussed. Future collaborative analysis is noted.

Krisko, P. H.↗

Connecting Satellite-Based Precipitation Estimates to Users

Beginning in 1997, the Merged Precipitation Group at NASA Goddard has distributed gridded global precipitation products built by combining satellite and surface gauge data. This started with the Global Precipitation Climatology Project (GPCP), then the Tropical Rainfall Measuring Mission (TRMM) Multi-satellite Precipitation Analysis (TMPA), and recently the Integrated Multi-satellitE Retrievals for the Global Precipitation Measurement (GPM) mission (IMERG). This 20+-year (and on-going) activity has yielded an important set of insights and lessons learned for making state-of-the-art precipitation data accessible to the diverse communities of users. Merged-data products critically depend on the input sensors and the retrieval algorithms providing accurate, reliable estimates, but it is also important to provide ancillary information that helps users determine suitability for their application. We typically provide fields of estimated random error, and recently reintroduced the quality index concept at user request. Also at user request we have added a (diagnostic) field of estimated precipitation phase. Over time, increasingly more ancillary fields have been introduced for intermediate products that give expert users insight into the detailed performance of the combination algorithm, such as individual merged microwave and microwave-calibrated infrared estimates, the contributing microwave sensor types, and the relative influence of the infrared estimate.

Huffman, George J.↗

Reliability with imperfect diagnostics

A reliability estimation method for systems that continually accumulate faults because of imperfect diagnostics is developed and an application for redundant digital avionics is presented. The present method assumes that if a fault does not appear in a short period of time, it will remain hidden until a majority of components are faulty and the system fails. A certain proportion of a component's faults are detected in a short period of time, and a description of their detection is included in the reliability model. A Markov model of failure during flight for a nonreconfigurable five-plex is presented for a sequence of one-hour flights followed by maintenance.

White, A. L.↗

ORDEM 3.0 and MASTER-2009 Modeled Small Debris Population Comparison

The latest versions of the two premier orbital debris engineering models, NASA's ORDEM 3.0 and ESA's MASTER-2009, have been publically released. Both models have gone through significant advancements since inception, and now represent the state-of-the-art in orbital debris knowledge of their respective agencies. The purpose of these models is to provide satellite designers/operators and debris researchers with reliable estimates of the artificial debris environment in low Earth orbit (LEO) to geosynchronous orbit (GEO). The small debris environment within the size range of 1 mm to 1 cm is of particular interest to both human and robotic spacecraft programs, particularly in LEO. These objects are much more numerous than larger trackable debris and can have enough momentum to cause significant, if not catastrophic, damage to spacecraft upon impact. They are also small enough to elude routine detection by existing observation systems (radar and telescope). Without reliable detection the modeling of these populations has always coupled theoretical origins with supporting observational data in different degrees. In this paper, we present and detail the 1 mm to 1 cm orbital debris populations from both ORDEM 3.0 and MASTER-2009 in LEO. We review population categories: particle sources for MASTER-2009, particle densities for ORDEM 3.0. We describe data sources and their uses, and supporting models. Fluxes on spacecraft for chosen orbits are also presented and discussed within the context of each model.

Krisko, P. H.↗

Model Evaluation of Methods for Estimating Surface Emissions and Chemical Lifetimes from Satellite Data

Column densities from satellite retrievals can provide valuable information for estimating emissions and chemical lifetimes objectively across the globe. To better understand the uncertainties associated with these estimates, we test four methods using simulated column densities from a point source: a box model approach, a 2D Gaussian fit, an Inverse Radius fit and an Exponentially-Modified Gaussian fit. The model results were simulated using the WRF and CAMx models for the year 2005, for a single point source outside Atlanta in Georgia, USA with specified emissions and three chemical scenarios: no chemical reactions, 12 h chemical lifetime and 1 h chemical lifetime. No other sources were included in the simulations. We find that the box model provides reliable estimates irrespective of plume speed and plume direction, if the plume speed and the chemical lifetime are known accurately. The 2D Gaussian fit was found to be sensitive to plume speed and direction, and requires omnidirectional dispersion in order to have a decent fit. However, the 2D Gaussian fit is only an approximate fit to the data, and the discrepancies mean that the results are dependent on the geographical domain used for the optimization. An Inverse Radius fit is introduced to correct this issue, which is found to provide improved emissions and lifetime estimates. The Exponentially-Modified Gaussian fit also gave improved estimates. It is however dependent on accurate plume rotation such that reported chemical lifetimes with this method could be significantly underestimated.

Emission inventory↗

Insight and Evidence Motivating the Simplification of Dual-Analysis Hybrid Systems into Single-Analysis Hybrid Systems

Many hybrid data assimilation systems currently used for NWP employ some form of dual-analysis system approach. Typically a hybrid variational analysis is responsible for creating initial conditions for high-resolution forecasts, and an ensemble analysis system is responsible for creating sample perturbations used to form the flow-dependent part of the background error covariance required in the hybrid analysis component. In many of these, the two analysis components employ different methodologies, e.g., variational and ensemble Kalman filter. In such cases, it is not uncommon to have observations treated rather differently between the two analyses components; recentering of the ensemble analysis around the hybrid analysis is used to compensated for such differences. Furthermore, in many cases, the hybrid variational high-resolution system implements some type of four-dimensional approach, whereas the underlying ensemble system relies on a three-dimensional approach, which again introduces discrepancies in the overall system. Connected to these is the expectation that one can reliably estimate observation impact on forecasts issued from hybrid analyses by using an ensemble approach based on the underlying ensemble strategy of dual-analysis systems. Just the realization that the ensemble analysis makes substantially different use of observations as compared to their hybrid counterpart should serve as enough evidence of the implausibility of such expectation. This presentation assembles numerous anecdotal evidence to illustrate the fact that hybrid dual-analysis systems must, at the very minimum, strive for consistent use of the observations in both analysis sub-components. Simpler than that, this work suggests that hybrid systems can reliably be constructed without the need to employ a dual-analysis approach. In practice, the idea of relying on a single analysis system is appealing from a cost-maintenance perspective. More generally, single-analysis systems avoid contradictions such as having to choose one sub-component to generate performance diagnostics to another, possibly not fully consistent, component.

Todling, Ricardo↗

A comparison of several methods of estimating the columnar electron content of the plasmasphere

Data from several different observation techniques are used to estimate the columnar electron content of the plasmasphere. The estimate is based upon the subtraction of the ionospheric electron content from the total content along the radio path from ground to the geostationary satellite ATS-6. The Radio Beacon Experiment on this satellite allows a very accurate determination of the total electron content up to the height of the satellite. For the ionospheric electron content (ground to appr. 2000 km) the following techniques are used: (1) Faraday effect on the ATS-6 signals, (2) differential Doppler effect on the signals of the low-orbiting NNSS satellites, (3) combination of bottomside and topside ionograms, and (4) extrapolation of bottomside ionograms. It is shown that the combination of group delay and Faraday effect data on the ATS-6 RBE signals provide the most reliable estimates of the columnar electron content of the plasmasphere. Data from low-orbiting satellites support this conclusion.

Davies, K.↗

Growth and reflectance characteristics of winter wheat canopies

A valuable input to crop growth and yield models would be estimates of current crop condition. If multispectral reflectance indicates crop condition, then remote sensing may provide an additional tool for crop assessment. The effects of nitrogen fertilization on the spectral reflectance and agronomic characteristics of winter wheat (Triticum aestivum L.) were determined through field experiments. Spectral reflectance was measured during the 1979 and 1980 growing seasons with a spectroradiometer. Agronomic data included total leaf N concentration, leaf chlorophyll concentration, stage of development, leaf area index (LAI), plant moisture, and fresh and dry phytomass. Nitrogen deficiency caused increased visible, reduced near infrared, and increased middle infrared reflectance. These changes were related to lower levels of chlorophyll and reduced leaf area in the N-deficient plots. Green LAI, an important descriptor of wheat canopies, could be reliably estimated with multispectral data. The potential of remote sensing in distinguishing stressed from healthy crops is demonstrated. Evidence suggests multispectral imagery may be useful for monitoring crop condition.

Hinzman, L. D.↗

Efficient Evaluation and Optimization of Structural Reliability

Use of approximations for calculating the structural failure probability under uncertainties is a necessary aspect. But efficient use of suitable approximations at different stages of reliability prediction and design makes this valuable tool practical for many large scale structures. This research addresses the modern approximation concepts and their utility in structural reliability estimation. Emphasis is placed on building higher order approximations using intervening variables to closely represent the nonlinear limit state functions. Several test problems with highly nonlinear performance functions are used to demonstrate the accuracy of the proposed method. Many of the structural problems are modeled and simulated using the finite element methods (FEM) for obtaining a detailed structural response. FEM is a computationally intensive numerical procedure with a large number of degrees of freedom. With an increase in the complexity of the structural model and the multidisciplinary nature of analyses, the number of limit states and their computation increases very significantly. The requirement of frequent repetitive analysis of the structure hinders the utility of any tool and discourages that approach from being used. One particular tool which faces this difficulty is the computation of the structural reliability under parametric uncertainties.

Grandhi, Ramana V.↗

Consistency of ARESE II Cloud Absorption Estimates and Sampling Issues

Data from three cloudy days (March 3, 21, 29, 2000) of the ARM Enhanced Shortwave Experiment II (ARESE II) were analyzed. Grand averages of broadband absorptance among three sets of instruments were compared. Fractional solar absorptances were approx. 0.21-0.22 with the exception of March 3 when two sets of instruments gave values smaller by approx. 0.03-0.04. The robustness of these values was investigated by looking into possible sampling problems with the aid of 500 nm spectral fluxes. Grand averages of 500 nm apparent absorptance cover a wide range of values for these three days, namely from a large positive (approx. 0.011) average for March 3, to a small negative (approximately -0.03) for March 21, to near zero (approx. 0.01) for March 29. We present evidence suggesting that a large part of the discrepancies among the three days is due to the different nature of clouds and their non-uniform sampling. Hence, corrections to the grand average broadband absorptance values may be necessary. However, application of the known correction techniques may be precarious due to the sparsity of collocated flux measurements above and below the clouds. Our analysis leads to the conclusion that only March 29 fulfills all requirements for reliable estimates of cloud absorption, that is, the presence of thick, overcast, homogeneous clouds.

Oreopoulos, L.↗

A Phenomenon-Based Decomposition of Model-Based Estimates of Boreal Winter ENSO Variability

Climate models are now routinely being used to simulate and predict climate variability on time scales ranging from sub-seasonal to seasonal and longer. As such, there are now long histories of such simulations and predictions spanning multiple decades and multiple ensemble members, both of which are crucial for separating climate signal from climate noise. A key focus of such runs has been the El Niño-Southern Oscillation (ENSO), spurred by recent improvements in our ability to predict such events, though questions remain as to how well climate models do beyond simply always predicting the “canonical” atmospheric response to an ENSO event—something simple statistical models already do reasonably well. This is a critical issue that needs addressing, given the importance of event-to-event differences for predicting regional impacts of ENSO teleconnections, and the need to justify the expense of running sophisticated climate models. Unfortunately, current diagnostic tools are not well suited for quantifying the different sources of variability associated with specific phenomena such as ENSO. More generally, while much effort has focused on addressing model bias, less has been done to address errors in second moment statistics—an issue whose importance is gaining increased attention particularly as we build climate prediction systems capable of taking advantage of forecasts of opportunity—a capability that requires reliable estimates of forecast uncertainty. In this report, we outline a phenomenon-based statistical decomposition of climate variance(in essence a detailed variance budget)that is specifically tailored to address the above questions by separating the variability (both the signal and noise) into that tied to the long-term average impact of a particular phenomenon(the composite mean) and the event-to-event(E2E) variability about the composite mean. In addition, we provide related decompositions of the correlations that allow us to quantify how much of the agreement with observations (the skill) comes from the composite mean as opposed to from the E2Evariability. As an example, we present the results of such a decomposition for ENSO based on simulations with the GEOS atmospheric general circulation model (AGCM), with a focus on the monthly mean impacts over North America during boreal winter(December –March). Here we take advantage of existing GEOS AGCM simulations that were produced as companion simulations to MERRA-2for the period 1980-2016. Comparisons are made throughout with MERRA-2.

ENSO↗

Prediction of coronary artery disease in patients undergoing operations for mitral valve degeneration

OBJECTIVES: We sought to develop and validate a model that estimates the risk of obstructive coronary artery disease in patients undergoing operations for mitral valve degeneration and to demonstrate its potential clinical utility. METHODS: A total of 722 patients (67% men; age, 61 +/- 12 years) without a history of myocardial infarction, ischemic electrocardiographic changes, or angina who underwent routine coronary angiography before mitral valve prolapse operations between 1989 and 1996 were analyzed. A bootstrap-validated logistic regression model on the basis of clinical risk factors was developed to identify low-risk (< or =5%) patients. Obstructive coronary atherosclerosis was defined as 50% or more luminal narrowing in one or more major epicardial vessels, as determined by means of coronary angiography. RESULTS: One hundred thirty-nine (19%) patients had obstructive coronary atherosclerosis. Independent predictors of coronary artery disease include age, male sex, hypertension, diabetes mellitus,and hyperlipidemia. Two hundred twenty patients were designated as low risk according to the logistic model. Of these patients, only 3 (1.3%) had single-vessel disease, and none had multivessel disease. The model showed good discrimination, with an area under the receiver-operating characteristic curve of 0.84. Cost analysis indicated that application of this model could safely eliminate 30% of coronary angiograms, corresponding to cost savings of $430,000 per 1000 patients without missing any case of high-risk coronary artery disease. CONCLUSION: A model with standard clinical predictors can reliably estimate the prevalence of obstructive coronary atherosclerosis in patients undergoing mitral valve prolapse operations. This model can identify low-risk patients in whom routine preoperative angiography may be safely avoided.

Non-NASA Center↗