Search NASA⌕ Search

SEARCH · Search NASA

Results for “generalization error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

An Explicit Linear Filtering Solution for the Optimization of Guidance Systems with Statistical Inputs

The determination of optimum filtering characteristics for guidance system design is generally a tedious process which cannot usually be carried out in general terms. In this report a simple explicit solution is given which is applicable to many different types of problems. It is shown to be applicable to problems which involve optimization of constant-coefficient guidance systems and time-varying homing type systems for several stationary and nonstationary inputs. The solution is also applicable to off-design performance, that is, the evaluation of system performance for inputs for which the system was not specifically optimized. The solution is given in generalized form in terms of the minimum theoretical error, the optimum transfer functions, and the optimum transient response. The effects of input signal, contaminating noise, and limitations on the response are included. From the results given, it is possible in an interception problem, for example, to rapidly assess the effects on minimum theoretical error of such factors as target noise and missile acceleration. It is also possible to answer important questions regarding the effect of type of target maneuver on optimum performance.

Stewart, Elwood C.↗

The evolution of Crew Resource Management training in commercial aviation

In this study, we describe changes in the nature of Crew Resource Management (CRM) training in commercial aviation, including its shift from cockpit to crew resource management. Validation of the impact of CRM is discussed. Limitations of CRM, including lack of cross-cultural generality are considered. An overarching framework that stresses error management to increase acceptance of CRM concepts is presented. The error management approach defines behavioral strategies taught in CRM as error countermeasures that are employed to avoid error, to trap errors committed, and to mitigate the consequences of error.

Non-NASA Center↗

On Bayesian Inductive Inference & Predictive Estimation

We investigate Bayesian inference and the Principle of Maximum Entropy (PME) as methods for doing inference under uncertainty. This investigation is primarily through concrete examples that have been previously investigated in the literature. We find that it is possible to do Bayesian inference and PME inference using the same information, despite claims to the contrary, but that the results are not directly comparable. This is because Bayesian inference yields a probability density function (pdf) over the unknown model parameters, whereas PME yields point estimates. If mean estimates are extracted from the Bayesian pdfs, the resulting parameter estimates can differ radically from the PME values and also from the Maximum Likelihood values. We conclude that these differences are due to the Bayesian inference not assuming anything beyond the given prior probabilities and the data, whereas PME implicitly assumes that the given constraints are the only constraints that are operating. Since this assumption can be wrong, PME values may have to be revised when subsequent data shows evidence for more constraints. The entropy concentration previously "proved" by E. T. Jaynes is shown to be in error. Further, we show that PME is a generalized form of independence assumption, and so can be a very powerful method of inference when the variables being investigated are largely independent of each other.

Cheeseman, Peter↗

Towards Verification of Unstructured-Grid Solvers

New methodology for verification of computational methods using unstructured grids is presented. The discretization order properties are studied in computational windows, easily constructed within a collection of grids or a single grid. The windows can be adjusted to isolate the interior discretization, the boundary discretization, or singularities. A major component of the methodology is the downscaling test, introduced previously for studying the convergence rates of truncation and discretization errors of finite-volume discretization schemes on general unstructured grids. Demonstrations of the method are shown, including a comparative accuracy assessment of commonly-used schemes on general mixed grids and the identification of local accuracy deterioration at intersections of tangency and inflow/outflow boundaries. Recommendations for the use of the methodology in large-scale computational simulations are given.

Thomas, James L.↗

Software for Generating Strip Maps from SAR Data

Jurassicprok is a computer program that generates strip-map digital elevation models and other data products from raw data acquired by an airborne synthetic-aperture radar (SAR) system. This software can process data from a variety of airborne SAR systems but is designed especially for the GeoSAR system, which is a dual-frequency (P- and X-band), single-pass interferometric SAR system for measuring elevation both at the bare ground surface and top of the vegetation canopy. Jurassicprok is a modified version of software developed previously for airborne-interferometric- SAR applications. The modifications were made to accommodate P-band interferometric processing, remove approximations that are not generally valid, and reduce processor-induced mapping errors to the centimeter level. Major additions and other improvements over the prior software include the following: a) A new, highly efficient multi-stage-modified wave-domain processing algorithm for accurately motion compensating ultra-wideband data; b) Adaptive regridding algorithms based on estimated noise and actual measured topography to reduce noise while maintaining spatial resolution; c) Exact expressions for height determination from interferogram data; d) Fully calibrated volumetric correlation data based on rigorous removal of geometric and signal-to-noise decorrelation terms; e) Strip range-Doppler image output in user-specified Doppler coordinates; f) An improved phase-unwrapping and absolute-phase-determination algorithm; g) A more flexible user interface with many additional processing options; h) Increased interferogram filtering options; and i) Ability to use disk space instead of random- access memory for some processing steps.

Hensley, Scott↗

Lidar-Polarimeter Retrieval OSSEs in Support of NASA's Aerosols and Clouds-Convection-Precipitation (ACCP) Study

The 2017 Decadal Survey (DS) highlighted Earth System Science themes, science and application questions, and several high priority objectives that have led to the inclusion of Aerosols (A) and Clouds-Convection-Precipitation (CCP) as Designated Observables (DOs). On June 1, 2018, several NASA centers (GSFC, LaRC, JPL, MSFC, GRC and ARC) submitted a joint Study Plan to the NASA Earth Science Division for the Aerosol (A) and Cloud, Convection, and Precipitation (CCP) Pre-formulation Study (A-CCP). The DS and the A-CCP team recognized the science merit in combining the A and CCP DOs for both enhancing the ability to address a number of science objectives and also to provide an expanded capability to address additional objectives beyond those addressed by individual DOs.A critical element of the A-CCP observing strategy is to make extensive use of new passive and active sensors as well as of the so-called Program-of-Record (PoR), complemented by a fully integrated sub-orbital component. Central to this observing system design is the adoption of a Value Framework in which quantitative assessment of the science benefits of space-and air-borne assets is a key element. Given pre-defined A-CCP science objectives and geophysical variables with desired accuracies, A-CCP relies on a spectrum of Observing System Simulation Experiments (OSSEs) aimed at addressing pixel level retrieval uncertainties and sampling trade-offs. In this talk we will discuss a subset of Retrieval OSSEs being considered for A-CCP, namely, synergistic lidar-polarimeter retrievals of particular relevance for the A-CCP aerosol science objectives. Starting with aerosol states from the GEOS-5 Nature Run (G5NR) sampled along specific satellite orbits, we simulate polarized radiances at the desired polarimeter wavelengths with the Vector Linearized Direct Ordinate Radiative Transfer (VLIDORT) model, alongside the lidar signal for the relevant lidars with realistic error characterization. Next, inversions are performed with the Generalized Retrieval of Aerosol and Surface Properties (GRASP) system and the accuracy of the retrieved geophysical variables are assessed. In this presentation we will highlight results for key architectures being considered for A-CCP.

da Silva, Arlindo↗

Lidar-Polarimeter Retrieval OSSEs using a Nature Run in Support of NASA's Aerosols, Clouds, Convection and Precipitation (ACCP) Study

The 2017 Decadal Survey (DS) highlighted Earth System Science themes, science and application questions, and several high priority objectives that have led to the inclusion of Aerosols (A) and Clouds-Convection-Precipitation (CCP) as Designated Observables (DOs). On June 1, 2018, several NASA centers (GSFC, LaRC, JPL, MSFC, GRC and ARC) submitted a joint Study Plan to the NASA Earth Science Division for the Aerosol (A) and Cloud, Convection, and Precipitation (CCP) Pre-formulation Study (ACCP). The DS and the ACCP team recognized the science merit in combining the A and CCP DOs for both enhancing the ability to address a number of science objectives and also to provide an expanded capability to address additional objectives beyond those addressed by individual DOs. A critical element of the ACCP observing strategy is to make extensive use of new passive and active sensors as well as of the so-called Program-of-Record (PoR), complemented by a fully integrated sub-orbital component. Central to this observing system design is the adoption of a Value Framework in which quantitative assessment of the science benefits of space- and air-borne assets is a key element. Given pre-defined ACCP science objectives and geophysical variables with desired accuracies, ACCP relies on a spectrum of Observing System Simulation Experiments (OSSEs) aimed at addressing pixel level retrieval uncertainties and sampling trade-offs. In this talk we will discuss a subset of Retrieval OSSEs being considered for ACCP, namely, synergistic lidar-polarimeter retrievals based on observation simulations from the GEOS-5 Nature Run (G5NR). Starting with aerosol states from the GEOS-5 Nature Run (G5NR) sampled along specific satellite orbits, we simulate polarized radiances at the desired polarimeter wavelengths with the Vector Linearized Direct Ordinate Radiative Transfer (VLIDORT) model, alongside the lidar signal for the relevant lidars with realistic error characterization. Next, inversions are performed with the Generalized Retrieval of Aerosol and Surface Properties (GRASP) system and the accuracy of the retrieved geophysical variables are assessed. In this presentation we will highlight results for key architectures being considered for ACCP with emphasis on geophysical variables of particular relevance to ACCP’s aerosol science objectives.

A Da Silva↗

Going beyond reliability to achieve robustness

Reliability is the ability to perform well and consistently. More formally, reliability is defined as the mathematical probability that a system does not fail during a specified time period under its specified operating conditions. The specified operating conditions often go beyond the nominal environment to include variations and challenges encountered in operational use. The difficulty is that systems are often operated outside of their specified operating conditions and, if they fail, the designers are in theory blameless. Unanticipated damaging events include internal failures, external disruptions in supporting systems, accidents, and repurposing. The most common explanation of a system failure is human error, which is usually the first assumption of the system designers. Robustness is the capability to perform without failure under a wide range of conditions that go beyond the specified operating conditions. The first step towards improving robustness would be to expand the system’s specified operating conditions to include a wider range of anticipated challenges, especially human error. Beyond this, there is a need for general approach to reduce the impact of unanticipated future events, the unknown unknowns, by improving the system’s general ability to cope. Robustness can be improved by providing additional processing capacity, larger flow control buffers, increased backup storage, more online redundancy, and more capable supervisory monitoring and control.

Harry W Jones↗

Uncertainty Analysis of Slug Calorimeters in the HyMETS Arc-Jet Facility

The objective of this work is to perform an uncertainty analysis of the deduced stagnation heat flux environment on a slug calorimeter for conditions that span the performance envelope of the Hypersonic Materials Environmental Test System arc-jet facility located at NASA Langley Research Center. Analytical solutions are developed for boundary-value problems on the slug element accounting for non-ideal effects, including spatial variation in the slug heat flux, multi-dimensional thermal conduction, and back-face losses, which departs from the state-of-the-art method derived from the American Society of Testing and Materials. Boundary-value problem definitions are informed by preliminary finite element thermal analysis of the slug calorimeter assembly (including both slug and housing) and just the slug element. The analytical solutions are presented in a general sense and in a truncated form from error analysis. Results are shown in optimizing and validating the analytical models against available slug back-face thermal data. The optimization results indicate that the appropriate epistemic uncertainty of the deduced stagnation heat flux on the slug calorimeter is at most±2.5% for both a high-and low-enthalpy test condition. In addition, a numerical approach is used to determine the aleatory (probabilistic) uncertainty component in the slug stagnation heat flux by applying a marching least-squares slope routine through the steady-state portion of the slug back-face thermal response. Results indicate a compromise between the number of samples and the filter frequency of slug back-face thermal data points when evaluating the standard deviation of the deduced stagnation heat flux statistics. When combining the mixed uncertainty, both aleatory and epistemic, the interval of uncertainty in the deduced stagnation heat flux is determined to be up to ±4%, which is at least a 60% reduction from the standard uncertainty used in the state-of-the-art method.

uncertainty↗

A Proposed Clock Synchronization Method for the Solar System Internet

Networked communications in space are necessary to achieve scalability in terms of the number of communicating nodes but also in terms of the overall system complexity. A key component to such a system is the ability to synchronize clocks, which is the focus of this paper. The so-called Solar System Internet (SSI) will be built upon Delay Tolerant Networking (DTN), which, in analogy to the Internet Protocol (IP), can be considered a suite of protocols necessary for networking in the space domain. Therefore, our goal is to extend this suite to include a DTN clock synchronization capability, analogous to the Network Time Protocol (NTP) used in the Internet. A motivating example of a network in space is NASA’s LunaNet, a vision for a multi-hop multi-path network extending to the moon wherein not all nodes will have direct connections to an authoritative reference clock. In this paper, we propose a general clock synchronization methodology and algorithm that could be used for LunaNet as well as more elaborate time-varying networks. In recent years, DTN has benefited from modeling efforts founded on the mathematical tool of sheaves. Here we continue this work to provide an approach to clock synchronization. Due to the time-varying nature of space networks, absolute consensus is not possible. However, the sheaf Laplacian provides a practical, distributed approach to approximating consensus by allowing data to diffuse through the network. In particular, the sheaf Laplacian is readily computable, lending our approach to implementation. Our approach is well suited to handle the difficulties of space networks. For instance, differences in clock accuracy mean certain nodes are more authoritative than others; we can account for these differences through hierarchies in the network, generalizing the strata in NTP. Furthermore, just as error estimation is an integral part of NTP, we are able to give concrete error bounds for our approach. Indeed, different applications (e.g., communications schedules, pointing, navigation, distributed science) will have different requirements, hence it is necessary to maintain clocks within a given tolerance. We outline some of the necessary steps to turn our approach into a practical network protocol that could be used in DTN, and we conclude the paper with suggestions for future research.

Michael Moy↗

Misclassification in Workers’ Telecommuting Frequency Choices Using a Generalized Extreme Value Model

Telecommuting frequency is a response variable collected in travel surveys and is, therefore, prone to errors leading to mismeasurements or misclassification. Misclassification of explanatory variables is a common risk when using statistical modeling techniques. We define “misclassification” as a response reported or recorded in the wrong category; for example, a variable is recorded as a 1 when it should be 0. Here, in this context, this study aims to develop a statistical model to analyze telecommuting data which accounts for potential misclassification errors by building on existing literature in econometrics. The empirical analysis was undertaken using the 2017 National Household Travel Survey (NHTS) and the general extreme value (GEV) models available in the literature. Specifically, the frequency of telecommuting days was analyzed using the negative binomial (NB) model recast as the multinomial logit (MNL) model. By nature—and consistent with other studies—NHTS data are prone to errors that can be classified as intentional or unintentional misinformation provided by the person being interviewed. Ignoring these errors while modeling telecommuting frequencies using standard discrete count models can result in biased parameter estimates. The misclassification parameter was calculated for both over-reporting and under-reporting scenarios. The misclassification errors can be as high as 14% over-reported and 10% under-reported, particularly for the neighboring values. Statistical fit comparison between the models shows that models that ignore misclassification have worse data fit and biased parameter estimates with significant policy implications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Satellite Orbital Drag During Magnetic Storms

We investigate satellite orbital drag effects at lowEarth orbit associated with thermosphere heating during magnetic storms caused by coronal mass ejections. CHAllenge Minisatellite Payload (CHAMP) and Gravity Recovery And Climate Experiment (GRACE) neutral density data are used to compute orbital drag. Stormtoquiet density comparisons are performed with background densities obtained by the JacchiaBowman 2008 (JB2008) empirical model. Our storms are grouped in different categories regarding their intensities as indicated by minimum values of the SYMH index. We then perform superposed epoch analyses with storm main phase onset as zero epoch time. In general, we find that orbital drag effects are larger for CHAMP (lower altitudes) in comparison to GRACE (higher altitudes). Results show that storm time drag effects manifest first at high latitudes, but for extreme storms, particularly observed by GRACE, stronger orbital drag effects occur during early main phase at low/equatorial latitudes, probably due to heating propagation from high latitudes. We find that storm time orbital decay along the satellites' path generally increases with storm intensity, being stronger and faster for the most extreme events. For these events, orbital drag effects decrease faster probably due to elevated cooling effects caused by nitric oxide, which introduce modeled density uncertainties during storm recovery phase. Errors associated with total orbit decay introduced by JB2008 are generally the largest for the strongest storms and increase during storm times, particular during recovery phases. We discuss the implication of these uncertainties for the prediction of collision between space objects at lowEarth orbit during magnetic storms.

Oliveira, D. M.↗

Technical approaches for measurement of human errors

Human error is a significant contributing factor in a very high proportion of civil transport, general aviation, and rotorcraft accidents. The technical details of a variety of proven approaches for the measurement of human errors in the context of the national airspace system are presented. Unobtrusive measurements suitable for cockpit operations and procedures in part of full mission simulation are emphasized. Procedure, system performance, and human operator centered measurements are discussed as they apply to the manual control, communication, supervisory, and monitoring tasks which are relevant to aviation operations.

Clement, W. F.↗

Quantum error mitigation by layerwise Richardson extrapolation

A widely used method for mitigating errors in noisy quantum computers is Richardson extrapolation, a technique in which the overall effect of noise on the estimation of quantum expectation values is captured by a single parameter that, after being scaled to larger values, is eventually extrapolated to the zero-noise limit. We generalize this approach by introducing layerwise Richardson extrapolation (LRE), an error mitigation protocol in which the noise of different individual layers (or larger chunks of the circuit) is amplified and the associated expectation values are linearly combined to estimate the zero-noise limit. The coefficients of the linear combination are analytically obtained from the theory of multivariate Lagrange interpolation. LRE leverages the flexible configurational space of layerwise unitary folding, allowing for a more nuanced mitigation of errors by treating the noise level of each layer of the quantum circuit as an independent variable. Furthermore, we provide numerical simulations demonstrating scenarios where LRE achieves superior performance compared to traditional (single-variable) Richardson extrapolation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

On the representation and estimation of spatial uncertainty

This paper describes a general method for estimating the nominal relationship and expected error (covariance) between coordinate frames representing the relative locations of objects. The frames may be known only indirectly through a series of spatial relationships, each with its associated error, arising from diverse causes, including positioning errors, measurement errors, or tolerances in part dimensions. This estimation method can be used to answer such questions as whether a camera attached to a robot is likely to have a particular reference object in its field of view. The calculated estimates agree well with those from an independent Monte Carlo simulation. The method makes it possible to decide in advance whether an uncertain relationship is known accurately enough for some task and, if not, how much of an improvement in locational knowledge a proposed sensor will provide. The method presented can be generalized to six degrees of freedom and provides a practical means of estimating the relationships (position and orientation) among objects, as well as estimating the uncertainty associated with the relationships.

Smith, Randall C.↗

Summary and Annotated Bibliography of Measurement Error Corrections with Potential Application in Future Quesst Mission Community Noise Studies

This document is motivated by likely needs of the Quesst mission community response tests, which will culminate in data collection and estimation of dose-response regression relationships for consideration by domestic and international aviation regulators. Furthermore, basic research questions evaluating interactions between rates of community annoyance, dose levels, and indicators of the presence of rattle, vibration, and startle hinge on hypothesis testing in the context of regression models. For a variety of reasons, noise doses may be known only imprecisely and may not reflect the actual level experienced by responding subjects. These differences between true dose and estimated dose, be they systematic or random, constitute covariate measurement error. Available statistics literature speaks to the impacts of measurement error on regression models, both in terms of bias in estimated coefficients and predicted values, and in terms of the loss of statistical power for hypothesis testing. Given the particulars of a categorical annoyance response variable and a continuous noise dose predictor variable subject to measurement error during testing, the emphasis of this report is on findings and methods pertinent to generalized linear (and mixed) models likely to be employed during the Quesst mission community tests. We reach the following conclusions: 1. Of four reviewed methods, structural Bayesian measurement error models and simulation extrapolation (SIMEX) may be the most readily applicable to Quesst mission community noise study objectives. 2. If warranted, a linear measurement model can help model systematic sources of measurement error that the classical measurement error does not. 3. For its ready implementation and small additional input requirements, simulation extrapolation may be ideally suited for addressing secondary research questions involving interactions between annoyance, noise dose, and other factors through hypothesis testing. 4. For their flexibility and ability to propagate uncertainty, structural Bayesian hierarchical models have great appeal for mission purposes; some care may be needed in developing appropriate probability models describing actual noise exposure during testing. An annotated bibliography logs additional papers and resources that may be of value to analysts in other projects and disciplines.

Dose-Response Model↗

A Complementary Note to 'A Lag-1 Smoother Approach to System-Error Estimation': The Intrinsic Limitations of Residual Diagnostics

Recently, this author studied an approach to the estimation of system error based on combining observation residuals derived from a sequential filter and fixed lag-1 smoother. While extending the methodology to a variational formulation, experimenting with simple models and making sure consistency was found between the sequential and variational formulations, the limitations of the residual-based approach came clearly to the surface. This note uses the sequential assimilation application to simple nonlinear dynamics to highlight the issue. Only when some of the underlying error statistics are assumed known is it possible to estimate the unknown component. In general, when considerable uncertainties exist in the underlying statistics as a whole, attempts to obtain separate estimates of the various error covariances are bound to lead to misrepresentation of errors. The conclusions are particularly relevant to present-day attempts to estimate observation-error correlations from observation residual statistics. A brief illustration of the issue is also provided by comparing estimates of error correlations derived from a quasi-operational assimilation system and a corresponding Observing System Simulation Experiments framework.

Fixed-lag smoothing↗

Determination of the ocean circulation using Geosat altimetry

A spherical harmonic model of the sea surface topography complete to degree and order 10 and a model of the earth's geopotential field complete to degree and order 50 have been obtained in a simultaneous solution using Geosat altimeter data and tracking data from 14 different satellites. The sea surface topography model compares well with oceanographic models computed using hydrographic data and ship drift data. Currently, errors in the estimated gravity field model limit the determination of the spherical harmonic coefficients of the general ocean circulation to degrees 10 and lower, corresponding to a minimum wavelength of 4000 km. Error analysis indicates that the correlation between the geoid and the sea surface topography model is less than 0.2, indicating good separation of the geoid and the sea surface topography at wavelengths of 4000 km or longer. Estimates of the scale factor for the significant wave height (H1/3), which is used to compute the electromagnetic bias correction and the bias for the Geosat altimeter, are obtained. The estimate of the H1/3 correction is 3.6 + or - 1.5 percent, and the height bias estimate is zero.

Nerem, R. S.↗