Search NASASearch

SEARCH · Search NASA

Results for “Generalization error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Observations of fallibility in applications of modern programming methodologies

Errors, inconsistencies, or confusing points are noted in a variety of published algorithms, many of which are being used as examples in formulating or teaching principles of such modern programming methodologies as formal specification, systematic construction, and correctness proving. Common properties of these points of contention are abstracted. These properties are then used to pinpoint possible causes of the errors and to formulate general guidelines which might help to avoid further errors. The common characteristic of mathematical rigor and reasoning in these examples is noted, leading to some discussion about fallibility in mathematics, and its relationship to fallibility in these programming methodologies. The overriding goal is to cast a more realistic perspective on the methodologies, particularly with respect to older methodologies, such as testing, and to provide constructive recommendations for their improvement.

Gerhart, S. L.

Artemis I Optical Navigation System Performance

This paper summarizes the assessment of the Optical Navigation Flight Test Objective (FTO) during the flight of Artemis I. The Optical Navigation (OpNav) System was tested under a variety of range, target, and lighting conditions to evaluate the performance compared to the pre-flight predicted error models. In general, OpNav performed very well – successfully processing over a thousand images of starfields, Earth, and Moon. The performance of the algorithm when processing Moon images matched the pre-flight expected error models. The errors when processing Earth images were notably higher than the pre-flight models predicted, however this was found to be due to an over-estimation of the atmosphere bias used in the tuning of the algorithm. After the bias was re-tuned and the images reprocessed, performance significantly improved.

GNC

Optimal controllers for finite wordlength implementation

When a controller is implemented in a digital computer, with A/D and D/A conversion, the numerical errors of the computation can drastically affect the performance of the control system. There exists realizations of a given controller transfer function yielding arbitrarily large effects from computational errors. Since, in general, there is no upper bound, it is important to have a systematic way of reducing these effects. Optimum controller designs are developed which take account of the digital round-off errors in the controller implementation and in the A/D and D/A converters. These results provide a natural extension to the Linear Quadratic Gaussian (LQG) theory since they reduce to the standard LQG controller when infinite precision computation is used. But for finite precision the separation principle does not hold.

Liu, K.

Accuracy analysis of the semi-analytical method for shape sensitivity calculation

The semianalytical method of design sensitivity analysis that is widely used for calculating derivatives of static response with respect to design variables for structures modeled by finite elements is studied. It is shown that the method can have serious accuracy problems for shape design variables in structures modeled by beam, plate, truss, frame, and solid elements. Errors are shown to be associated with an incompatibility of the sensitivity field with the structure. An error index is developed to test the accuracy of the semianalytical method. It characterizes the difference in errors between a general finite-difference method and the semianalytical method. A method for improving the accuracy of the semianalytical method (when possible) is provided. Examples are presented to demonstrate the use of the error index.

Barthelemy, Bruno

Optimal controllers for finite wordlength implementation

There exist realizations of a given controller transfer function yielding arbitrarily large effects from computational errors. Since, in general, there is no upper bound, it is important to have a systematic way of reducing these effects. Optimum controller designs are developed which take into account the digital round-off errors in the controller implementation and in the A/D and D/A converters. These results provide a natural extension to the LQG (linear quadratic Gaussian) theory since they reduce to the standard LQG controller when infinite-precision computation is used, but for finite precision the separation principle does not hold.

Liu, K.

Improvement of Aerosol Optical Depth Retrieval from MODIS Spectral Reflectance over the Global Ocean Using New Aerosol Models Archived from AERONET Inversion Data and Tri-axial Ellipsoidal Dust Database

New over-ocean aerosol models are developed by integrating the inversion data from the Aerosol Robotic Network (AERONET) sun/sky radiometers with a database for the optical properties of tri-axial ellipsoid particles. The new aerosol models allow more accurate retrieval of aerosol optical depth (AOD) from the Moderate Resolution Imaging Spectroradiometer (MODIS) in the case of high AOD (AOD greater than 0.3). The aerosol models are categorized by using the fine-mode fraction (FMF) at 550 nm and the singlescattering albedo (SSA) at 440 nm from the AERONET inversion data to include a variety of aerosol types found around the globe. For each aerosol model, the changes in the aerosol optical properties (AOPs) as functions of AOD are considered to better represent aerosol characteristics. Comparisons of AODs between AERONET and MODIS for the period from 2003 to 2010 show that the use of the new aerosol models enhances the AOD accuracy with a Pearson coefficient of 0.93 and a regression slope of 0.99 compared to 0.92 and 0.85 calculated using the MODIS Collection 5 data. Moreover, the percentage of data within an expected error of +/-(0.03 + 0.05xAOD) is increased from 62 percent to 64 percent for overall data and from 39 percent to 51 percent for AOD greater than 0.3. Errors in the retrieved AOD are further characterized with respect to the Angstrom exponent (AE), scattering angle, SSA, and air mass factor (AMF). Due to more realistic AOPs assumptions, the new algorithm generally reduces systematic errors in the retrieved AODs compared with the current operational algorithm. In particular, the underestimation of fine-dominated AOD and the scattering angle dependence of dust-dominated AOD are significantly mitigated as results of the new algorithm's improved treatment of aerosol size distribution and dust particle nonsphericity.

aerosol optical depth

Accuracy analysis of the semi-analytical method for shape sensitivity calculation

The semianalytical method, widely used for calculating derivatives of static response with respect to design variables for structures modeled by finite elements, is studied in this paper. The paper shows that the method can have serious accuracy problems for shape design variables in structures modeled by beam, plate, truss, frame, and solid elements. The errors are shown to be associated with the structural model. An error index is developed to test the accuracy of the semianalytical method. It characterizes the difference in errors between a general finite-difference method and the semianalytical method. Moreover, a method for improving the accuracy of the semianalytical method (when possible) is provided. Examples are presented to demonstrate the use of the error index.

Barthelemy, Bruno

Quantifying Uncertainties in Land-Surface Microwave Emissivity Retrievals

Uncertainties in the retrievals of microwaveland-surface emissivities are quantified over two types of land surfaces: desert and tropical rainforest. Retrievals from satellite-based microwave imagers, including the Special Sensor Microwave Imager, the Tropical Rainfall Measuring Mission Microwave Imager, and the Advanced Microwave Scanning Radiometer for Earth Observing System, are studied. Our results show that there are considerable differences between the retrievals from different sensors and from different groups over these two land-surface types. In addition, the mean emissivity values show different spectral behavior across the frequencies. With the true emissivity assumed largely constant over both of the two sites throughout the study period, the differences are largely attributed to the systematic and random errors inthe retrievals. Generally, these retrievals tend to agree better at lower frequencies than at higher ones, with systematic differences ranging 1%-4% (3-12 K) over desert and 1%-7% (3-20 K) over rainforest. The random errors within each retrieval dataset are in the range of 0.5%-2% (2-6 K). In particular, at 85.5/89.0 GHz, there are very large differences between the different retrieval datasets, and within each retrieval dataset itself. Further investigation reveals that these differences are most likely caused by rain/cloud contamination, which can lead to random errors up to 10-17 K under the most severe conditions.

Land-Surface

Assessment of Computational Fluid Dynamics (CFD) Models for Shock Boundary-Layer Interaction

A workshop on the computational fluid dynamics (CFD) prediction of shock boundary-layer interactions (SBLIs) was held at the 48th AIAA Aerospace Sciences Meeting. As part of the workshop numerous CFD analysts submitted solutions to four experimentally measured SBLIs. This paper describes the assessment of the CFD predictions. The assessment includes an uncertainty analysis of the experimental data, the definition of an error metric and the application of that metric to the CFD solutions. The CFD solutions provided very similar levels of error and in general it was difficult to discern clear trends in the data. For the Reynolds Averaged Navier-Stokes methods the choice of turbulence model appeared to be the largest factor in solution accuracy. Large-eddy simulation methods produced error levels similar to RANS methods but provided superior predictions of normal stresses.

DeBonis, James R.

More On The Decoder-Error Probability Of Reed-Solomon Codes

Paper extends theory of decoder-error probability for linear maximum-distance separable (MDS) codes. General class of error-correcting codes includes Reed-Solomon codes, important in communications with distant spacecraft, military communications, and compact-disk recording industry. Advancing beyond previous theoretical developments that placed upper bounds on decoder-error probabilities, author derives an exact formula for probability PE(u) that decoder will make error when u code symbols in error.

Cheung, Kar-Ming

Integrated and spectral energetics of the GLAS general circulation model

Integrated and spectral error energetics of the Goddard Laboratory for Atmospheric Sciences (GLAS) general circulation model are compared with observations for periods in January 1975, 1976, and 1977. For two cases the model shows significant skill in predicting integrated energetics quantities out to two weeks, and for all three cases, the integrated monthly mean energetics show qualitative improvements over previous versions of the model in eddy kinetic energy and barotropic conversions. Fundamental difficulties remain with leakage of energy to the stratospheric level. General circulation model spectral energetics predictions are compared with the corresponding observational spectra on a day by day basis. Eddy kinetic energy can be correct while significant errors occur in the kinetic energy of wavenumber three. Single wavenumber dominance in eddy kinetic energy and the correlation of spectral kinetic and potential energy are demonstrated.

Tenenbaum, J.

Modeling the Uncertainties of Solar System Ephemerides for Robust Gravitational-wave Searches with Pular-timing Arrays

The regularity of pulsar emissions becomes apparent once we reference the pulses’ times of arrivals to the inertial rest frame of the solar system. It follows that errors in the determination of Earthʼs position with respect to the solar system barycenter can appear as a time-correlated bias in pulsar-timing residual time series, affecting the searches for low-frequency gravitational waves performed with pulsar-timing arrays. Indeed, recent array data sets yield different gravitational-wave background upper limits and detection statistics when analyzed with different solar system ephemerides. Crucially, the ephemerides do not generally provide usable error representations. In this article, we describe the motivation, construction, and application of a physical model of solar system ephemeris uncertainties, which focuses on the degrees of freedom (Jupiterʼs orbital elements) most relevant to gravitational-wave searches with pulsar-timing arrays. This model, BAYESEPHEM, was used to derive ephemeris-robust results in NANOGravʼs 11 yr stochastic-background search, and it provides a foundation for future searches by NANOGrav and other consortia. The analysis and simulations reported here suggest that ephemeris modeling reduces the gravitational-wave sensitivity of the 11 yr data set and that this degeneracy will vanish with improved ephemerides and with pulsar-timing data sets that extend well beyond a single Jovian orbital period.

M Vallisneri

Boundary-fitted coordinate systems for numerical solution of partial differential equations - A review

A comprehensive review of methods of numerically generating curvilinear coordinate systems with coordinate lines coincident with all boundary segments is given. Some general mathematical framework and error analysis common to such coordinate systems is also included. The general categories of generating systems are those based on conformal mapping, orthogonal systems, nearly orthogonal systems, systems produced as the solution of elliptic and hyperbolic partial differential equations, and systems generated algebraically by interpolation among the boundaries. Also covered are the control of coordinate line spacing by functions embedded in the partial differential operators of the generating system and by subsequent stretching transformation. Dynamically adaptive coordinate systems, coupled with the physical solution, and time-dependent systems that follow moving boundaries are treated. References reporting experience using such coordinate systems are reviewed as well as those covering the system development.

Thompson, J. F.

NASA’s Identified Risks of Adverse Outcomes Due to Inadequate Human Systems Integration Architecture in Human Spaceflight

The NASA Human System Risk Board (HSRB) has the overall responsibility for tracking the evolution of the top ~30 human system risks that it has identified to be associated with human spaceflight. As part of this process, the Board is charged with maintaining a consistent, integrated process to mitigate those risks, and developing evidence-based risk posture recommendations. One of the identified risks is due to inadequate human systems integration architecture (HSIA) and a driving factor of this risk is that given decreasing real-time ground support for execution of complex operations during future exploration missions, there is a possibility of adverse performance outcomes including that crew are unable to adequately respond to unanticipated critical malfunctions or detect safety critical procedural errors. The HSRB uses Directed Acyclic Graphs (DAGs) as a communication tool for describing how astronaut exposure to spaceflight hazards leads to meaningful mission-level health and performance outcomes and as the basis for understanding intermediate causal relationships between risk contributing factors and countermeasures that link hazards to outcomes. The HSIA risk DAG will be presented and described. Historically, critical malfunctions requiring Crew/MCC management occurred at a rate of 1.7 times per year for ISS averaged over the lifetime and 3-4 times per year in the burn in phase for the vehicle. These averages do not include EVA data, which greatly increases the incident rate. Prior experience from the Apollo program showed 10/11 crewed missions experienced significant anomalies where crew relied heavily on MCC expertise in real-time. These failure patterns are in line with those observed in other complex engineered systems (e.g., oil rigs, launch systems, commercial aviation, etc.) It is likely that general malfunction and error rates are > 10% for short duration missions (<30 days), based on past and current spaceflight operations data. Likelihood of adverse outcomes has the potential to increase as crew conduct work with new, complex systems and with less ground support. For Low Earth Orbit missions and Lunar missions less than 30 days, assuming minimal comm delays, disruptions and bandwidth limitations, malfunctions and errors can affect mission objectives and crew health but may be mitigated by ground support. For Lunar missions greater than 30 days and any potential Mars mission malfunctions and errors can have Loss of Crew and Loss of Mission consequences due to reduced ground support (communication delays, constraints and blackouts) for more complex operations, as well as reduced resupply and evacuation options.

Daniel M Buckland

Space Trajectories Error Analysis (STEAP) Programs. Volume 1: Analytic manual, update

Manual revisions are presented for the modified and expanded STEAP series. The STEAP 2 is composed of three independent but related programs: NOMAL for the generation of n-body nominal trajectories performing a number of deterministic guidance events; ERRAN for the linear error analysis and generalized covariance analysis along specific targeted trajectories; and SIMUL for testing the mathematical models used in the navigation and guidance process. The analytic manual provides general problem description, formulation, and solution and the detailed analysis of subroutines. The programmers' manual gives descriptions of the overall structure of the programs as well as the computational flow and analysis of the individual subroutines. The user's manual provides information on the input and output quantities of the programs. These are updates to N69-36472 and N69-36473.

Source record

Retrieval of thermodynamic variables with deep convective clouds Experiments in three dimensions

A three-dimensional numerical cloud model has been used to test a method for retrieving temperature and pressure deviation fields from detailed wind and water fields in deep convective clouds. A comparison of the retrieved fields with the output from the numerical model was used to test the validity of the theoretical treatment and accuracy of the programming. The local time derivatives of each of the velocity components are known to be potential problem sources in using Doppler radar data, and a test was done with this derivative estimated over a 4 min time span rather than 30 s, resulting in excellent agreement with the original solution for this data set. When the local derivative was eliminated, the solution was judged useful for general temperature patterns. Errors due to the inability to measure cloudwater mixing ratio and inaccuracies in rainwater mixing ratio were found to be significant, but not so severe as in the turbulence and steady-state sensitivity tests.

Hane, C. E.

Analysis of a resistance-energy balance method for estimating daily evaporation from wheat plots using one-time-of-day infrared temperature observations

Accurate estimates of evaporation over field-scale or larger areas are needed in hydrologic studies, irrigation scheduling, and meteorology. Remotely sensed surface temperature might be used in a model to calculate evaporation. A resistance-energy balance model, which combines an energy balance equation, the Penman-Monteith (1981) evaporation equation, and van den Honert's (1948) equation for water extraction by plant roots, is analyzed for estimating daily evaporation from wheat using postnoon canopy temperature measurements. Additional data requirements are half-hourly averages of solar radiation, air and dew point temperatures, and wind speed, along with reasonable estimates of canopy emissivity, albedo, height, and leaf area index. Evaporation fluxes were measured in the field by precision weighing lysimeters for well-watered and water-stressed wheat. Errors in computed daily evaporation were generally less than 10 percent, while errors in cumulative evaporation for 10 clear sky days were less than 5 percent for both well-watered and water-stressed wheat. Some results from sensitivity analysis of the model are also given.

Choudhury, B. J.