Search NASASearch

SEARCH · Search NASA

Results for “Generalization error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

AveBoost2: Boosting for Noisy Data

AdaBoost is a well-known ensemble learning algorithm that constructs its constituent or base models in sequence. A key step in AdaBoost is constructing a distribution over the training examples to create each base model. This distribution, represented as a vector, is constructed to be orthogonal to the vector of mistakes made by the pre- vious base model in the sequence. The idea is to make the next base model's errors uncorrelated with those of the previous model. In previous work, we developed an algorithm, AveBoost, that constructed distributions orthogonal to the mistake vectors of all the previous models, and then averaged them to create the next base model s distribution. Our experiments demonstrated the superior accuracy of our approach. In this paper, we slightly revise our algorithm to allow us to obtain non-trivial theoretical results: bounds on the training error and generalization error (difference between training and test error). Our averaging process has a regularizing effect which, as expected, leads us to a worse training error bound for our algorithm than for AdaBoost but a superior generalization error bound. For this paper, we experimented with the data that we used in both as originally supplied and with added label noise-a small fraction of the data has its original label changed. Noisy data are notoriously difficult for AdaBoost to learn. Our algorithm's performance improvement over AdaBoost is even greater on the noisy data than the original data.

Oza, Nikunj C.

Performance analysis of a generalized concurrent error detection procedure

A general procedure for error detection in complex systems, called the data block capture and analysis monitoring process, is described and analyzed. It is assumed that, in addition to being exposed to potential external fault sources, a complex system will in general always contain embedded hardware and software fault mechanisms which can cause the system to perform incorrect computations and/or produce incorrect output. Thus, in operation, the system continuously moves back and forth between error and no-error states. These external fault sources or internal fault mechanisms are extremely difficult to detect. The data block capture and analysis monitoring process is concerned with detecting deviations from the normal performance of the system, known as errors, which are symptomatic of fault conditions. The process consists of repeatedly recording a fixed amount of data from a set of predetermined observation lines of the system being monitored (i.e., capturing a block of data) and then analyzing the captured block in an attempt to determine whether the system is functioning correctly. The performances of linear, quadratic, and logarithmic data analysis algorithms are rigorously characterized in terms of the probability of correctly detecting an error, the expectation and variance of the number of false alarms per error, and the expectation and variance of the latency in detection of errors. Insight into the nature of the general problem of error detection is obtained.

Blough, Douglas M.

An extremum principle for computation of the zone of tooth contact and generalized transmission error of spiral bevel gears

For a given set of forces transmitted by the gears, each of the three components of the generalized transmission error of spiral bevel gears is shown to be stationary with respect to small independent variations in the positions of the endpoints of the lines of tooth contact about their true values. The tangential generalized transmission error component is shown to take on a minimum value at the true endpoint positions. A computational procedure based on the method of steepest descent is described for computing the true line of contact endpoint positions and the three components of the generalized transmission error. A method for computing the Fourier series coefficients of the tooth meshing harmonics of the three generalized transmission error components also is provided.

Mark, W. D.

Use of the generalized transmission error in the equations of motion of gear systems

The vibratory excitation arising from a gear pair is widely recognized to be a consequence of the nonuniform transmission of motion by the gear pair. In the preceding paper in this issue, it is shown that a three-component transmission error is required to describe the nonuniform transmission of motion by bevel gears for vibration excitation characterization purposes. The expression for the three-component transmission error derived in that paper is combined in the present paper with an analysis of the mesh forces and mesh elasticity to yield an equation of constraint involving the six degree-of-freedom unknown vibratory displacements of the gear shaft centerliners, the three unknown components of the generalized force transmitted by the mesh, and the geometric deviations of the tooth running surfaces from perfect involute surfaces which are assumed known. This matrix equation can be combined with the equations of motion of a gear system to predict the vibratory response of the system to the generalized transmission error excitation arising from meshing gear pairs within the system.

Mark, W. D.

Jet stream velocity errors in general circulation models

The longitude and time dependence of excessive wind speed errors above subtropical jets in current GCM forecasts is studied for 14 five-day winter forecasts using the NASA Goddard Laboratory for Atmospheres fourth-order GCM. Several distinct phenomena, which may be divided into four categories, are found to contribute to the excess winds. These categories are: (1) error growth above the jet near the Himalayas; (2) error growth above the jet initiated elsewhere followed by advection; (3) tropical moisture bursts appearing in equatorial regions and migrating northeastward to merge with and distort the jet; and (4) undulatory growth of waves in the meridional component of the jet stream velocity. The results of additional sensitivity studies of the Himalayan region error are also reported.

Tenenbaum, J.

Attitude determination error analysis - General model and specific application

This paper presents a comprehensive approach to filter and dynamics modeling for attitude determination error analysis. The discussion includes models for both batch least-squares and sequential estimators, a specific dynamic model for attitude determination error analysis of a three-axis stabilized spacecraft equipped with strapdown gyros, and the incorporation of general attitude sensor observations. An analyst using this approach to perform an error analysis chooses a subset of the spacecraft parameters to be 'solve-for' parameters, which are to be estimated, and another subset to be 'consider' parameters, which are assumed to have errors but not to be estimated. The result of the error analysis is an indication of overall uncertainties in the 'solve-for' parameters, as well as the contributions of the various error sources to these uncertainties, including those of errors in the a priori 'solve-for' estimates, of measurement noise, of dynamic noise (also known as process noise or plant noise), and of 'consider' parameter uncertainties. The analysis of attitude, star tracker alignment, and gyro bias uncertainties for the Gamma Ray Observatory spacecraft provide a specific example of the use of a general-purpose software package incorporating these models.

Markley, F. Landis

The generalized transmission error of spiral bevel gears

The traditional definition of the transmission error of parallel-axis gear pairs is reviewed and shown to be unsuitable for characterizing the deviation from conjugate action of bevel gear pairs for vibration excitation characterization purposes. This situation is rectified by generalizing the concept of the transmission error of parallel-axis gears to a three-component transmission error for spiral bevel gears of nominal spherical involute design. A general relationship is derived which expresses the contributions to the three-component transmission error from each gear of a meshing spiral bevel pair as a linear transformation of the six coordinates that describe the deviation of the shaft centerline position of each gear of the pair from the position of its rigid perfect involute counterpart.

Mark, W. D.

TRMM On-Orbit Performance Re-Accessed After Control Change

The Tropical Rainfall Measuring Mission (TRMM) spacecraft, a joint mission between the U.S. and Japan, launched onboard an HI1 rocket on November 27,1997 and transitioned in August, 2001 from an average operating altitude of 350 kilometers to 402.5 kilometers. Due to problems using the Earth Sensor Assembly (ESA) at the higher altitude, TRMM switched to a backup attitude control mode. Prior to the orbit boost TRMM controlled pitch and roll to the local vertical using ESA measurements while using gyro data to propagate yaw attitude between yaw updates from the Sun sensors. After the orbit boost, a Kalman filter used 3-axis gyro data with Sun sensor and magnetometers to estimate onboard attitude. While originally intended to meet a degraded attitude accuracy of 0.7 degrees, the new control mode met the original 0.2 degree attitude accuracy requirement after improving onboard ephemeris prediction and adjusting the magnetometer calibration onboard. Independent roll attitude checks using a science instrument, the Precipitation Radar (PR) which was built in Japan, provided a novel insight into the pointing performance. The PR data helped identify the pointing errors after the orbit boost, track the performance improvements, and show subtle effects from ephemeris errors and gyro bias errors. It also helped identify average bias trends throughout the mission. Roll errors tracked by the PR from sample orbits pre-boost and post-boost are shown in Figure 1. Prior to the orbit boost the largest attitude errors were due to occasional interference in the ESA. These errors were sometime larger than 0.2 degrees in pitch and roll, but usually less, as estimated from a comprehensive review of the attitude excursions using gyro data. Sudden jumps in the onboard roll show up as spikes in the reported attitude since the control responds within tens of seconds to null the pointing error. The PR estimated roll tracks well with an estimate of the roll history propagated using gyro data. After the orbit boost, the attitude errors shown by the PR roll have a smooth sine-wave type signal because of the way that attitude errors propagate with the use of gyro data. Yaw errors couple at orbit period to roll with '/4 orbit lag. By tracking the amplitude, phase, and bias of the sinusoidal PR roll error signal, it was shown that the average pitch rotation axis tends to be offset from orbit normal in a direction perpendicular to the Sun direction, as shown in Figure 2 for a 200 day period following the orbit boost. This is a result of the higher accuracy and stability of the Sun sensor measurements relative to the magnetometer measurements used in the Kalman filter. In November, 2001 a magnetometer calibration adjustment was uploaded which improved the pointing performance, keeping the roll and yaw amplitudes within about 0.1 degrees. After the boost, onboard ephemeris errors had a direct effect on the pitch pointing, being used to compute the Earth pointing reference frame. Improvements after the orbit boost have kept the the onboard ephemeris errors generally below 20 kilometers. Ephemeris errors have secondary effects on roll and yaw, especially during high beta angle when pitch effects can couple into roll and yaw. This is illustrated in figure 3. The onboard roll bias trends as measured by PR data show correlations with the Kalman filter's gyro bias error. This particularly shows up after yaw turns (every 2 to 4 weeks) as shown in Figure 3, when a slight roll bias is observed while the onboard computed gyro biases settle to new values. As for longer term trends, the PR data shows that the roll bias was influenced by Earth horizon radiance effects prior to the boost, changing values at yaw turns, and indicated a long term drift as shown in Figure 4. After the boost, the bias variations were smaller and showed some possible correlation with solar beta angle, probably due to sun sensor misalignment effects.

Bilanow, Steve

Error analysis of multi-conic techniques

A general error analysis of three recently developed multi-conic methods of three-body trajectory integration has been carried out. Single-step error functions for position and velocity have been derived as Taylor series in powers of the time step and also in integral form. These error functions are used to investigate the relative accuracy of the three methods in various regions of the earth-moon space and to provide a method of variable step size control for the trajectory integration procedure. Numerical results are used to compare the multi-step performance of the methods for both large and small step sizes.

D'Amario, L. A.

A general analysis of anti-jam communication systems

A general error bound is derived for a general anti-jam communication system which will serve as the basis for evaluating the performance of all such complex communication systems. The two most common spread spectrum techniques, coherent DS/BPSK and noncoherent FH/MFSK, are analyzed. Pulse jamming represents the worst type of jammer for DS/BPSK systems, and several receiver structures against such a jammer are examined. It is found that for low values of chip energy-to-noise ratios of O dB or less there is little difference between having or not having jammer state knowledge with a hard decision receiver. Soft decision receivers are shown to be useless against very narrow pulses without jammer state knowledge. Partial band jammers are close to the worst case jammer for FH/MFSK systems. The conclusions found for these systems are similar to those for the DS/BPSK systems.

Omura, J. K.

Some effects of experimental error in fracture testing

Effects of experimental imprecision on the stress intensity factors calculated for various practical specimen types are shown. A general form equation for the stress intensity factor is presented and a general error equation is derived. The expected error in the stress intensity factor is given in terms of the precision levels of the basic experimental measurements and derivatives of the stress intensity calibration factor. Nine common fracture specimen types are considered, and the sensitivity of the various types to experimental error is illustrated. Some implications for fracture toughness testing and crack growth rate testing are discussed and methods of analysis are proposed to compensate for the effects of experimental error.

Orange, T. W.

A comparative study of spherical and flat-Earth geopotential modeling at satellite elevations

Flat-Earth and spherical-Earth geopotential modeling of crustal anomaly sources at satellite elevations are compared by computing gravity and scalar magnetic anomalies perpendicular to the strike of variably dimensioned rectangular prisms at altitudes of 150, 300, and 450 km. Results indicate that the error caused by the flat-Earth approximation is less than 10% in most geometric conditions. Generally, error increase with larger and wider anomaly sources at higher altitudes. For most crustal source modeling applications at conventional satellite altitudes, flat-Earth modeling can be justified and is numerically efficient.

Parrott, M. H.

Implementation of A New Microwave Scattering Database and A Forward Model for Active Microwave Sensors in CRTM

Radiative transfer models are extensively used for the assimilation of satellite observations into NWP models as well as retrieving geophysical products from satellite measurements. CRTM is a community model developed by NOAA JCSDA and widely used for different purposes requiring RT calculations. CRTM requires bulk scattering lookup tables in order to perform all-sky RT calculations. However, the current CRTM lookup tables for microwave frequencies were generated based on the Mie theory by assuming spherical frozen particles. The scattering lookup tables generated using the DDA technique has shown to largely improve the RT scattering calculations in the MW region. This presentation targets (i) the implementation and validation of a DDA database that was originally developed for the ARTS RT model into CRTM, and (ii) developing the CRTM active sensor module that takes advantage of the backscattering coefficients computed using the DDA method. The DDA database only provides single scattering properties of different habits, while CRTM requires bulk scattering properties. The CRTM cloud coefficients were previously generated based on the effective radius for representing the size of the particles. However, effective radius is neither measurable nor provided by the NWP models, thus need to be estimated from other geophysical variables such as water content. Therefore, in addition to calculating the CRTM bulk scattering properties from the DDA single scattering database, the CRTM was also largely modified to use cloud water content (kg.m-3), instead of effective radius, for performing the interpolation over size/mass of the particles. CRTM already requires water content as input, thus no extra variables are required for performing scattering calculations using the new ARTS DDA database. The CRTM scattering modules search for effective radius in cloud coefficient files and will use the cloud water content if the effective radius dimension is not found in the cloud coefficient files. Figure 1 shows the CRTM simulated brightness temperatures computed using different cloud coefficients versus ATMS observed values over Hurricane Irma on September 7, 2017 at 18:00 UTC. We used all the cloud water content values included in ERA5 with default CRTM/DDA habits for water, rain, snow, ice, hail, and graupel. ERA5 does not provide separate water content values for ice, hail, and graupel, thus the ice water content values were divided between ice, hail, and graupel clouds similar to what was explained in the previous section. In channels with a frequency lower than 90 GHz, emission from water and rain clouds can compensate for cloud scattering so that cloud contaminated Tbs are larger than corresponding clear sky Tbs. The DDA simulations for channels 1-7 largely perform better than the Mie simulations. The DDA simulations show a mix of small negative and positive simulated minus observed values, while the Mie results show large negative biases. The weighting functions for some of the ATMS temperature sounding channels (channels 9-15) peak mostly above the clouds, therefore the measured Tbs become less sensitive to clouds so that the results of both Mie and DDA become very similar. The Mie lookup tables generate excessive scattering for channel 16, but not enough scattering for the water vapor channels. In the specific case of Hurricane Maria, the DDA lookup tables do not generate enough scattering for channel 16, but the DDA results are much more consistent with observations for water vapor channels than for channel 16. It should be noted that the results may vary if we use other habits to represent snow, hail, and graupel in the DDA simulations. Although these results clearly show the advantage of the DDA database over the Mie dataset, different error sources such as error in the observations, displacement of clouds in the ERA5 reanalysis, and also lack of convective clouds or in general errors in the input atmospheric and cloud profiles contribute to the differences between the simulated and observed values. Aside from the improvements in the simulations, a major advantage of the new dataset is a large number of habits that can be used to tune the data assimilation systems to perform well in different weather conditions.

Isaac Moradi

Some effects of experimental error in fracture testing.

The purpose of this paper is to show the effects of experimental imprecision on the stress intensity factors calculated for various practical specimen types. A general form equation for the stress intensity factor is presented, and a general error equation is derived. The expected error in the stress intensity factor is given in terms of the precision levels of the basic experimental measurements and derivatives of the stress intensity calibration factor. Nine common fracture specimen types are considered, and the sensitivity of the various types to experimental error is illustrated. Some implications for fracture toughness testing and crack growth rate testing are discussed, and methods of analysis are proposed to compensate for the effects of experimental error.

Orange, T. W.

Comparison of Kalman filter and optimal smoother estimates of spacecraft attitude

Given a valid system model and adequate observability, a Kalman filter will converge toward the true system state with error statistics given by the estimated error covariance matrix. The errors generally do not continue to decrease. Rather, a balance is reached between the gain of information from new measurements and the loss of information during propagation. The errors can be further reduced, however, by a second pass through the data with an optimal smoother. This algorithm obtains the optimally weighted average of forward and backward propagating Kalman filters. It roughly halves the error covariance by including future as well as past measurements in each estimate. This paper investigates whether such benefits actually accrue in the application of an optimal smoother to spacecraft attitude determination. Tests are performed both with actual spacecraft data from the Extreme Ultraviolet Explorer (EUVE) and with simulated data for which the true state vector and noise statistics are exactly known.

Sedlak, J.

On the sensitivity of numerical weather prediction to remotely sensed marine surface wind data - A simulation study

The reported investigation has the objective to assess the potential impact on numerical weather prediction (NWP) of remotely sensed surface wind data. Other investigations conducted with similar objectives have not been satisfactory in connection with a use of procedures providing an unrealistic distribution of initial errors. In the current study, care has been taken to duplicate the actual distribution of information in the conventional observing system, thus shifting the emphasis from accuracy of the data to the data coverage. It is pointed out that this is an important consideration in assessing satellite observing systems since experience with sounder data has shown that improvements in forecasts due to satellite-derived information is due less to a general error reduction than to the ability to fill data-sparse regions. The reported study concentrates on the evaluation of the observing system simulation experimental design and on the assessment of the potential of remotely sensed marine surface wind data.

Cane, M. A.

NLTE model stellar atmospheres with line blanketing near the series limits

In this paper we study the influence of line-merging regions at the intermediate long-wavelength side of a continuum threshold on the computed model atmosphere structure and predicted spectrum. In order to model these regions sufficiently accurately, we have developed two concepts. First, we have extended the occupation probability formalism of Hummer and Mihalas to non-local thermodynamic equilibrium (non-LTE) plasmas. Second, in order to treat the very complicated opacity in the line merging region, we have generalized the concept of opacity distribution functions to treat non-LTE situations. All Rydberg states are consistently included within this framework, so that no arbitrary cutoff of high (LTE) levels is made. We have calculated several pure hydrogen models atmospheres for two effective temperatures, T(sub eff) = 20000 and 35000 K, and discussed the differences between models calculated with various treatments of the line merging. In particular, we have shown that the error in the predicted profiles of Balmer lines resulting from the neglect of line merging is typically of the order of 3-4%, while the errors in the far-UV portion of the Balmer continuum reaches 15-35%. The errors generally decrease with increasing effective temperature. At the same time, the internal accuracy of the models is shown to be about or below 0.5% for all predicted spectral features. We conclude that for interpreting current high-accuracy spectrophotometric observations models including the line merging are necessary, and that the formalism developed in this paper is capable of providing a sufficiently accurate and robust modeling technique.

Hubeny, I.