Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistical comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

The Impact of Assimilating Precipitation-affected Radiance on Cloud and Precipitation in Goddard WRF-EDAS Analyses

High-frequency TMI and AMSR-E radiances, which are sensitive to precipitation over land, are assimilated into the Goddard Weather Research and Forecasting Model- Ensemble Data Assimilation System (WRF-EDAS) for a few heavy rain events over the continental US. Independent observations from surface rainfall, satellite IR brightness temperatures, as well as ground-radar reflectivity profiles are used to evaluate the impact of assimilating rain-sensitive radiances on cloud and precipitation within WRF-EDAS. The evaluations go beyond comparisons of forecast skills and domain-mean statistics, and focus on studying the cloud and precipitation features in the jointed rainradiance and rain-cloud space, with particular attentions on vertical distributions of height-dependent cloud types and collective effect of cloud hydrometers. Such a methodology is very helpful to understand limitations and sources of errors in rainaffected radiance assimilations. It is found that the assimilation of rain-sensitive radiances can reduce the mismatch between model analyses and observations by reasonably enhancing/reducing convective intensity over areas where the observation indicates precipitation, and suppressing convection over areas where the model forecast indicates rain but the observation does not. It is also noted that instead of generating sufficient low-level warmrain clouds as in observations, the model analysis tends to produce many spurious upperlevel clouds containing small amount of ice water content. This discrepancy is associated with insufficient information in ice-water-sensitive radiances to address the vertical distribution of clouds with small amount of ice water content. Such a problem will likely be mitigated when multi-channel multi-frequency radiances/reflectivity are assimilated over land along with sufficiently accurate surface emissivity information to better constrain the vertical distribution of cloud hydrometers.

WRF-EDAS Analyses↗

Computational Fluid Dynamics Study on the Effects of RATO Timing on the Scale Model Acoustic Test

The Scale Model Acoustic Test (SMAT) is a 5% scale test of the Space Launch System (SLS), which is currently being designed at Marshall Space Flight Center (MSFC). The purpose of this test is to characterize and understand a variety of acoustic phenomena that occur during the early portions of lift off, one being the overpressure environment that develops shortly after booster ignition. The SLS lift off configuration consists of four RS-25 liquid thrusters on the core stage, with two solid boosters connected to each side. Past experience with scale model testing at MSFC (in ER42), has shown that there is a delay in the ignition of the Rocket Assisted Take Off (RATO) motor, which is used as the 5% scale analog of the solid boosters, after the signal to ignite is given. This delay can range from 0 to 16.5ms. While this small of a delay maybe insignificant in the case of the full scale SLS, it can significantly alter the data obtained during the SMAT due to the much smaller geometry. The speed of sound of the air and combustion gas constituents is not scaled, and therefore the SMAT pressure waves propagate at approximately the same speed as occurs during full scale. However, the SMAT geometry is much smaller allowing the pressure waves to move down the exhaust duct, through the trench, and impact the vehicle model much faster than occurs at full scale. To better understand the effect of the RATO timing simultaneity on the SMAT IOP test data, a computational fluid dynamics (CFD) analysis was performed using the Loci/CHEM CFD software program. Five different timing offsets, based on RATO ignition delay statistics, were simulated. A variety of results and comparisons will be given, assessing the overall effect of RATO timing simultaneity on the SMAT overpressure environment.

Nielsen, Tanner↗

Quantitative Validation of the Integrated Medical Model (IMM) for ISS Missions

Lifetime Surveillance of Astronaut Health (LSAH) provided observed medical event data on 33 ISS and 111 STS person-missions for use in further improving and validating the Integrated Medical Model (IMM). Using only the crew characteristics from these observed missions, the newest development version, IMM v4.0, will simulate these missions to predict medical events and outcomes. Comparing IMM predictions to the actual observed medical event counts will provide external validation and identify areas of possible improvement. In an effort to improve the power of detecting differences in this validation study, the total over each program ISS and STS will serve as the main quantitative comparison objective, specifically the following parameters: total medical events (TME), probability of loss of crew life (LOCL), and probability of evacuation (EVAC). Scatter plots of observed versus median predicted TMEs (with error bars reflecting the simulation intervals) will graphically display comparisons while linear regression will serve as the statistical test of agreement. Two scatter plots will be analyzed 1) where each point reflects a mission and 2) where each point reflects a condition-specific total number of occurrences. The coefficient of determination (R2) resulting from a linear regression with no intercept bias (intercept fixed at zero) will serve as an overall metric of agreement between IMM and the real world system (RWS). In an effort to identify as many possible discrepancies as possible for further inspection, the -level for all statistical tests comparing IMM predictions to observed data will be set to 0.1. This less stringent criterion, along with the multiple testing being conducted, should detect all perceived differences including many false positive signals resulting from random variation. The results of these analyses will reveal areas of the model requiring adjustment to improve overall IMM output, which will thereby provide better decision support for mission critical applications.

validation↗

Modeling Mg II During Solar Flares. II. Nonequilibrium Effects

To extract the information that the Mg II NUV spectra (observed by the Interface Region Imaging Spectrograph) carry about the chromosphere during solar flares, and to validate models of energy transport via model–data comparison, forward modeling is required. The assumption of statistical equilibrium (SE) is typically used to obtain the atomic level populations from snapshots of flare atmospheres, due to computational necessity. However, it is possible that relying on SE could lead to spurious results. We compare solving the atomic level populations via SE versus a non-equilibrium (NEQ) time-dependent approach. This was achieved using flare simulations from RADYN alongside the minority species version MS_RADYN from which the time-dependent Mg II atomic level populations and radiation transfer were computed in complete frequency redistribution. The impacts on the emergent profiles, light curves, line ratios, and formation heights are discussed. In summary we note that NEQ effects during flares are typically important only in the initial stages and for a short period following the cessation of the energy injection. An analysis of the timescales of ionization equilibrium reveals that for most of the duration of the flare, when the temperatures and densities are sufficiently enhanced, the relaxation timescales are short (τrelax < 0.1 s), so that the equilibrium solution is an adequate approximation. These effects vary with the size of the flare, however. In weaker flares, effects can be more pronounced. We recommend that NEQ effects be considered when possible but that SE is sufficient at most stages of the flare.

Kerr, Graham S.↗

On Achieving High Accuracy in Quantum Chemical Calculations of 3 d Transition Metal-Containing Systems: A Comparison of Auxiliary-Field Quantum Monte Carlo with Coupled Cluster, Density Functional Theory, and Experiment for Diatomic Molecules

According to the article, the bond dissociation energies of a set of 44 3d transition metal-containing diatomics are computed with phaseless auxiliary-field quantum Monte Carlo (ph-AFQMC) utilizing a correlated sampling technique. We investigate molecules with H, N, O, F, Cl, and S ligands, including those in the 3dMLBE20 database first compiled by Truhlar and co-workers with calculated and experimental values that have since been revised by various groups. In order to make a direct comparison of the accuracy of our ph-AFQMC calculations with previously published results from 10 DFT functionals, CCSD(T), and icMR-CCSD(T), we establish an objective selection protocol which utilizes the most recent experimental results except for a few cases with well-specified discrepancies. With the remaining set of 41 molecules, we find that ph-AFQMC gives robust agreement with experiment superior to that of all other methods, with a mean absolute error (MAE) of 1.4(4) kcal/mol and maximum error of 3(3) kcal/mol (parentheses account for reported experimental uncertainties and the statistical errors of our ph-AFQMC calculations). In comparison, CCSD(T) and B97, the best performing DFT functional considered here, have MAEs of 2.8 and 3.7 kcal/mol, respectively, and maximum errors in excess of 17 kcal/mol (for the CoS diatomic). While a larger and more diverse data set would be required to demonstrate that ph-AFQMC is truly a benchmark method for transition metal systems, our results indicate that the method has tremendous potential, exhibiting unprecedented consistency and accuracy compared to other approximate quantum chemical approaches.

Chemistry↗

On the reliability of microvariability tests in quasars

Microvariations probe the physics and internal structure of quasars. Unpredictability and small flux variations make this phenomenon elusive and difficult to detect. Variance-based probes such as the C and F tests, or a combination of both, are popular methods to compare the light curves of the quasar and a comparison star. Recently, detection claims in some studies have depended on the agreement of the results of the C and F tests, or of two instances of the F-test, for rejecting the non-variation null hypothesis. However, the C-test is a non-reliable statistical procedure, the F-test is not robust, and the combination of tests with concurrent results is anything but a straightforward methodology. A priori power analysis calculations and post hoc analysis of Monte Carlo simulations show excellent agreement for the analysis of variance test to detect microvariations as well as the limitations of the F-test. Additionally, the combined tests yield correlated probabilities that make the assessment of statistical significance unworkable. However, it is possible to include data from several field stars to enhance the power in a single F-test, increasing the reliability of the statistical analysis. This would be the preferred methodology when several comparison stars are available. An example using two stars and the enhanced F-test is presented. These results show the importance of using adequate methodologies and avoiding inappropriate procedures that can jeopardize microvariability detections. Power analysis and Monte Carlo simulations are useful tools for research planning, as they can demonstrate the robustness and reliability of different research approaches.

79 ASTRONOMY AND ASTROPHYSICS↗

COMPARING MID-INFRARED GLOBULAR CLUSTER COLORS WITH POPULATION SYNTHESIS MODELS

Several population synthesis models now predict integrated colors of simple stellar populations in the mid-infrared bands. To date, the models have not been extensively tested in this wavelength range. In a comparison of the predictions of several recent population synthesis models, the integrated colors are found to cover approximately the same range but to disagree in detail, for example, on the effects of metallicity. To test against observational data, globular clusters (GCs) are used as the closest objects to idealized groups of stars with a single age and single metallicity. Using recent mass estimates, we have compiled a sample of massive, old GCs in M31 which contain enough stars to guard against the stochastic effects of small-number statistics, and measured their integrated colors in the Spitzer/IRAC bands. Comparison of the cluster photometry in the IRAC bands with the model predictions shows that the models reproduce the cluster colors reasonably well, except for a small (not statistically significant) offset in [4.5] - [5.8]. In this color, models without circumstellar dust emission predict bluer values than are observed. Model predictions of colors formed from the V band and the IRAC 3.6 and 4.5 {mu}m bands are redder than the observed data at high metallicities and we discuss several possible explanations. In agreement with model predictions, V - [3.6] and V - [4.5] colors are found to have metallicity sensitivity similar to or slightly better than V - K{sub s}.

79 ASTRONOMY AND ASTROPHYSICS↗

Direct numerical simulation of turbulent flow in a rotating square duct

A fully developed turbulent flow in a rotating straight square duct is simulated by direct numerical simulations at Re{sub τ} = 300 and 0 ≤ Ro{sub τ} ≤ 40. The rotating axis is parallel to two opposite walls of the duct and normal to the main flow. Variations of the turbulence statistics with the rotation rate are presented, and a comparison with the rotating turbulent channel flow is discussed. Rich secondary flow patterns in the cross section are observed by varying the rotation rate. The appearance of a pair of additional vortices above the pressure wall is carefully examined, and the underlying mechanism is explained according to the budget analysis of the mean momentum equations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

NASA pocket statistics

NASA program goals and objectives, major mission performance, USSR space flights, comparisons of the USA and USSR space records, and selected technical, financial, and manpower data are summarized.

Source record↗

An evaluation and comparison of vertical profile data from the VISSR Atmospheric Sounder (VAS)

A statistical evaluation is used to compared vertical profiles of temperature and moisture derived from VISSR Atmospheric Sounder (VAS) with three different algorithms to that of corresponding rawinsonde measurements for a clear cold environment. To account for time and space discrepancies between the data sets, rawinsonde data were adjusted to be representative of the satellite sounding times. Both rawinsonde and satellite sounding data were objectively analyzed onto a mesoscale grid. These grid point values were compared at 50 mb pressure increments from the surface up to 100 mb. The data were analyed for horizontal and vertical structure, representatives of derived parameters, and significant departure (improvement) from the apriori (first guess) information. Results indicate some rather strong temperature and moisture biases exist in the satellite soundings. Temperature biases of 1 to 4 C and dewpoint biases of 2 to 6 C generally occur in layers where strong inversions are present and vary with time as these atmospheric features evolve. The biases also changes as a function retrieval scheme suggesting limitations and restrictions on the applications of the various techniques. Standard temperature deviations range from 1 to 2 C for each retrieval scheme with maximum values around 800 and 400 mb. Derived parameters (precipitable water and thickness) suffer from similar biases, though to a somewhat lesser extent. Gradients of basic and derived parameters are generally weaker but have good horizontal structure where magnitudes of the parameters are relatively strong. Integrated thermal (temperature) and moisture (precipitable water) parameters show mixed results.

Jedlovec, G. J.↗

An evaluation and comparison of vertical profile data from the VISSR Atmospheric Sounder (VAS)

A statistical evaluation is used to compared vertical profiles of temperature and moisture derived from VISSR Atmospheric Sounder (VAS) with three different algorithms to that of corresponding rawinsonde measurements for a clear cold environment. To account for time and space discrepancies between the data sets, rawinsonde data were adjusted to be representative of the satellite sounding times. Both rawinsonde and satellite sounding data were objectively analyzed onto a mesoscale grid. These grid point values were compared at 50 mb pressure increments from the surface up to 100 mb. The data were analyzed for horizontal and vertical structure, representatives of derived parameters, and significant departure (improvement) from the apriori (first guess) information. Results indicate some rather strong temperature and moisture biases exist in the satellite soundings. Temperature biases of 1 to 4 C and dewpoint biases of 2 to 6 C generally occur in layers where strong inversions are present and vary with time as these atmospheric features evolve. The biases also changes as a function retrieval scheme suggesting limitations and restrictions on the applications of the various techniques. Standard temperature deviations range from 1 to 2 C for each retrieval scheme with maximum values around 800 and 400 mb. Derived parameters (precipitable water and thickness) suffer from similar biases, though to a somewhat lesser extent. Gradients of basic and derived parameters are generally weaker but have good horizontal structure where magnitudes of the parameters are relatively strong. Integrated thermal (temperature) and moisture (precipitable water) parameters show mixed results.

Jedlovec, G. J.↗

Ranking and Selection of Populations on the Base of Sample Means

A number of directions is indicated in which for statistical problems of decision making related to ordering the parameters of distributions, it is expedient to lean on comparison of sample means. It is assumed that the corresponding parametric family has no nontrivial sufficient statistics. The key role is played by establishing conditions under which the reliability of inferences increases monotonically with increasing the sampling size. Examples of applications are given.

97 MATHEMATICS AND COMPUTING↗

POD of ultrasonic detection of synthetic hard alpha inclusions in titanium aircraft engine forgings

The probability of detection (POD) of inspection techniques is a key input to estimating the lives of structural components such as aircraft engines. This paper describes work conducted as a part of the development of POD curves for the ultrasonic detection of synthetic hard alpha (SHA) inclusions in titanium aircraft engine forgings. The sample upon which the POD curves are to be based contains four types of right circular SHAs that have been embedded in a representative titanium forging, as well as a number of flat bottomed holes (FBHs). The SHAs were of two sizes, number 3 and number 5, with each size including seeds with nominal nitrogen concentrations of both 3 and 17 wt. %. The FBHs included sizes of number 1, number 3, and number 5. This discreteness of the data poses a number of challenges to standard processes for determining POD. For example, at each concentration of nitrogen, there are only two sizes, with 10 inspection opportunities each. Fully empirical, standard methodologies such as a circumflex versus a provide less than an ideal framework for such an analysis. For example, there is no way to describe the beam limiting effect whereby the signal no longer increases the flaw grows larger than the beam, one can only determine POD at the two concentration levels present in the block, and confidence bounds tend to be broad because of the limited data available for each case. In this paper, we will describe strategies involving the use of physics-based models to overcome these difficulties by allowing the data from all reflectors to be analyzed by a single statistical model. Included will be a discussion of the development of the physics-based model, its comparison to the experimental data (obtained at multiple sites with multiple operators) and its implications regarding the statistical analysis, whose details will be given in a separate article by Li et al. in this volume.

36 MATERIALS SCIENCE↗

Statistical Aspects of ENSO Events (1950-1997) and the El Nino-Atlantic Intense Hurricane Activity Relationship

On the basis of Trenberth's quantitative definition for marking the occurrence of an El Nino (or La Nina), one can precisely identify by month and year the starts and ends of some 15 El Nino and 10 La Nina events during the interval of 1950-1997, an interval corresponding to the most reliable for cataloging intense hurricane activity in the Atlantic basin (i.e., those of category 3-5 on the Saffir-Simpson hurricane scale). The main purpose of this investigation is primarily two-fold: First, the statistical aspects of these identified extremes and the intervening periods between them (called "interludes") are examined and, second, the statistics of the seasonal frequency of intense hurricanes in comparison to the extremes and interludes are determined. This study clearly demonstrates that of the last 48 hurricane seasons, 20 (42 percent) can be described as being "El Nino-related" (i.e., an El Nino was in progress during all, or part, of the yearly hurricane season--June-November), 13 (27 percent) as "La Nina-related" (i.e., a La Nina was in progress during all, or part, of the yearly hurricane season), and 15 (31 percent) as "interlude-related" (i.e., neither an El Nino nor a La Nina was in progress during any portion of the yearly hurricane season). Combining the latter two subgroups into a single grouping called "non-El Nino-related" seasons, one finds that they have had a mean frequency of intense hurricanes measuring 2.8 events per season, while the El Nino-related seasons have had a mean frequency of intense hurricanes measuring 1.3 events per season, where the observed difference in the means is inferred to be statistically important at the 99.8-percent level of confidence. Therefore, as previously shown more than a decade ago using a different data set, there undeniably exists an El Nino-Atlantic hurricane activity relationship, one which also extends to the class of intense hurricanes. During the interval of 1950-1997, fewer intense hurricanes occurred during El Nino-related seasons (always less than or equal to 3 and usually less than or equal to 2, this latter value having been true for 18 of the 20 El Nino-related seasons), while more usually occurred during non-El Nino-related seasons (typically greater than or equal to 2, having been true for 22 of the 28 non-El Nino-related seasons). Implications for the 1998 and 1999 hurricane seasons are discussed.

Wilson, Robert M.↗

Intercomparison of global SST fields derived from satellite sensors and ship observations

Near global comparisons were made between binned forms of SST obtained from different instruments, ship meteorological observations, and the output of a meteorological model. Binning hereinafter means gridding by simple summation of data values in a bin, which in this study was a 2 deg. x 2 deg. box or a 10 deg. x 10 box surrounding a grid node. In the binned comparisons, the question is asked: are the binned data from two instruments drawn from the same population? The first two measures of statistical moments of the populations are used to test the hypothesis that they are. Comparisons were also attempted between raw forms of the various SST retrievals, using a structure function analysis. The results of this analysis were relatively uninteresting and are therefore omitted.

Pazan, S. E.↗

Comparison of simulation modeling and satellite techniques for monitoring ecological processes

In 1985 improvements were made in the world climatic data base for modeling and predictive mapping; in individual process models and the overall carbon-balance models; and in the interface software for mapping the simulation results. Statistical analysis of the data base was begun. In 1986 mapping was shifted to NASA-Goddard. The initial approach involving pattern comparisons was modified to a more statistical approach. A major accomplishment was the expansion and improvement of a global data base of measurements of biomass and primary production, to complement the simulation data. The main accomplishments during 1987 included: production of a master tape with all environmental and satellite data and model results for the 1600 sites; development of a complete mapping system used for the initial color maps comparing annual and monthly patterns of Normalized Difference Vegetation Index (NDVI), actual evapotranspiration, net primary productivity, gross primary productivity, and net ecosystem production; collection of more biosphere measurements for eventual improvement of the biological models; and development of some initial monthly models for primary productivity, based on satellite data.

Box, Elgene O.↗

Understanding Solar Cycle Variability

The level of solar magnetic activity, as exemplified by the number of sunspots and by energetic events in the corona, varies on a wide range of timescales. Most prominent is the 11-year solar cycle, which is significantly modulated on longer timescales. Drawing from dynamo theory, together with the empirical results of past solar activity and similar phenomena for solar-like stars, we show that the variability of the solar cycle can be essentially understood in terms of a weakly nonlinear limit cycle affected by random noise. In contrast to ad hoc “toy models” for the solar cycle, this leads to a generic normal-form model, whose parameters are all constrained by observations. The model reproduces the characteristics of the variable solar activity on timescales between decades and millennia, including the occurrence and statistics of extended periods of very low activity (grand minima). Comparison with results obtained with a Babcock–Leighton-type dynamo model confirm the validity of the normal-mode approach.

79 ASTRONOMY AND ASTROPHYSICS↗

A Comparison of Tropical Storm (TS) and Non-TS Gust Factors for Assessing Peak Wind Probabilities at the Eastern Range

Knowledge of peak wind speeds is important to the safety of personnel and flight hardware at Kennedy Space Center (KSC) and the Cape Canaveral Air Force Station (CCAFS), but they are more difficult to forecast than mean wind speeds. Development of a reliable model for the gust factor (GF) relating the peak to the mean wind speed motivated a previous study of GF in tropical storms. The same motivation inspired a climatological study of non-TS peak wind speed statistics without the use of GF. Both studies presented their respective statistics as functions of mean wind speed and height. The few comparisons of IS and non-TS GF in the literature suggest that the non-TS GF at a given height and mean wind speed are smaller than the corresponding TS GF. The investigation reported here converted the non-TS peak wind statistics mentioned above to the equivalent GF statistics and compared the results with the previous TS GF results. The advantage of this effort over all previously reported studies of its kind is that the TS and non-TS data are taken from the same towers in the same locations. That eliminates differing surface attributes, including roughness length and thermal properties, as a major source of variance in the comparison. The results are consistent with the literature, but include much more detailed, quantitative information on the nature of the relationship between TS and non-TS GF as a function of height and mean wind speed. In addition, the data suggest the possibility of providing an operational model for non-TS GF as a function of height and wind speed in a manner similar to the one previously developed for TS GF.

Merceret, Francis J.↗