Search NASA⌕ Search

SEARCH · Search NASA

Results for “testing statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

An Assessment of Actual and Potential Building Climate Zone Change and Variability From the Last 30 Years Through 2100 Using NASA's MERRA and CMIP5 Simulations

Background: In the US, residential and commercial building infrastructure combined consumes about 40% of total energy usage and emits about 39% of total CO2 emission (DOE/EIA "Annual Energy Outlook 2013"). Building codes, as used by local and state enforcement entities are typically tied to the dominant climate within an enforcement jurisdiction classified according to various climate zones. These climate zones are based upon a 30-year average of local surface observations and are developed by DOE and ASHRAE. Establishing the current variability and potential changes to future building climate zones is very important for increasing the energy efficiency of buildings and reducing energy costs and emissions in the future. Objectives: This paper demonstrates the usefulness of using NASA's Modern Era Retrospective-analysis for Research and Applications (MERRA) atmospheric data assimilation to derive the DOE/ASHRAE building climate zone maps and then using MERRA to define the last 30 years of variability in climate zones for the Continental US. An atmospheric assimilation is a global atmospheric model optimized to satellite, atmospheric and surface in situ measurements. Using MERRA as a baseline, we then evaluate the latest Climate Model Inter-comparison Project (CMIP) climate model Version 5 runs to assess potential variability in future climate zones under various assumptions. Methods: We derive DOE/ASHRAE building climate zones using surface and temperature data products from MERRA. We assess these zones using the uncertainties derived by comparison to surface measurements. Using statistical tests, we evaluate variability of the climate zones in time and assess areas in the continental US for statistically significant trends by region. CMIP 5 produced a data base of over two dozen detailed climate model runs under various greenhouse gas forcing assumptions. We evaluate the variation in building climate zones for 3 different decades using an ensemble and quartile statistics to provide an assessment of potential building climate zone changes relative to the uncertainties demonstrated using MERRA. Findings and Conclusions: These results show that there is a statistically significant increase in the area covered by warmer climate zones and a tendency for a reduction of area in colder climate zones in some limited regions. The CMIP analysis shows that models vary from relatively little building climate zone change for the least sensitive and conservation assumptions to a warming of at most 3 zones for certain areas, particularly the north central US by the end of the 21st century.

Stackhouse, Paul W., Jr.↗
NASA NTRS2007

Detection of Digital Elevation Model Errors Using X-band Weather Radar

Flight in Instrument Meteorological Conditions requires pilots to manipulate flight controls while referring to a Primary Flight Display. The Primary Flight Display indicates aircraft attitude along with, in some cases, many other state variables such as altitude, speed, and guidance cues. Synthetic Vision Systems have been proposed that overlay the traditional information provided on Primary Flight Displays onto a scene depicting the location of terrain and other geo-spatial features.Terrain models used by these displays must have sufficient quality to avoid providing misleading information. This paper describes how X-band radar measurements can be used as part of a monitor, and/or maintenance system, to quantify the integrity of terrain models that are used by systems such as Synthetic Vision. Terrain shadowing effects, as seen by the radar, are compared in a statistical manner against estimated shadow feature elements extracted from the stored terrain model from the perspective of the airborne observer. A test statistic is defined that enables detection of errors as small as the range resolution of the radar. Experimental results obtained from two aircraft platforms hosting certified commercial-off-the-shelf X-band radars test the premise and illustrate its potential.

Young, Steven D.↗
DOE OSTI2021

Grid-based minimization at scale: Feldman-Cousins corrections for light sterile neutrino search

High Energy Physics (HEP) experiments generally employ sophisticated statistical methods to present results in searches of new physics. In the problem of searching for sterile neutrinos, likelihood ratio tests are applied to short-baseline neutrino oscillation experiments to construct confidence intervals for the parameters of interest. The test statistics of the form Δχ2 is often used to form the confidence intervals, however, this approach can lead to statistical inaccuracies due to the small signal rate in the region-of-interest. In this paper, we present a computational model for the computationally expensive Feldman-Cousins corrections to construct a statistically accurate confidence interval for neutrino oscillation analysis. The program performs a grid-based minimization over oscillation parameters and is written in C++. Our algorithms make use of vectorization through Eigen3, yielding a single-core speed-up of 350 compared to the original implementation, and achieve MPI data parallelism by employing DIY. We demonstrate the strong scaling of the application at High-Performance Computing (HPC) sites. We utilize HDF5 along with HighFive to write the results of the calculation to file.

Wospakrik, Marianette↗
NASA NTRS1991

A rule-based software test data generator

Rule-based software test data generation is proposed as an alternative to either path/predicate analysis or random data generation. A prototype rule-based test data generator for Ada programs is constructed and compared to a random test data generator. Four Ada procedures are used in the comparison. Approximately 2000 rule-based test cases and 100,000 randomly generated test cases are automatically generated and executed. The success of the two methods is compared using standard coverage metrics. Simple statistical tests showing that even the primitive rule-based test data generation prototype is significantly better than random data generation are performed. This result demonstrates that rule-based test data generation is feasible and shows great promise in assisting test engineers, especially when the rule base is developed further.

Deason, William H.↗
NASA NTRS2016

Safeguarding a Lunar Rover with Wald's Sequential Probability Ratio Test

The virtual bumper is a safeguarding mechanism for autonomous and remotely operated robots. In this paper we take a new approach to the virtual bumper system by using an old statistical test. By using a modified version of Wald's sequential probability ratio test we demonstrate that we can reduce the number of false positive reported by the virtual bumper, thereby saving valuable mission time. We use the concept of sequential probability ratio to control vehicle speed in the presence of possible obstacles in order to increase certainty about whether or not obstacles are present. Our new algorithm reduces the chances of collision by approximately 98 relative to traditional virtual bumper safeguarding without speed control.

safeguarding↗
NASA NTRS1991

Simulation of deep one- and two-dimensional redshift surveys

It is shown that slice or pencil-beam redshift surveys of galaxies can be simulated in a box with nonequal sides. This method saves a lot of computer time and memory while providing essentially the same results as from whole-cube simulations. A 2457.6/h Mpc-long rod (out to a redshift z = 0.58 in two opposite directions) is simulated using the standard biased cold dark matter model as an example to mimic the recent deep pencil-beam surveys by Broadhurst et al. (1990). The structures (spikes) seen in these simulated samples occur when the narrow pencil-beam pierces walls, filaments, and clusters appearing randomly along the line-of-sight. A statistical test for goodness of fit to a periodic lattice has been applied to the observations and the simulations. It is found that the statistical significance level (P = 15.4 percent) is not strong enough to reject the null hypothesis that the observations and the simulations were drawn at random from the same set.

Park, Changbom↗
NASA NTRS1987

Statistical aspects of solar flares

A survey of the statistical properties of 850 H alpha solar flares during 1975 is presented. Comparison of the results found here with those reported elsewhere for different epochs is accomplished. Distributions of rise time, decay time, and duration are given, as are the mean, mode, median, and 90th percentile values. Proportions by selected groupings are also determined. For flares in general, mean values for rise time, decay time, and duration are 5.2 + or - 0.4 min, and 18.1 + or 1.1 min, respectively. Subflares, accounting for nearly 90 percent of the flares, had mean values lower than those found for flares of H alpha importance greater than 1, and the differences are statistically significant. Likewise, flares of bright and normal relative brightness have mean values of decay time and duration that are significantly longer than those computed for faint flares, and mass-motion related flares are significantly longer than non-mass-motion related flares. Seventy-three percent of the mass-motion related flares are categorized as being a two-ribbon flare and/or being accompanied by a high-speed dark filament. Slow rise time flares (rise time greater than 5 min) have a mean value for duration that is significantly longer than that computed for fast rise time flares, and long-lived duration flares (duration greater than 18 min) have a mean value for rise time that is significantly longer than that computed for short-lived duration flares, suggesting a positive linear relationship between rise time and duration for flares. Monthly occurrence rates for flares in general and by group are found to be linearly related in a positive sense to monthly sunspot number. Statistical testing reveals the association between sunspot number and numbers of flares to be significant at the 95 percent level of confidence, and the t statistic for slope is significant at greater than 99 percent level of confidence. Dependent upon the specific fit, between 58 percent and 94 percent of the variation can be accounted for with the linear fits. A statistically significant Northern Hemisphere flare excess (P less than 1 percent) was found, as was a Western Hemisphere excess (P approx 3 percent). Subflares were more prolific within 45 deg of central meridian (P less than 1 percent), while flares of H alpha importance or = 1 were more prolific near the limbs greater than 45 deg from central meridian; P approx 2 percent). Two-ribbon flares were more frequent within 45 deg of central meridian (P less than 1 percent). Slow rise time flares occurred more frequently in the western hemisphere (P approx 2 percent), as did short-lived duration flares (P approx 9 percent), but fast rise time flares were not preferentially distributed (in terms of east-west or limb-disk). Long-lived duration flares occurred more often within 45 deg 0 central meridian (P approx 7 percent). Mean durations for subflares and flares of H alpha importance or + 1, found within 45 deg of central meridian, are 14 percent and 70 percent, respectively, longer than those found for flares closer to the limb. As compared to flares occurring near cycle maximum, the flares of 1975 (near solar minimum) have mean values of rise time, decay time, and duration that are significantly shorter. A flare near solar maximum, on average, is about 1.6 times longer than one occurring near solar minimum.

Wilson, Robert M.↗
NASA NTRS1990

Reliability growth modeling analysis of the space shuttle main engines based upon the Weibull process

The Weibull process, identified as the inhomogeneous Poisson process with the Weibull intensity function, is used to model the reliability growth assessment of the space shuttle main engine test and flight failure data. Additional tables of percentage-point probabilities for several different values of the confidence coefficient have been generated for setting (1-alpha)100-percent two sided confidence interval estimates on the mean time between failures. The tabled data pertain to two cases: (1) time-terminated testing, and (2) failure-terminated testing. The critical values of the three test statistics, namely Cramer-von Mises, Kolmogorov-Smirnov, and chi-square, were calculated and tabled for use in the goodness of fit tests for the engine reliability data. Numerical results are presented for five different groupings of the engine data that reflect the actual response to the failures.

Wheeler, J. T.↗
DOE OSTI2022

DefectTrack: a deep learning-based multi-object tracking algorithm for quantitative defect analysis of in-situ TEM videos in real-time

Abstract In-situ irradiation transmission electron microscopy (TEM) offers unique insights into the millisecond-timescale post-cascade process, such as the lifetime and thermal stability of defect clusters, vital to the mechanistic understanding of irradiation damage in nuclear materials. Converting in-situ irradiation TEM video data into meaningful information on defect cluster dynamic properties (e.g., lifetime) has become the major technical bottleneck. Here, we present a solution called the DefectTrack , the first dedicated deep learning-based one-shot multi-object tracking (MOT) model capable of tracking cascade-induced defect clusters in in-situ TEM videos in real-time. DefectTrack has achieved a Multi-Object Tracking Accuracy (MOTA) of 66.43% and a Mostly Tracked (MT) of 67.81% on the test set, which are comparable to state-of-the-art MOT algorithms. We discuss the MOT framework, model selection, training, and evaluation strategies for in-situ TEM applications. Further, we compare the DefectTrack with four human experts in quantifying defect cluster lifetime distributions using statistical tests and discuss the relationship between the material science domain metrics and MOT metrics. Our statistical evaluations on the defect lifetime distribution suggest that the DefectTrack outperforms human experts in accuracy and speed.

42 ENGINEERING↗
DOE OSTI2023

Emissions and Flame Structure Assessment of Aeroengine Micromixing Injectors for Lean Direct Injection of Hydrogen and Hydrogen/Natural Gas Blends

Abstract The present study focuses on whether adapting low emissions liquid fuel injection concepts can be applied to gaseous mixtures. The goal is to develop an injector with specific geometric characteristics that will achieve the lowest emissions. This is conducted by evaluating emissions and flame diagnostics on a set of test hardware that has been developed for combustion of pure hydrogen and hydrogen/methane mixtures. The current test hardware adapts lean direct injection concepts from aeroengine injectors to a ground-based engine based on target flows associated with a Solar Turbines Industrial Engine gas turbine. A statistical test plan was developed to assess these geometric characteristics using a three level Box Behnken design. The test plan investigates the effect of injector flow splits, air swirl, fuel swirl, pressure drop, preheat temperature, fuel composition, and the adiabatic flame temperature on the flame structure and emissions performance. A total of 16 injectors were considered for a total of 688 test points for emission and imaging data. Emissions data were reported on a mass basis in ng/J and chemical reactor network analysis were conducted to further interpret emissions behavior. Images were also captured to analyze the flame structure features of interest including reaction volume, flame length, flame spread, and flame width. With these results, a predictive model for emissions was made to conclude the most optimal injector configuration is to have the highest level of air split (more volume of air through the injector plate versus the injector) and air swirl angle for both methane and hydrogen gas mixtures. The predictive emissions level for all of these cases were below 10 ng/J.

08 HYDROGEN↗
DOE OSTI2022

Cervical Precancers and Cancers Attributed to HPV Types by Race and Ethnicity: Implications for Vaccination, Screening, and Management

Abstract Background Racial and ethnic variations in attribution of cervical precancer and cancer to human papillomavirus (HPV) types may result in different HPV vaccine protection, screening test coverage, and clinical management. Methods Pooling data from 7 US studies, we calculated the proportional attribution of precancers and cancers to HPV types using HPV DNA typing from diagnosis. All statistical tests were 2-sided. Results For all racial and ethnic groups, most cases of cervical intraepithelial neoplasia grade 3 (CIN3) (84.2%-90.8% of 5526) and squamous cell carcinoma (SCC) (90.4%-93.8% of 1138) were attributed to types targeted by the 9-valent vaccine. A higher proportion of CIN3s were attributed to nonvaccine HPV types among non-Hispanic Black women (15.8%) compared with non-Hispanic Asian or Pacific Islander (9.7%; P = .002), non-Hispanic White (9.2%; P < .001), and Hispanic (11.3%; P = .004) women. The proportion of SCCs attributed to 9-valent types was similar by race and ethnicity (P = .80). A higher proportion of CIN3s were attributed to nonvaccine HPV35 among non-Hispanic Black (9.0%) compared with non-Hispanic Asian or Pacific Islander (2.2%), non-Hispanic White (2.5%), and Hispanic (3.0%; all P < .001) women. Compared with CIN3, the proportion of SCCs attributed to HPV35 among non-Hispanic Black women (3.2%) was lower and closer to other groups (0.3%-2.1%; P = .70). Conclusion The 9-valent HPV vaccine will prevent nearly all cervical precancers and invasive cancers among major racial and ethnic groups in the United States. Adding HPV35 to vaccines could prevent a small percentage of CIN3s and SCCs, with greater potential impact for CIN3s among Black women. HPV screening tests target high-risk HPV types, including HPV35. Future genotyping triage strategies could consider the importance of HPV35- and other HPV16-related types.

Mix, Jacqueline (ORCID:0000000164187706)↗
DOE OSTI2019

Sandia Fracture Challenge 3: detailing the Sandia Team Q failure prediction strategy

The third Sandia Fracture Challenge illustrated the geometric and material uncertainties presented by modern additive manufacturing techniques. Tasked with the challenge of predicting failure of a complex additively-manufactured geometry made of 316L stainless steel, we combined a rigorous material calibration scheme with a number of statistical assessments of problem uncertainties. Particularly, we used optimization techniques to calibrate a rate-dependent and anisotropic Hill plasticity model to represent material deformation coupled with a damage model driven by void growth and nucleation. Through targeted simulation studies we assessed the influence of internal voids and surface flaws on the specimens of interest in the challenge which guided our material modeling choices. Employing the Kolmogorov–Smirnov test statistic, we developed a representative suite of simulations to account for the geometric variability of test specimens and the variability introduced by material parameter uncertainty. This method allowed the team to successfully predict the failure mode of the experimental test population as well as the global response with a high degree of accuracy.

316L stainless steel↗
DOE OSTI2021

The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey quasar sample: testing observational systematics on the Baryon Acoustic Oscillation measurement

ABSTRACT Baryon Acoustic Oscillations (BAO) are considered to be a very robust standard ruler against various systematics. This premise has been tested against observational systematics, but not to the level required for the next generation of galaxy surveys such as the Dark Energy Spectroscopic Instrument (DESI) and Euclid. In this paper, we investigate the effect of observational systematics on the BAO measurement of the final sample of quasars from the extended Baryon Oscillation Spectroscopic Survey Data Release 16 in order to prepare and hone a similar analysis for upcoming surveys. We employ catalogues with various treatments of imaging systematic effects using linear and neural network-based non-linear approaches and consider how the BAO measurement changes. We also test how the variations to the BAO fitting model respond to the observational systematics. As expected, we confirm that the BAO measurements obtained from the DR16 quasar sample are robust against imaging systematics well within the statistical error, while reporting slightly modified constraints that shift the line-of-sight BAO signal by less than 1.1 per cent. We use realistic simulations with similar redshift and angular distributions as the DR16 sample to conduct statistical tests for validating the pipeline, quantifying the significance of differences, and estimating the expected bias on the BAO scale in future high-precision data sets. Although we find a marginal impact for the eBOSS QSO data, the work presented here is of vital importance for constraining the nature of dark energy with the BAO feature in the new era of big data cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRSDate not supplied

DO 365 Test Procedure Results and Analysis Discussion

CAL will leverage M&S tools and existing encounter data to evaluate the robustness of the DAA MOPS Test Procedures. Recently, the SC-147 ACAS-Xu team performed an analysis evaluating the Xu implementation against the DAA MOPS test procedures. Several areas of non-compliance were raised, some indicating shortfalls in our DAA test procedures and/or requirements. The ACAS-Xu team is expected to put out a report highlighting these exemptions. This work will build off that ACAS-Xu analysis/report and perform a full characterization of the statistical test procedures and document the findings. Additionally, CAL will provide recommendations for addressing these findings, potentially resulting in changes to test procedures and/or requirements.

ACAS-Xu↗
DOE OSTI2020

AFIP6-MkII and RERTR-12 Porosity Data Collection and Analysis for Modeling and Simulation

Gathering data for the improvement of nuclear fuel modeling and simulation efforts is the primary driver for this work. Mechanistic models allow for a better understanding of the material on a micro- and macrostructural level while saving time and money over traditional experiment efforts. Historically, summarized data and correlations are the inputs for empirical material models and model validation. When improving these models for nuclear fuels with experimental results, there is a lack of reliable data readily available. Experiments - RERTR-12 and AFIP6-MkII - were conducted to understand the irradiation behavior of metallic U-10Mo monolithic fuels for use in extreme reactor environments such as research reactors like the Advanced Test Reactor (ATR) or the High Flux Isotope Reactor (HFIR). Microstructural characteristics of fission gas pores (FGP) in each experiment are collected using an automated image analysis technique developed at the University of Florida and presented here. A series of statistical tests are performed to explore the reliability of the results, as well as understand where the data is lacking and what future data collection is necessary to provide sufficient information to assist modeling efforts. The focus is on the porosity, pore size, and eccentricity of FGPs formed during irradiation in three AFIP6-MkII samples and one RERTR-12 sample. From the analysis, it is clear there are substantial impacts of fission density on the pore structure, but there also exist also underlying connections between each sample and the behavior observed in the pores. Further analyses of the pre- and post-irradiation microstructure are needed to improve the understanding of these connections. An early method for microstructural data analysis is presented within and is currently being expanded to include other microstructure data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Detectability of neutrino-signal fluctuations induced by the hadron-quark phase transition in failing core-collapse supernovae

Here we introduce a systematic and quantitative methodology for establishing the presence of neutrino oscillatory signals due to the hadron-quark phase transition (PT) in failing core-collapse supernovae from the observed neutrino event rate in water- or ice-based neutrino detectors. The methodology uses a likelihood ratio in the frequency domain as a test-statistic; it is employed for quantitative analysis of neutrino signals without assuming the frequency, amplitude, starting time, and duration of the PT-induced oscillations present in the neutrino events and thus it is suitable for analyzing neutrino signals from a wide variety of numerical simulations. We test the validity of this method by using a core-collapse simulation of a 17 solar-mass star by Zha et al. [Astrophys. J. 911, 74 (2021) ]. Based on this model, we further report the presence of a PT-induced oscillations quantitatively for a core-collapse supernovae out to a distance of ~10 kpc, ~5 kpc for IceCube and to a distance of ~10 kpc, ~5 kpc, and ~1 kpc for a 0.4 Mt mass water Cherenkov detector. This methodology will aid the investigation of a future galactic supernova and the study of hadron-quark phase in the core of core-collapse supernovae.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1990

Thermal advection and stratification effects on surface winds and the low level meridional mass transport

Statistical tests are performed on the Seasat scatterometer observations to examine if and to what degree thermal advection and stratification effects manifest themselves in these remotely sensed measurements of mean wind and wind stress over the ocean. On the basis of a two layer baroclinic boundary layer model which is presented, it is shown that the thermal advection and stratification of the entire boundary layer as well as the geostrophic forcing influence the modeled near surface wind and wind stress profiles. Evidence of diurnal variation in the stratification under barotropic conditions is found in the data, with the daytime marine boundary layer being more convective than its nighttime counterpart. The temporal and spacial sampling pattern of the satellite makes it impossible to recover the full diurnal cycle, however. The observed effects of the thermal advection are shown to be statistically significant during the day (and presumed more convective) hours, causing a systematic increase in the poleward transport of mass and heat. The statistical results are in a qualitative agreement with the model simulations and cannot be reproduced in randomized control tests.

Levy, Gad↗
NASA NTRS1979

Application of modified profile analysis to function testing of the motion/no-motion issue in an aircraft ground-handling simulation

A recent modification of the methodology of profile analysis, which allows the testing for differences between two functions as a whole with a single test, rather than point by point with multiple tests is discussed. The modification is applied to the examination of the issue of motion/no motion conditions as shown by the lateral deviation curve as a function of engine cut speed of a piloted 737-100 simulator. The results of this application are presented along with those of more conventional statistical test procedures on the same simulator data.

Parrish, R. V.↗