Search NASA⌕ Search

SEARCH · Search NASA

Results for “nonparametric testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Efficient fault diagnosis of helicopter gearboxes

Application of a diagnostic system to a helicopter gearbox is presented. The diagnostic system is a nonparametric pattern classifier that uses a multi-valued influence matrix (MVIM) as its diagnostic model and benefits from a fast learning algorithm that enables it to estimate its diagnostic model from a small number of measurement-fault data. To test this diagnostic system, vibration measurements were collected from a helicopter gearbox test stand during accelerated fatigue tests and at various fault instances. The diagnostic results indicate that the MVIM system can accurately detect and diagnose various gearbox faults so long as they are included in training.

Chin, H.↗

Validation of the dynamic response of a blade-element UH-60 simulation model in hovering flight

The dynamic fidelity of an operational blade-element simulation model of the UH-60A helicopter is assessed for the hovering and low-speed flight regimes. Nonparametric frequency-response identification techniques and time-history comparisons are used to determine the validity of vehicle responses. Frequency-domain methods are applied to the model to isolate deficiencies and verify refinements and corrections. A dedicated flight-test program was conducted to provide data used in the analyses. Model deficiencies are also identified by using side-by-side pilot assessments of a motion-based simulation and of a test aircraft. Model refinements are found to improve fidelity significantly in the frequency range of interest to handling-qualities research. The applicability of the model to high-bandwidth flight-control research is also discussed.

Ballin, Mark G.↗

Uncertainty Estimates of Psychoacoustic Thresholds Obtained from Group Tests

Adaptive psychoacoustic test methods, in which the next signal level depends on the response to the previous signal, are the most efficient for determining psychoacoustic thresholds of individual subjects. In many tests conducted in the NASA psychoacoustic labs, the goal is to determine thresholds representative of the general population. To do this economically, non-adaptive testing methods are used in which three or four subjects are tested at the same time with predetermined signal levels. This approach requires us to identify techniques for assessing the uncertainty in resulting group-average psychoacoustic thresholds. In this presentation we examine the Delta Method of frequentist statistics, the Generalized Linear Model (GLM), the Nonparametric Bootstrap, a frequentist method, and Markov Chain Monte Carlo Posterior Estimation and a Bayesian approach. Each technique is exercised on a manufactured, theoretical dataset and then on datasets from two psychoacoustics facilities at NASA. The Delta Method is the simplest to implement and accurate for the cases studied. The GLM is found to be the least robust, and the Bootstrap takes the longest to calculate. The Bayesian Posterior Estimate is the most versatile technique examined because it allows the inclusion of prior information.

Rathsam, Jonathan↗

A Bayesian Approach for Estimating Uncertainty in Stochastic Economic Dispatch considering Wind Power Penetration

The increasing penetration of renewable energy resources in power systems, represented as random processes, converts the traditional deterministic economic dispatch problem into a stochastic one. To estimate the uncertainty in this stochastic economic dispatch problem for forecasting purposes, the conventional Monte-Carlo method is prohibitively time-consuming for practical applications. To overcome this problem, here we propose a novel Gaussian-process-emulator-based approach to quantify the uncertainty in the stochastic economic dispatch considering wind power penetration. Facing high-dimensional real-world data representing the correlated uncertainties from wind generation, a manifold-learning-based Isomap algorithm is proposed to efficiently represent the low-dimensional hidden probabilistic structure of the data. In this low-dimensional latent space, with Latin hypercube sampling as the computer experimental design, a Gaussian-process emulator is used, for the first time, to serve as a nonparametric, surrogate model for the original complicated stochastic economic dispatch model. This reduced-order representative allows us to evaluate the economic dispatch solver at sampled values with a negligible computational cost while maintaining a desirable accuracy. Simulation results conducted on the IEEE 118-bus test system reveal the impressive performance of the proposed method.

17 WIND ENERGY↗

Confidence Intervals for Laboratory Sonic Boom Annoyance Tests

Commercial supersonic flight is currently forbidden over land because sonic booms have historically caused unacceptable annoyance levels in overflown communities. NASA is providing data and expertise to noise regulators as they consider relaxing the ban for future quiet supersonic aircraft. One deliverable NASA will provide is a predictive model for indoor annoyance to aid in setting an acceptable quiet sonic boom threshold. A laboratory study was conducted to determine how indoor vibrations caused by sonic booms affect annoyance judgments. The test method required finding the point of subjective equality (PSE) between sonic boom signals that cause vibrations and signals not causing vibrations played at various amplitudes. This presentation focuses on a few statistical techniques for estimating the interval around the PSE. The techniques examined are the Delta Method, Parametric and Nonparametric Bootstrapping, and Bayesian Posterior Estimation.

Rathsam, Jonathan↗

Wavelet Filtering to Reduce Conservatism in Aeroservoelastic Robust Stability Margins

Wavelet analysis for filtering and system identification was used to improve the estimation of aeroservoelastic stability margins. The conservatism of the robust stability margins was reduced with parametric and nonparametric time-frequency analysis of flight data in the model validation process. Nonparametric wavelet processing of data was used to reduce the effects of external desirableness and unmodeled dynamics. Parametric estimates of modal stability were also extracted using the wavelet transform. Computation of robust stability margins for stability boundary prediction depends on uncertainty descriptions derived from the data for model validation. F-18 high Alpha Research Vehicle aeroservoelastic flight test data demonstrated improved robust stability prediction by extension of the stability boundary beyond the flight regime.

Brenner, Marty↗

On-Line Robust Modal Stability Prediction using Wavelet Processing

Wavelet analysis for filtering and system identification has been used to improve the estimation of aeroservoelastic stability margins. The conservatism of the robust stability margins is reduced with parametric and nonparametric time- frequency analysis of flight data in the model validation process. Nonparametric wavelet processing of data is used to reduce the effects of external disturbances and unmodeled dynamics. Parametric estimates of modal stability are also extracted using the wavelet transform. Computation of robust stability margins for stability boundary prediction depends on uncertainty descriptions derived from the data for model validation. The F-18 High Alpha Research Vehicle aeroservoelastic flight test data demonstrates improved robust stability prediction by extension of the stability boundary beyond the flight regime. Guidelines and computation times are presented to show the efficiency and practical aspects of these procedures for on-line implementation. Feasibility of the method is shown for processing flight data from time- varying nonstationary test points.

Brenner, Martin J.↗

A nonparametric software reliability growth model

Miller and Sofer have presented a nonparametric method for estimating the failure rate of a software program. The method is based on the complete monotonicity property of the failure rate function, and uses a regression approach to obtain estimates of the current software failure rate. This completely monotone software model is extended. It is shown how it can also provide long-range predictions of future reliability growth. Preliminary testing indicates that the method is competitive with parametric approaches, while being more robust.

Miller, Douglas R.↗

Nonparametric Multiparticle Set Methods for Interpreting Environmental Samples

Collection and analysis of environmental samples is commonly used by a range of stakeholders in nuclear safeguards and security contexts. While the ubiquity of samples and their transport in the environment allow regular collection, developing and demonstrating methods for analyzing these samples is difficult. In this work, an environmental sample consists of a set of one or more individual particles. Recent advances in reactor simulation have allowed us to generate data that are more representative of real-world environmental samples, enabling statistically defensible method development and testing. The most notable of these advances is a drastic increase in the number of material depletion regions, which allows our simulations to capture the variation in isotopic composition seen at length scales consistent with environmental samples. Traditional approaches for handling multiparticle samples treat each particle in the sample individually, estimating the quantity of interest (e.g., core-average burnup) resulting from measurement and analysis of signatures (e.g., nuclide assays) from each individual particle. Individual estimates are then averaged to generate a single estimate of the quantity of interest over the entire sample. In this presentation, we introduce two novel approaches for interpreting environmental samples that comprise of multiple particles: (1) the Quantile-Quantile Comparator, which uses a multivariate generalization of quantile-quantile plots for comparing unknown statistical distributions, and (2) the Set Transformer, an attention-based neural network module designed to model interactions among elements (particles) in the input set (sample). Statistically representative sampling cannot be guaranteed as samples are passively collected and are beholden to what particles are available in the environment. These new analysis methods for set-input problems are expected to be more robust than traditional approaches to issues of sampling bias where particles are not uniformly distributed throughout regions of interest, as well as generally outperform traditional approaches by jointly considering all elements in the set. We will present results comparing the performance of traditional single particle approaches and the novel Quantile-Quantile Comparator and Set Transformer for interpretation of simulated environmental samples.

Phathanapirom, Birdy↗

Spirometric traits show quantile-dependent heritability, which may contribute to their gene-environment interactions with smoking and pollution

Background: “Quantile-dependent expressivity” refers to a genetic effect that is dependent upon whether the phenotype (e.g., spirometric data) is high or low relative to its population distribution. Forced vital capacity (FVC), forced expiratory volume in 1 second (FEV 1 ), and the FEV 1 /FVC ratio are moderately heritable spirometric traits. The aim of the analyses is to test whether their heritability (h 2 ) is constant over all quantiles of their distribution. Methods: Quantile regression was applied to the mean age, sex, height and smoking-adjusted spirometric data over multiple visits in 9,993 offspring-parent pairs and 1,930 sibships from the Framingham Heart Study to obtain robust estimates of offspring-parent (β OP ), offspring-midparent (β OM ), and full-sib regression slopes (β FS ). Nonparametric significance levels were obtained from 1,000 bootstrap samples. β OP s were used as simple indicators of quantile-specific heritability (i.e.,h 2 = 2β OP /(1+r spouse ), where r spouse was the correlation between spouses). Results: β OP ± standard error (SE) decreased by 0.0009 ± 0.0003 (P = 0.003) with every one-percent increment in the population distribution of FEV 1 /FVC, i.e., β OP ± SE were: 0.182 ± 0.031, 0.152 ± 0.015; 0.136 ± 0.011; 0.121 ± 0.013; and 0.099 ± 0.013 at the 10th, 25th, 50th, 75th, and 90th percentiles of the FEV 1 /FVC distribution, respectively. These correspond to h 2 ± SEs of 0.350 ± 0.060 at the 10th, 0.292 ± 0.029 at the 25th, 0.262 ± 0.020 at the 50th, 0.234 ± 0.025 at the 75th, and 0.191 ± 0.025 at the 90th percentiles of the FEV 1 /FVC ratio. Maximum mid-expiratory flow (MMEF) h 2 ± SEs increased 0.0025 ± 0.0007 (P = 0.0004) with every one-percent increment in its distribution, i.e.: 0.467 ± 0.046, 0.467 ± 0.033, 0.554 ± 0.038, 0.615 ± 0.042, and 0.675 ± 0.060 at the 10th, 25th, 50th, 75th, and 90th percentiles of its distribution. This was due to forced expiratory flow at 75% of FVC (FEF75%), whose quantile-specific h 2 increased an average of 0.0042 ± 0.0008 for every one-percent increment in its distribution. It is speculated that previously reported gene-environment interactions may be partially attributable to quantile-specific h 2 , i.e., greater heritability in individuals with lower FEV 1 /FVC due to smoking or airborne particles exposure vs. nonsmoking, unexposed individuals. Conclusion: Heritabilities of FEV 1 /FVC, MMEF, and FEF75% from quantile-regression of offspring-parent and sibling spirometric data suggest their quantile-dependent expressivity.

59 BASIC BIOLOGICAL SCIENCES↗

Phenomenology of large scale structure in scalar-tensor theories: Joint prior covariance of w DE , Σ, and μ in Horndeski theories

Ongoing and upcoming cosmological surveys will significantly improve our ability to probe the equation of state of dark energy, w DE , and the phenomenology of large scale structure. They will allow us to constrain deviations from the Λ cold dark matter predictions for the relations between the matter density contrast and the weak lensing and the Newtonian potential, described by the functions Σ and μ, respectively. In this work, we derive the theoretical prior for the joint covariance of w DE , Σ and μ, expected in general scalar-tensor theories with second order equations of motion (Horndeski gravity), focusing on their time-dependence at certain representative scales. We employ Monte Carlo methods to generate large ensembles of statistically independent Horndeski models, focusing on those that are physically viable and in broad agreement with local tests of gravity, the observed cosmic expansion history and the measurement of the speed of gravitational waves from a binary neutron star merger. Here, we identify several interesting features and trends in the distribution functions of w DE , Σ and μ, as well as in their covariances; we confirm the high degree of correlation between Σ and μ in scalar-tensor theories. The derived prior covariance matrices will allow us to reconstruct jointly w DE , Σ and μ in a nonparametric way.

79 ASTRONOMY AND ASTROPHYSICS↗

Quantile-Dependent Expressivity of Serum Uric Acid Concentrations

“Quantile-dependent expressivity” occurs when the effect size of a genetic variant depends upon whether the phenotype (e.g., serum uric acid) is high or low relative to its distribution. Analyses were performed to test whether serum uric acid heritability is quantile-specific and whether this could explain some reported gene-environment interactions. Methods. Serum uric acid concentrations were analyzed from 2151 sibships and 12,068 offspring-parent pairs from the Framingham Heart Study. Quantile-specific heritability from offspring-parent regression slopes (β OP , h 2 = 2β OP /(1 + r spouse )) and full-sib regression slopes (β FS ,h 2 = {(1 + 8r spouse β FS ) 0.5 - 1}/(2r spouse ) was robustly estimated by quantile regression with nonparametric significance assigned from 1000 bootstrap samples. Results. Quantile-specific h 2 (±SE) increased with increasing percentiles of the offspring’s sex- and age-adjusted uric acid distribution when estimated from β OP (P trend = 0.001): 0.34 ± 0.03 at the 10th, 0.36 ± 0.03 at the 25th, 0.41 ± 0.03 at the 50th, 0.46 ± 0.04 at the 75th, and 0.49 ± 0.05 at the 90th percentile and when estimated from β FS (P trend = 0.006). This is consistent with the larger genetic effect size of (1) the SLC2A9 rs11722228 polymorphism in gout patients vs. controls, (2) the ABCG2 rs2231142 polymorphism in men vs. women, (3) the SLC2A9 rs13113918 polymorphism in obese patients prior to bariatric surgery vs. two-year postsurgery following 29 kg weight loss, (4) the ABCG2 rs6855911 polymorphism in obese vs. nonobese women, and (5) the LRP2 rs2544390 polymorphism in heavier drinkers vs. abstainers. Quantile-dependent expressivity may also explain the larger genetic effect size of an SLC2A9/PKD2/ABCG2 haplotype for high vs. low intakes of alcohol, chicken, or processed meats. Conclusions. Heritability of serum uric acid concentrations is quantile-specific.

59 BASIC BIOLOGICAL SCIENCES↗

An Entropy-Based Test and Development Framework for Uncertainty Modeling in Level-Set Visualizations

We present a simple comparative framework for testing and developing uncertainty modeling in uncertain marching cubes implementations. The selection of a model to represent the probability distribution of uncertain values directly influences the memory use, run time, and accuracy of an uncertainty visualization algorithm. We use an entropy calculation directly on ensemble data to establish an expected result and then compare the entropy from various probability models, including uniform, Gaussian, histogram, and quantile models. Our results verify that models matching the distribution of the ensemble indeed match the entropy. We further show that fewer bins in nonparametric histogram models are more effective whereas large numbers of bins in quantile models approach data accuracy.

Sisneros, Robert↗

The Initial Mass Function in the Nearest Strong Lenses from SNELLS: Assessing the Consistency of Lensing, Dynamical, and Spectroscopic Constraints

We present new observations of the three nearest early-type galaxy (ETG) strong lenses discovered in the SINFONI Nearby Elliptical Lens Locator Survey (SNELLS). Based on their lensing masses, these ETGs were inferred to have a stellar initial mass function (IMF) consistent with that of the Milky Way, not the bottom-heavy IMF that has been reported as typical for high- σ ETGs based on lensing, dynamical, and stellar population synthesis techniques. We use these unique systems to test the consistency of IMF estimates derived from different methods. We first estimate the stellar M {sub *}/ L using lensing and stellar dynamics. We then fit high-quality optical spectra of the lenses using an updated version of the stellar population synthesis models developed by Conroy and van Dokkum. When examined individually, we find good agreement among these methods for one galaxy. The other two galaxies show 2–3 σ tension with lensing estimates, depending on the dark matter contribution, when considering IMFs that extend to 0.08 M {sub ⊙}. Allowing a variable low-mass cutoff or a nonparametric form of the IMF reduces the tension among the IMF estimates to <2 σ . There is moderate evidence for a reduced number of low-mass stars in the SNELLS spectra, but no such evidence in a composite spectrum of matched- σ ETGs drawn from the SDSS. Such variation in the form of the IMF at low stellar masses ( m ≲ 0.3 M {sub ⊙}), if present, could reconcile lensing/dynamical and spectroscopic IMF estimates for the SNELLS lenses and account for their lighter M {sub *}/ L relative to the mean matched- σ ETG. We provide the spectra used in this study to facilitate future comparisons.

79 ASTRONOMY AND ASTROPHYSICS↗

Non-Intrusive Appliance Identification with Appliance-Specific Networks

The problem of noninstrusive load monitoring (NILM) is usually formulated as a single-channel blind source separation task, whose successful solution enable fast and convenient load identification and energy disaggregation. When applied at test time, NILM algorithms aim to identify the operating characteristics of individual appliances from an aggregate power measurement of the entire house. Recent advances in deep learning gave rise to many methods that mostly focus on learning a direct mapping from aggregate measurement to individual appliance power. However, these methods are not only computationally expensive, but they often suffer from overfitting and do not generalize very well. In this article, we propose a novel NILM method that leverages advances in statistical learning that have not been properly applied in this domain before. The proposed method consists of three stages: first, a Bayesian nonparametric learning-based approach for appliance state extraction; second, synthetic minority oversampling technique for data augmentation and mitigating the heavy imbalance in switching events; and third, appliance-specific lightweight long short-term memory networks for status classification for each appliance. Here, we adopt a “differential” input (the difference before and after the switching event) to reduce the complexity of network training and make the proposed method robust to multiappliance switching events. Experiments are conducted to demonstrate the effectiveness of the proposed method, achieving superior performance when compared to recent methods. An ablation study is conducted to demonstrate the effectiveness of each module of our method. Finally, we investigate the quality of generated synthetic samples.

42 ENGINEERING↗

Arbitrarily accurate, nonparametric coarse graining with Markov renewal processes and the Mori–Zwanzig formulation

Stochastic dynamics, such as molecular dynamics, are important in many scientific applications. However, summarizing and analyzing the results of such simulations is often challenging due to the high dimension in which simulations are carried out and, consequently, due to the very large amount of data that are typically generated. Coarse graining is a popular technique for addressing this problem by providing compact and expressive representations. Coarse graining, however, potentially comes at the cost of accuracy, as dynamical information is, in general, lost when projecting the problem in a lower-dimensional space. This article shows how to eliminate coarse-graining error using two key ideas. First, we represent coarse-grained dynamics as a Markov renewal process. Second, we outline a data-driven, non-parametric Mori–Zwanzig approach for computing jump times of the renewal process. Numerical tests on a small protein illustrate the method.

36 MATERIALS SCIENCE↗

VADER: A Tool for Criticality Safety Validation

The purpose of criticality safety is to prevent any inadvertent criticality from occurring during the handling or storage of fissile material. Calculations are frequently used to demonstrate that a sufficient subcritical margin exists. Validation is a key aspect of the evaluation process, establishing the suitability, accuracy, and associated uncertainty of the computational method and data to be used for the intended application. The validation process is performed by comparing the results of critical experiments with the calculated results from models of the experiments using the computational method to be validated. Laboratory critical experiments are controlled systems that achieve a k eff of approximately 1 in order to investigate the parameters at which such a critical condition is achieved. The validation parameters that are traditionally applied to safety analysis calculations are the bias and the bias uncertainty . The bias is the deviation of the average k eff of the validation suite from unity. The bias uncertainty accounts for the statistical uncertainty in the bias based on the standard deviation, sample size, and distribution of k eff values of the validation suite. The values of bias and bias uncertainty ensure that the systems predicted to be subcritical by the computational method will indeed be subcritical. The bias and bias uncertainty are often combined to determine an upper subcritical limit (USL) or computational margin that can then be applied to safety analysis calculations. Many methods have been developed by different organizations to calculate the bias and bias uncertainty for various types of criticality analyses. Each of these methods typically requires that the validity of various underpinning statistical assumptions be confirmed to demonstrate that the method is appropriate for the analysis of a given validation suite. An example of the validation decision making flow is shown in Fig.1. As shown in Fig. 1, the analyst performing the validation fits a trend line to the data and performs a test to determine if the trend was a statistically better representation of the data than if it were treated as an uncorrelated sample. If the trend line is a better representation of the data, then the analyst uses any one of a number of trending techniques to determine the bias and bias uncertainty. If a trend is not an appropriate representation of the data, then the analyst proceeds to perform a normality assessment for the data. If the normal assumption can be shown to be acceptable, then the analyst calculates the bias and bias uncertainty with the parametric technique. If the assumption of normality cannot be justified, then the nonparametric technique is used. Once the decision flow has been followed and the appropriate technique has been selected, the bias and bias uncertainty is typically combined with an administrative margin to determine a USL below which calculated values of k eff for safety analysis models can be considered subcritical. The calculations used in each decision are often performed with spreadsheets or with small programs available at various sites performing criticality analyses. Expertise in understanding and interpreting the results must be maintained to perform these calculations. This can often be an error-prone process. Oak Ridge National Laboratory (ORNL) is currently developing the Validation and Data Evaluation Resource (VADER) to simplify and automate the criticality safety validation process and to provide a software quality assurance pedigree to the calculational methods used. This paper discusses the use of the Fulcrum user interface with VADER, the anticipated initial capabilities of VADER to perform validation analyses, and the output from the code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Stellar Mass Calibrations for Local Low-mass Galaxies

The stellar masses of galaxies are measured from integrated light via several methods—however, few of these methods were designed for low-mass (M ⋆ ≲ 10 8 M ⊙ ) “dwarf” galaxies, whose properties (e.g., stochastic star formation, low metallicity) pose unique challenges for estimating stellar masses. In this work, we quantify the precision and accuracy at which stellar masses of low-mass galaxies can be recovered using UV/optical/IR photometry. We use mock observations of 469 low-mass galaxies from a variety of models, including both semi-empirical models (GRUMPY and UniverseMachine-SAGA) and cosmological baryonic zoom-in simulations (MARVELous Dwarfs and FIRE-2), to test literature color–M ⋆ /L relations and multiwavelength spectral energy distribution (SED) mass estimators. We identify a list of “best practices” for measuring stellar masses of low-mass galaxies from integrated photometry. We find that literature color–M ⋆ /L relations are often unable to capture the bursty star formation histories (SFHs) of low-mass galaxies, and we develop an updated prescription for stellar mass based on g − r color that is better able to recover stellar masses for the bursty low-mass galaxies in our sample (with ∼0.1 dex precision). SED fitting can also precisely recover stellar masses of low-mass galaxies, but this requires thoughtful choices about the form of the assumed SFH: Parametric SFHs can underestimate stellar mass by as much as ∼0.4 dex, while nonparametric SFHs recover true stellar masses with insignificant offset (−0.03 ± 0.11 dex). Finally, we also caution that noninformative (wide) dust attenuation priors may introduce M ⋆ uncertainties of up to ∼0.6 dex.

de los Reyes, Mithi A. C. [Amherst College, MA (Un↗