Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Evaluation of dose recalculation vs dose deformation in a commercial platform for deformable image registration with a computational phantom

Deformable image registration (DIR) is an important tool for mapping both dose and contours of a new set of planning images when recurrent, that is, adaptive radiotherapy, or further treatment, that is, re-treatment, is required. The aim of this study was to evaluate the need for plan recalculation in deformed anatomies and to develop a reliable workflow for validating the DIR algorithm to be applied to dose warping such as dose accumulation (DA) for adaptive radiation therapy, and dose summation (DS) in the case of re-treatment. A set of 3 computational phantoms was developed to validate the application of B-Spline-based registrations for dose mapping among the various computed tomography image data sets. Two different versions were defined for each phantom to simulate clinical needs: adaptive radiotherapy and re-treatment; a DIR was performed to obtain a displacement vector field (DVF) for dose applications. Comparison of calculated and deformed doses was carried out by means of known markers inside the virtual phantoms. The differences were evaluated using a 3% dose index as acceptance criteria. A paired Wilcoxon signed-rank test was carried out to test the statistical significance of differences within the markers. Significant differences were only observed for the deformed dose in the DA test; no significant differences were observed for recalculated dose values in the DA and DS tests. The dose index is in accordance with these results. The warping dose process obtained by registering various sets of images was validated; a recalculation approach seems to be more accurate for DA purposes and image-guided adaptive radiation therapy (IGART) applications.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2017

Description of the LASSO Alpha 1 Release

The Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Climate Research Facility began a pilot project in May 2015 to design a routine, high-resolution modeling capability to complement ARM’s extensive suite of measurements. This modeling capability has been named the Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) project. The availability of LES simulations with concurrent observations will serve many purposes. LES helps bridge the scale gap between DOE ARM observations and models, and the use of routine LES adds value to observations. It provides a self-consistent representation of the atmosphere and a dynamical context for the observations. Further, it elucidates unobservable processes and properties. LASSO will generate a simulation library for researchers that enables statistical approaches beyond a single-case mentality. It will also provide tools necessary for modelers to reproduce the LES and conduct their own sensitivity experiments. Many different uses are envisioned for the combined LASSO LES and observational library. For an observationalist, LASSO can help inform instrument remote-sensing retrievals, conduct Observation System Simulation Experiments (OSSEs), and test implications of radar scan strategies or flight paths. For a theoretician, LASSO will help calculate estimates of fluxes and co-variability of values, and test relationships without having to run the model yourself. For a modeler, LASSO will help one know ahead of time which days have good forcing, have co-registered observations at high-resolution scales, and have simulation inputs and corresponding outputs to test parameterizations. Further details on the overall LASSO project are available at http://www.arm. gov/science/themes/lasso.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1993

Digital test signal generation: An accurate SNR calibration approach for the DSN

In support of the on-going automation of the Deep Space Network (DSN) a new method of generating analog test signals with accurate signal-to-noise ratio (SNR) is described. High accuracy is obtained by simultaneous generation of digital noise and signal spectra at the desired bandwidth (base-band or bandpass). The digital synthesis provides a test signal embedded in noise with the statistical properties of a stationary random process. Accuracy is dependent on test integration time and limited only by the system quantization noise (0.02 dB). The monitor and control as well as signal-processing programs reside in a personal computer (PC). Commands are transmitted to properly configure the specially designed high-speed digital hardware. The prototype can generate either two data channels modulated or not on a subcarrier, or one QPSK channel, or a residual carrier with one biphase data channel. The analog spectrum generated is on the DC to 10 MHz frequency range. These spectra may be up-converted to any desired frequency without loss on the characteristics of the SNR provided. Test results are presented.

Gutierrez-Luaces, Benito O.↗
DOE OSTI2022

Extreme variation in fatigue: Fatigue life prediction and dependence on build volume location in laser powder bed fusion of 17-4 stainless steel

Laser powder bed fusion (LPBF), a metal additive manufacturing technology, is well-suited for design optimization but fatigue life is limited by manufacturing defects. In this work, 17-4 stainless steel components were manufactured in densely populated build volumes, simulating at-scale LPBF production. Tests revealed extreme variability in fatigue life data, analyzed via rigorous statistical tools. The El-Haddad model, modified for finite-life, enabled defect-based life prediction. Specimen location within the build volume correlated to life, which was heteroscedastic. Investigating defect concentration over the build volume explained typical life and scatter. Finally, these findings argue for qualification approaches which acknowledge high material lot variability.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Quantitative cross-species translators of cardiac myocyte electrophysiology: Model training, experimental validation, and applications

Animal experimentation is key in the evaluation of cardiac efficacy and safety of novel therapeutic compounds. However, interspecies differences in the mechanisms regulating excitation-contraction coupling can limit the translation of experimental findings from animal models to human physiology and undermine the assessment of drugs’ efficacy and safety. Here, we built a suite of translators for quantitatively mapping electrophysiological responses in ventricular myocytes across species. We trained these statistical operators using a broad dataset obtained by simulating populations of our biophysically detailed computational models of action potential and Ca 2+ transient in mouse, rabbit, and human. We then tested our translators against experimental data describing the response to stimuli, such as ion channel block, change in beating rate, and β-adrenergic challenge. We demonstrate that this approach is well suited to predicting the effects of perturbations across different species or experimental conditions and suggest its integration into mechanistic studies and drug development pipelines.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

Comparison of Statistical Methods for Detector Testing Programs

A typical goal for any detector testing program is to ascertain not only the performance of the detector systems under test, but also the confidence that systems accepted using that testing program’s acceptance criteria will exceed a minimum acceptable performance (which is usually expressed as the minimum acceptable success probability, p). A similar problem often arises in statistics, where we would like to ascertain the fraction, p, of a population of items that possess a property that may take one of two possible values. Typically, the problem is approached by drawing a fixed sample of size n, with the number of items out of n that possess the desired property, x, being termed successes. The sample mean gives an estimate of the population mean p ≈ x/n, although usually it is desirable to accompany such an estimate with a statement concerning the range within which p may fall and the confidence associated with that range. Procedures for establishing such ranges and confidence limits are described in detail by Clopper, Brown, and Agresti for two-sided symmetric confidence intervals.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Description of the LASSO Data Bundles Product

The U. S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility began a pilot project in May 2015 to design a routine, high-resolution modeling capability to complement ARM’s extensive suite of measurements. This modeling capability has evolved into the Large-Eddy Simulation (LES) ARM Symbiotic Simulation and Observation (LASSO) datastream. The datastream, broadly termed data bundles, contains high-resolution model output, input files, observations for evaluation, and skill scores for the simulations. The initial focus of LASSO is on shallow convection at the ARM Southern Great Plains (SGP) atmospheric observatory. The availability of LES simulations with concurrent observations serves many purposes. LES helps bridge the scale gap between DOE ARM observations and models, and the use of routine LES adds value to observations. It provides a self-consistent representation of the atmosphere and a dynamical context for the observations. Further, it elucidates unobservable processes and properties. LASSO generates a simulation library for researchers that enables statistical approaches beyond a single-case mentality. It also provides tools necessary for modelers to reproduce the LES and conduct their own sensitivity experiments. The LASSO library of data bundles is designed to facilitate a wide range of research. For an observationalist, LASSO can help inform instrument remote-sensing retrievals, conduct observation system simulation experiments (OSSEs), and test implications of radar scan strategies or flight paths. For a theoretician, LASSO can help calculate estimates of fluxes and co-variability of values, and test relationships without having to run the model personally. For a modeler, LASSO can help one know ahead of time which days have good forcing, have co-registered observations at high-resolution scales, and have simulation inputs and corresponding outputs to test parameterizations. Further details on the overall LASSO project are available at https://www.arm.gov/capabilities/modeling/lasso.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1975

Reliability approach to rotating-component design

A probabilistic methodology for designing rotating mechanical components using reliability to relate stress to strength is explained. The experimental test machines and data obtained for steel to verify this methodology are described. A sample mechanical rotating component design problem is solved by comparing a deterministic design method with the new design-by reliability approach. The new method shows that a smaller size and weight can be obtained for specified rotating shaft life and reliability, and uses the statistical distortion-energy theory with statistical fatigue diagrams for optimum shaft design. Statistical methods are presented for (1) determining strength distributions for steel experimentally, (2) determining a failure theory for stress variations in a rotating shaft subjected to reversed bending and steady torque, and (3) relating strength to stress by reliability.

Kececioglu, D. B.↗
NASA NTRS1982

Quantiles, parametric-select density estimation, and bi-information parameter estimators

A quantile-based approach to statistical analysis and probability modeling of data is presented which formulates statistical inference problems as functional inference problems in which the parameters to be estimated are density functions. Density estimators can be non-parametric (computed independently of model identified) or parametric-select (approximated by finite parametric models that can provide standard models whose fit can be tested). Exponential models and autoregressive models are approximating densities which can be justified as maximum entropy for respectively the entropy of a probability density and the entropy of a quantile density. Applications of these ideas are outlined to the problems of modeling: (1) univariate data; (2) bivariate data and tests for independence; and (3) two samples and likelihood ratios. It is proposed that bi-information estimation of a density function can be developed by analogy to the problem of identification of regression models.

Parzen, E.↗
DOE OSTI2017

Behavior-based approach to misuse detection of a simulated SCADA system - 339

This paper presents the initial findings in applying a behavior-based approach for detection of unauthorized activities in a simulated Supervisory Control and Data Acquisition (SCADA) system. Misuse detection of this type utilizes fault-free system telemetry to develop empirical models that learn normal system behavior. Future monitored telemetry sources that show statistically significant deviations from this learned behavior may indicate an attack or other unwanted actions. The experimental test bed consists of a set of Linux based enterprise servers that were isolated from a larger university research cluster. All servers are connected to a private network and simulate several components and tasks seen in a typical SCADA system. Telemetry sources included kernel statistics, resource usages and internal system hardware measurements. For this study, the Auto Associative Kernel Regression (AAKR) and Auto Associative Multivariate State Estimation Technique (AAMSET) are employed to develop empirical models. Prognostic efficacy of these methods for computer security used several groups of signals taken from available telemetry classes. The Sequential Probability Ratio Test (SPRT) is used along with these models for intrusion detection purposes. The different intrusion types shown include host/network discovery, DoS, brute force login, privilege escalation and malicious exfiltration actions. For this study, all intrusion types tested displayed alterations in the residuals of much of the monitored telemetry and were able to be detected in all signal groups used by both model types. The methods presented can be extended and implemented to industries besides nuclear that use SCADA or business-critical networks. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1975

The application of satellite data in the determination of ocean temperatures and cloud characteristics and statistics

The author has identified the following significant results. The major shortcoming of the data was the loss of the infrared radiances from the S191 spectrometer. The cloud thermodynamic phase determination procedure was derived and tested with the data collected by the S192 multispectral scanner. Results of the test indicate a large fraction of the data could be classified thermodynamically. An added bonus was the inclusion of snow in the classification approach. The conclusion to be drawn from this portion of the effort is that in most cases considered ice clouds, liquid water droplet clouds, and snow fields can be spectroscopically separated to a high degree of accuracy.

Curran, R. J.↗
DOE OSTI2019

Debiasing cosmic gravitational wave sirens

ABSTRACT Accurate estimation of the Hubble constant, and other cosmological parameters, from distances measured by cosmic gravitational wave sirens requires sufficient allowance for the dark energy evolution. We demonstrate how model-independent statistical methods, specifically Gaussian process regression, can remove bias in the reconstruction of H(z), and can be combined to model independently with supernova distances. This allows stringent tests of both H0 and Λ cold dark matter, and can detect unrecognized systematics. We also quantify the redshift systematic control necessary for the use of dark sirens, showing that it must approach spectroscopic precision to avoid significant bias.

Keeley, Ryan E.↗
NASA NTRS1978

Filtration effects on ball bearing life and condition in a contaminated lubricant

Ball bearings were fatigue tested with a noncontaminated lubricant and with a contaminated lubricant under four levels of filtration. The test filters had absolute particle removal ratings of 3, 30, 49, and 105 microns. Aircraft turbine engine contaminants were injected into the filter's supply line at a constant rate of 125 milligrams per bearing hour. Bearing life and running track condition generally improved with finer filtration. The experimental lives of 3 and 30 micron filter bearings were statistically equivalent, approaching those obtained with the noncontaminated lubricant bearings. Compared to these bearings, the lives of the 49 micron bearings were statistically lower. The 105 micron bearings experienced gross wear. The degree of surface distress, weight loss, and probable failure mode were dependent on filtration level, with finer filtration being clearly beneficial.

Loewenthal, S. H.↗
NASA NTRS1978

Filtration effects on ball bearing life and condition in a contaminated lubricant

Ball bearings were fatigue tested with a noncontaminated MIL-L-23699 lubricant and with a contaminated MIL-L-23699 lubricant under four levels of filtration. The test filters had absolute particle removal ratings of 3, 30, 49, and 105 microns. Aircraft turbine engine contaminants were injected into the filter's supply line at a constant rate of 125 milligrams per bearing hour. Bearing life and running track condition generally improved with finer filtration. The experimental lives of 3- and 30-micron filter bearings were statistically equivalent, approaching those obtained with the noncontaminated lubricant bearings. Compared to these bearings, the lives of the 49-micron bearings were statistically lower. The 105-micron bearings experienced gross wear. The degree of surface distress, weight loss, and probable failure mode were dependent on filtration level, with finer filtration being clearly beneficial.

Loewenthal, S. H.↗
DOE OSTI2021

Estimating uncertainty: A Bayesian approach to modelling photosynthesis in C3 leaves

The Farquhar-von Caemmerer-Berry (FvCB) model is extensively used to model pho-tosynthesis from gas exchange measurements. Since its publication, many methods have been developed to measure, or more accurately estimate, parameters of this model. Here, we have created a tool that uses Bayesian statistics to fit photosyn-thetic parameters using concurrent gas exchange and chlorophyll fluorescence mea-surements whilst evaluating the reliability of the parameter estimation. We have tested this tool on synthetic data and experimental data from rice leaves. Our results indicate that reliable parameter estimation can be achieved whilst only keeping one parameter, Km, that is, Michaelis constant for CO2 by Rubisco, prefixed. Additionally, we show that including detailed low CO2 measurements at low light levels increases reliability and suggests this as a new standard measurement protocol. By providing an estimated distribution of parameter values, the tool can be used to evaluate the quality of data from gas exchange and chlorophyll fluorescence measurement proto-cols. Compared to earlier model fitting methods, the use of a Bayesian statistics-based tool minimizes human interaction during fitting, reducing the subjectivity which is essential to most existing tools. A user friendly, interactive Bayesian tool script is provided.

Bayesian statistics, leaf photosynthesis, mesophyl↗
NASA NTRS1995

A Bayesian approach to microwave precipitation profile retrieval

A multichannel passive microwave precipitation retrieval algorithm is developed. Bayes theorem is used to combine statistical information from numerical cloud models with forward radiative transfer modeling. A multivariate lognormal prior probability distribution contains the covariance information about hydrometeor distribution that resolves the nonuniqueness inherent in the inversion process. Hydrometeor profiles are retrieved by maximizing the posterior probability density for each vector of observations. The hydrometeor profile retrieval method is tested with data from the Advanced Microwave Precipitation Radiometer (10, 19, 37, and 85 GHz) of convection over ocean and land in Florida. The CP-2 multiparameter radar data are used to verify the retrieved profiles. The results show that the method can retrieve approximate hydrometeor profiles, with larger errors over land than water. There is considerably greater accuracy in the retrieval of integrated hydrometeor contents than of profiles. Many of the retrieval errors are traced to problems with the cloud model microphysical information, and future improvements to the algorithm are suggested.

Evans, K. Franklin↗
DOE OSTI2023

Direct Estimation of Parameters in ODE Models Using WENDy: Weak-Form Estimation of Nonlinear Dynamics

Abstract We introduce the Weak-form Estimation of Nonlinear Dynamics (WENDy) method for estimating model parameters for non-linear systems of ODEs. Without relying on any numerical differential equation solvers, WENDy computes accurate estimates and is robust to large (biologically relevant) levels of measurement noise. For low dimensional systems with modest amounts of data, WENDy is competitive with conventional forward solver-based nonlinear least squares methods in terms of speed and accuracy. For both higher dimensional systems and stiff systems, WENDy is typically both faster (often by orders of magnitude) and more accurate than forward solver-based approaches. The core mathematical idea involves an efficient conversion of the strong form representation of a model to its weak form, and then solving a regression problem to perform parameter inference. The core statistical idea rests on the Errors-In-Variables framework, which necessitates the use of the iteratively reweighted least squares algorithm. Further improvements are obtained by using orthonormal test functions, created from a set of $$C^{\infty }$$ C ∞ bump functions of varying support sizes.We demonstrate the high robustness and computational efficiency by applying WENDy to estimate parameters in some common models from population biology, neuroscience, and biochemistry, including logistic growth, Lotka-Volterra, FitzHugh-Nagumo, Hindmarsh-Rose, and a Protein Transduction Benchmark model. Software and code for reproducing the examples is available at https://github.com/MathBioCU/WENDy .

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Frequency Domain Methodology for Quantitative Evaluation of Diffuse Wavefield With Applications to Seismic Imaging

Abstract Ambient Noise Imaging (ANI) of subsurface structures relies on seismic interferometry of diffuse seismic wavefields. However, the lack of effective methods to quantify and identify highly diffuse waves hampers applications of ANI, particularly in evaluating seismic attenuation and monitoring structural changes with high temporal resolution. Conventional ANI approaches require data normalization, which effectively suppresses the non‐diffuse component with large amplitude but also results in significant loss of amplitude and phase information in the continuous seismic records. In this study, we propose a frequency domain method to quantitatively evaluate the degree of diffuseness of seismic wavefields by analyzing their statistical characteristics of modal amplitudes for stationarity and randomness. Tests on synthetic waveform and field nodal records show that the proposed method can effectively distinguish between diffuse and non‐diffuse waveforms for either single‐ or three‐component data. As an application, we identify a 60‐s‐long diffuse coda of a local M 2.2 earthquake recorded by a dense nodal array on the San Jacinto Fault Zone, and successfully extract high‐quality dispersion curve andQ‐value without performing data normalization. These results are consistent with those obtained by conventional methods that assess the correlation between coherency and the Green's function, and by modeling ballistic waves generated by road traffic. Our proposed method can advance the imaging of subsurface velocity and attenuation structures as well as monitoring temporal changes for scientific studies and engineering applications.

Geochemistry & Geophysics↗