Search NASA⌕ Search

SEARCH · Search NASA

Results for “test statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72

VADER: A Tool for Criticality Safety Validation

The purpose of criticality safety is to prevent any inadvertent criticality from occurring during the handling or storage of fissile material. Calculations are frequently used to demonstrate that a sufficient subcritical margin exists. Validation is a key aspect of the evaluation process, establishing the suitability, accuracy, and associated uncertainty of the computational method and data to be used for the intended application. The validation process is performed by comparing the results of critical experiments with the calculated results from models of the experiments using the computational method to be validated. Laboratory critical experiments are controlled systems that achieve a k eff of approximately 1 in order to investigate the parameters at which such a critical condition is achieved. The validation parameters that are traditionally applied to safety analysis calculations are the bias and the bias uncertainty . The bias is the deviation of the average k eff of the validation suite from unity. The bias uncertainty accounts for the statistical uncertainty in the bias based on the standard deviation, sample size, and distribution of k eff values of the validation suite. The values of bias and bias uncertainty ensure that the systems predicted to be subcritical by the computational method will indeed be subcritical. The bias and bias uncertainty are often combined to determine an upper subcritical limit (USL) or computational margin that can then be applied to safety analysis calculations. Many methods have been developed by different organizations to calculate the bias and bias uncertainty for various types of criticality analyses. Each of these methods typically requires that the validity of various underpinning statistical assumptions be confirmed to demonstrate that the method is appropriate for the analysis of a given validation suite. An example of the validation decision making flow is shown in Fig.1. As shown in Fig. 1, the analyst performing the validation fits a trend line to the data and performs a test to determine if the trend was a statistically better representation of the data than if it were treated as an uncorrelated sample. If the trend line is a better representation of the data, then the analyst uses any one of a number of trending techniques to determine the bias and bias uncertainty. If a trend is not an appropriate representation of the data, then the analyst proceeds to perform a normality assessment for the data. If the normal assumption can be shown to be acceptable, then the analyst calculates the bias and bias uncertainty with the parametric technique. If the assumption of normality cannot be justified, then the nonparametric technique is used. Once the decision flow has been followed and the appropriate technique has been selected, the bias and bias uncertainty is typically combined with an administrative margin to determine a USL below which calculated values of k eff for safety analysis models can be considered subcritical. The calculations used in each decision are often performed with spreadsheets or with small programs available at various sites performing criticality analyses. Expertise in understanding and interpreting the results must be maintained to perform these calculations. This can often be an error-prone process. Oak Ridge National Laboratory (ORNL) is currently developing the Validation and Data Evaluation Resource (VADER) to simplify and automate the criticality safety validation process and to provide a software quality assurance pedigree to the calculational methods used. This paper discusses the use of the Fulcrum user interface with VADER, the anticipated initial capabilities of VADER to perform validation analyses, and the output from the code.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Load sequence effects on graphite/epoxy /+, -35/2s laminates

Load sequence effects on composite material fatigue behavior are due to the difference in residual strength when fatigue occurs, or the 'boundary effect', and the 'material money effect' due to previous loads. The present model, which allows the isolation of the effects of memory from those of boundary, has been investigated through a test program for the case of /+, -35/2s graphite/epoxy laminates under high-low and low-high load sequences which generated statistical residual strength data. As predicted by the model, the memory effect is present and a good correlation is obtained between test results and the theoretical predictions for both median residual strength and the expected percentage of fatigue failures under dual loading. It is noted, however, that the statistical dispersion of the residual strength test results is much smaller than that of the static ultimate strength.

Yang, J. N.↗

Compensated gadolinium-loaded plastic scintillators for thermal neutron detection (and counting)

Plastic scintillator loading with gadolinium-rich organometallic complexes shows a high potential for the deployment of efficient and cost-effective neutron detectors. Due to the low-energy photon and electron signature of thermal neutron capture by gadolinium-155 and gadolinium-157, alternative treatment to Pulse Shape Discrimination has to be proposed in order to display a trustable count rate. This paper discloses the principle of a compensation method applied to a two-scintillator system: a detection scintillator interacts with photon radiation and is loaded with gadolinium organometallic compound to become a thermal neutron absorber, while a non-gadolinium loaded compensation scintillator solely interacts with the photon part of the incident radiation. Posterior to the nonlinear smoothing of the counting signals, a hypothesis test determines whether the resulting count rate after photon response compensation falls into statistical fluctuations or provides a robust image of a neutron activity. A laboratory prototype is tested under both photon and neutron irradiations, allowing us to investigate the performance of the overall compensation system in terms of neutron detection, especially with regards to a commercial helium-3 counter. The study reveals satisfactory results in terms of sensitivity and orientates future investigation toward promising axes. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Bayes Analysis and Reliability Implications of Stress-Rupture Testing a Kevlar/Epoxy COPV using Temperature and Pressure Acceleration

Composite Overwrapped Pressure Vessel (COPVs) that have survived a long service time under pressure generally must be recertified before service is extended. Sometimes lifetime testing is performed on an actual COPV in service in an effort to validate the reliability model that is the basis for certifying the continued flight worthiness of its sisters. Currently, testing of such a Kevlar49(registered TradeMark)/epoxy COPV is nearing completion. The present paper focuses on a Bayesian statistical approach to analyze the possible failure time results of this test and to assess the implications in choosing between possible model parameter values that in the past have had significant uncertainty. The key uncertain parameters in this case are the actual fiber stress ratio at operating pressure, and the Weibull shape parameter for lifetime; the former has been uncertain due to ambiguities in interpreting the original and a duplicate burst test. The latter has been uncertain due to major differences between COPVs in the data base and the actual COPVs in service. Any information obtained that clarifies and eliminates uncertainty in these parameters will have a major effect on the predicted reliability of the service COPVs going forward. The key result is that the longer the vessel survives, the more likely the more optimistic stress ratio is correct. At the time of writing, the resulting effect on predicted future reliability is dramatic, increasing it by about one nine , that is, reducing the probability of failure by an order of magnitude. However, testing one vessel does not change the uncertainty on the Weibull shape parameter for lifetime since testing several would be necessary.

Phoenix, S. Leigh↗

Response Variability in Commercial MOSFET SEE Qualification

Single-event effects (SEE) evaluation of five different part types of next generation, commercial trench MOSFETs indicates large part-to-part variation in determining a safe operating area (SOA) for drain-source voltage (V DS ) following a test campaign that exposed >50 samples per part type to heavy ions. These results suggest a determination of a SOA using small sample sizes may fail to capture the full extent of the part-to-part variability. An example method is discussed for establishing a Safe Operating Area using a one-sided statistical tolerance limit based on the number of test samples. Finally, burn-in is shown to be a critical factor in reducing part-to-part variation in part response. Implications for radiation qualification requirements are also explored.

43 PARTICLE ACCELERATORS↗

Learning likelihood ratios with neural network classifiers

The likelihood ratio is a crucial quantity for statistical inference in science that enables hypothesis testing, construction of confidence intervals, reweighting of distributions, and more. Many modern scientific applications, however, make use of data- or simulation-driven models for which computing the likelihood ratio can be very difficult or even impossible. By applying the so-called “likelihood ratio trick,” approximations of the likelihood ratio may be computed using clever parametrizations of neural network-based classifiers. A number of different neural network setups can be defined to satisfy this procedure, each with varying performance in approximating the likelihood ratio when using finite training data. We present a series of empirical studies detailing the performance of several common loss functionals and parametrizations of the classifier output in approximating the likelihood ratio of two univariate and multivariate Gaussian distributions as well as simulated high-energy particle physics datasets.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Mortality and Rates of Secondary Intervention After EVAR in an Unselected Population: Influence of Simple Clinical Categories and Implications for Surveillance

IntroductionPost-EVAR surveillance has a major impact upon patients, carers and healthcare resources. We hypothesised that elective indication, on-IFU anatomy, use of a modern device or normal first CTA, or a combination of these categories, might predict a rate of secondary intervention low enough to alter current surveillance protocols.MethodsPatients undergoing EVAR in our institution between 01.05.2007 and 28.02.2013 were assessed. Data on indication (elective, emergency), anatomy relative to IFU, device, first month CTA result, secondary intervention and mortality were obtained. Kaplan–Meier charts of mortality and freedom from secondary intervention were produced. Statistical analysis was by log-rank test and Cox proportional hazard modelling.Results234 patients underwent EVAR (188 elective, 208 on-IFU). Most implants were Endurant (106) or Talent (98). 151 patients had a normal first CTA. By median follow-up of 38.6 months, 39 patients underwent secondary intervention. A normal first CTA and elective indication were significantly associated with reduced risk of secondary intervention (p < 0.001 and p = 0.042 respectively), but device type and placement on- or off-IFU were not. Elective placement with a normal first CTA was 93 % predictive of freedom from secondary intervention by 32 months post-EVAR. Of nine patients undergoing secondary intervention in this group, eight presented symptomatically.DiscussionIn optimal procedural circumstances with normal post-procedural imaging, only 7 % of patients undergoing EVAR require secondary intervention, a minority of which is driven by surveillance. These data support a change to surveillance more tailored to the individual patient, and highlight the need for further qualitative and quantitative research.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Characteristics of a New X-Ray Imaging System for Interventional Procedures: Improved Image Quality and Reduced Radiation Dose

PurposeTo compare image quality and radiation exposure between a new angiographic imaging system and the preceding generation system during uterine artery embolization (UAE).Materials and MethodsIn this retrospective, IRB-approved two-arm study, 54 patients with symptomatic uterine fibroids were treated with UAE on two different angiographic imaging systems. The new system includes optimized acquisition parameters and real-time image processing algorithms. Air kerma (AK), dose area product (DAP) and acquisition time for digital fluoroscopy (DF) and digital subtraction angiography (DSA) were recorded. Body mass index was noted as well. DF image quality was assessed objectively by image noise measurements. DSA image quality was rated by two blinded, independent readers on a four-rank scale. Statistical differences were assessed with unpaired t tests and Wilcoxon rank-sum tests.ResultsThere was no significant difference between the patients treated on the new (n = 36) and the old system (n = 18) regarding age (p = 0.10), BMI (p = 0.18), DF time (p = 0.35) and DSA time (p = 0.17). The new system significantly reduced the cumulative AK and DAP by 64 and 72%, respectively (median 0.58 Gy and 145.9 Gy*cm{sup 2} vs. 1.62 Gy and 526.8 Gy*cm{sup 2}, p < 0.01 for both). Specifically, DAP for DF and DSA decreased by 59% (75.3 vs. 181.9 Gy*cm{sup 2}, p < 0.01) and 78% (67.6 vs. 312.2 Gy*cm{sup 2}, p < 0.01), respectively. The new system achieved a significant decrease in DF image noise (p < 0.01) and a significantly better DSA image quality (p < 0.01).ConclusionsThe new angiographic imaging system significantly improved image quality and reduced radiation exposure during UAE procedures.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Deep Learning for Subgrid‐Scale Turbulence Modeling in Large‐Eddy Simulations of the Convective Atmospheric Boundary Layer

Abstract In large‐eddy simulations, subgrid‐scale (SGS) processes are parameterized as a function of filtered grid‐scale variables. First‐order, algebraic SGS models are based on the eddy‐viscosity assumption, which does not always hold for turbulence. Here we apply supervised deep neural networks (DNNs) to learn SGS stresses from a set of neighboring coarse‐grained velocity from direct numerical simulations of the convective boundary layer at friction Reynolds numbers Re τ up to 1243 without invoking the eddy‐viscosity assumption. The DNN model was found to produce higher correlation between SGS stresses compared to the Smagorinsky model and the Smagorinsky‐Bardina mixed model in the surface and mixed layers and can be applied to different grid resolutions and various stability conditions ranging from near neutral to very unstable. The DNN model can capture key statistics of turbulence in a posteriori (online) tests when applied to large‐eddy simulations of the atmospheric boundary layer.

54 ENVIRONMENTAL SCIENCES↗

Comparing generalized ensemble methods for sampling of systems with many degrees of freedom

Here, we compare two standard replica exchange methods using temperature and dielectric constant as the scaling variables for independent replicas against two new corresponding enhanced sampling methods based on non-equilibrium statistical cooling (temperature) or descreening (dielectric). We test the four methods on a rough 1D potential as well as for alanine dipeptide in water, for which their relatively small phase space allows for the ability to define quantitative convergence metrics. We show that both dielectric methods are inferior to the temperature enhanced sampling methods, and in turn show that temperature cool walking (TCW) systematically outperforms the standard temperature replica exchange (TREx) method. We extend our comparisons of the TCW and TREx methods to the 5 residue met-enkephalin peptide, in which we evaluate the Kullback-Leibler divergence metric to show that the rate of convergence between two independent trajectories is faster for TCW compared to TREx. Finally we apply the temperature methods to the 42 residue amyloid-β peptide in which we find non-negligible differences in the disordered ensemble using TCW compared to the standard TREx. All four methods have been made available as software through the OpenMM Omnia software consortium.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The impact of anisotropic redshift distributions on angular clustering

A leading way to constrain physical theories from cosmological observations is to test their predictions for the angular clustering statistics of matter tracers, a technique that is set to become ever more central with the next generation of large imaging surveys. Interpretation of this clustering requires knowledge of the projection kernel, or the redshift distribution of the sources, and the typical assumption is an isotropic redshift distribution for the objects. However, variations in the kernel are expected across the survey footprint due to photometric variations and residual observational systematic effects. Here, we develop the formalism for anisotropic projection and present several limiting cases that elucidate the key aspects. We quantify the impact of anisotropies in the redshift distribution on a general class of angular two-point statistics. In particular, we identify a mode-coupling effect that can add power to auto-correlations, including galaxy clustering and cosmic shear, and remove it from certain cross-correlations. If the projection anisotropy is primarily at large scales, the mode-coupling depends upon its variance as a function of redshift; furthermore, it is often of similar shape to the signal. In contrast, the cross-correlation of a field whose selection function is anisotropic with another one featuring no such variations — such as CMB lensing — is immune to these effects. We discuss explicitly several special cases of the general formalism including galaxy clustering, galaxy-galaxy lensing, cosmic shear and cross-correlations with CMB lensing, and publicly release a code to compute the biases.

79 ASTRONOMY AND ASTROPHYSICS↗

Probing neutrino emission at GeV energies from compact binary mergers with the IceCube Neutrino Observatory

The advent of multimessenger astronomy has allowed for new types of source searches by neutrino detectors. Here, we present the results of the search for 0.5–100 GeV astrophysical neutrinos detected with IceCube and emitted from compact binary mergers detected by the LIGO, Virgo, and KAGRA interferometers from their first run of observation (O1) to the end of the first part of the fourth (O4a). An innovative approach is used to lower the energy threshold to 0.5 GeV and to search for an excess of GeV neutrinos in time coincidence with astrophysical transient events. Furthermore, we use a statistical combination of all observations, a binomial test, to search for a subpopulation of neutrino emitters. No significant excess was found from the studied mergers, with a best post-trial 𝑝-value of 40%, and there is currently no hint of a population of GeV neutrino emitters found in the IceCube data (post-trial 𝑝−value=81%).

Abbasi, R. [Loyola University Chicago]↗

At-wavelength characterization of X-ray wavefronts in Bragg diffraction from crystals

The advent of next-generation synchrotron radiation sources and X-ray free-electron lasers calls for high-quality Bragg-diffraction crystal optics to preserve the X-ray beam coherence and wavefront. This requirement brings new challenges in characterizing crystals in Bragg diffraction in terms of Bragg-plane height errors and wavefront phase distortions. Here, a quantitative methodology to characterize crystal optics using a state-of-the-art at-wavelength wavefront sensing technique and statistical analysis is proposed. The method was tested at the 1-BM-B optics testing beamline at the Advanced Photon Source for measuring silicon and diamond crystals in a self-referencing single-crystal mode and an absolute double-crystal mode. The phase error sensitivity of the technique is demonstrated to be at the λ/100 level required by most applications, such as the characterization of diamond crystals for cavity-based X-ray free-electron lasers.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Reducing Communication Overhead in Federated Learning for Network Anomaly Detection with Adaptive Client Selection

Communication overhead in federated learning (FL) poses a significant challenge for network anomaly detection systems, where the myriad of client configurations and network conditions can severely impact system efficiency and detection accuracy. While existing approaches attempt to address this through individual optimization techniques, they often fail to maintain the delicate balance between reduced overhead and detection performance. This paper presents an adaptive FL framework that dynamically combines batch size optimization, client selection, and asynchronous updates to achieve efficient anomaly detection. Through extensive profiling and experimental analysis on two distinct datasets-UNSW-NBIS for general network traffic and ROAD for automotive networks-our framework reduces communication overhead by 97.6%; (from 700.0s to 16.8s) compared to synchronous baseline approaches while maintaining comparable detection accuracy (95.10%; vs. 95.12%;). Statistical validation using Mann-Whitney U test confirms significant improvements (p < 0.05) over existing FL approaches across both datasets, demonstrating the framework's adaptability to different network security contexts. Detailed profiling analysis reveals the efficiency gains through dramatic reductions in GPU operations and memory transfers while maintaining robust detection performance under varying client conditions.

Marfo, William [University of Texas at El Paso]↗

Adaptive Client Selection in Federated Learning: A Network Anomaly Detection Use Case

Federated Learning (FL) has become a ubiquitous approach for training machine learning models on decentralized data, addressing the myriad privacy concerns inherent in traditional centralized methods. However, the efficiency of FL depends on effective client selection and robust privacy preservation mechanisms. Inadequate client selection may lead to suboptimal model performance, while insufficient privacy measures risk exposing sensitive data. This paper proposes a client selection framework for FL that integrates differential privacy and fault tolerance. Our adaptive approach dynamically adjusts the number of selected clients based on model performance and system constraints, ensuring privacy through calibrated noise addition. We evaluate our method on a network anomaly detection use case using the UNSW-NB15 and ROAD datasets. Results show up to a 7% increase in accuracy and a 25% reduction in training time compared to FedL2P. Moreover, we highlight the trade-offs between privacy budgets and model performance, with higher privacy budgets reducing noise and improving accuracy. Our fault tolerance mechanism, while causing a slight performance drop, enhances robustness to client failures. Statistical validation using Mann-Whitney U tests confirms the significance of these improvements (p < 0.05).

Marfo, William [University of Texas at El Paso,Dep↗

Federated Learning for Efficient Condition Monitoring and Anomaly Detection in Industrial Cyber-Physical Systems

Detecting and localizing anomalies in cyber-physical systems (CPS) has become increasingly challenging as systems grow in complexity, particularly due to varying sensor reliability and node failures in distributed environments. While federated learning (FL) offers a foundation for distributed model training, existing approaches lack mechanisms to handle these CPS-specific challenges. This paper presents an enhanced FL framework that introduces three key innovations: adaptive model aggregation based on sensor reliability, dynamic node selection for resource optimization, and Weibull-based checkpointing for fault tolerance. Our framework enables reliable condition monitoring while addressing the computational and reliability challenges of industrial CPS deployments. Experiments on NASA Bearing and Hydraulic System Datasets demonstrate superior performance over state-of-the-art FL methods, achieving 99.5% AUC-ROC in anomaly detection and maintaining accuracy under node failures. Statistical validation using Mann-Whitney (U) test confirms significant improvements (p < 0.05) in both detection accuracy and computational efficiency across diverse operational scenarios.1

Marfo, William [University of Texas at El Paso,Dep↗

MO-C-17A-06: Online Adaptive Re-Planning to Account for Independent Motions Between Multiple Targets During Radiotherapy of Lung Cancer

Purpose: To quantify interfractional independent motions between multiple targets in radiotherapy (RT) of lung cancer, and to study the dosimetric benefits of an online adaptive replanning method to account for these variations. Methods: Ninety five diagnostic-quality daily CTs acquired for 9 lung cancer patients treated with IGRT using an in-room CT (CTVision, Siemens) were analyzed. On each daily CT set, contours of the targets (GTV, CTV, or involved nodes) and organs at risk were generated by populating the planning contours using an auto-segmentation tool (ABAS, Elekta) with manual editing. For each patient, an IMRT plan was generated based on the planning CT with a prescription dose of 60 Gy in 2Gy fractions. Three plans were generated and compared for each daily CT set: an IGRT (repositioning) plan by copying the original plan with the required shifts, an online adaptive plan by rapidly modifying the aperture shapes and segment weights of the original plan to conform to the daily anatomy, and a new fully re-optimized plan based on the daily CT using a planning system (Panther, Prowess). Results: The daily deviations of the distance between centers of masses of the targets from the plans varied daily from -10 to 8 mm with an average −0.9±4.1 mm (one standard deviation). The average CTV V100 are 99.0±0.7%, 97.9±2.8%, 99.0±0.6%, and 99.1±0.6%, and the lung V20 Gy 928±332 cc, 944±315 cc, 917±300 cc, and 891±295 cc for the original, repositioning, adaptive, and re-optimized plans, respectively. Wilcoxon signed-rank tests show that the adaptive plans are statistically significantly better than the repositioning plans and comparable with the reoptimized plans. Conclusion: There exist unpredictable, interfractional, relative volume changes and independent motions between multiple targets during lung cancer RT which cannot be accounted for by the current IGRT repositioning but can be corrected by the online adaptive replanning method.

60 APPLIED LIFE SCIENCES↗

A two-stage method for microcalcification cluster segmentation in mammography by deformable models

Purpose: Segmentation of microcalcification (MC) clusters in x-ray mammography is a difficult task for radiologists. Accurate segmentation is prerequisite for quantitative image analysis of MC clusters and subsequent feature extraction and classification in computer-aided diagnosis schemes. Methods: In this study, a two-stage semiautomated segmentation method of MC clusters is investigated. The first stage is targeted to accurate and time efficient segmentation of the majority of the particles of a MC cluster, by means of a level set method. The second stage is targeted to shape refinement of selected individual MCs, by means of an active contour model. Both methods are applied in the framework of a rich scale-space representation, provided by the wavelet transform at integer scales. Segmentation reliability of the proposed method in terms of inter and intraobserver agreements was evaluated in a case sample of 80 MC clusters originating from the digital database for screening mammography, corresponding to 4 morphology types (punctate: 22, fine linear branching: 16, pleomorphic: 18, and amorphous: 24) of MC clusters, assessing radiologists’ segmentations quantitatively by two distance metrics (Hausdorff distance—HDIST{sub cluster}, average of minimum distance—AMINDIST{sub cluster}) and the area overlap measure (AOM{sub cluster}). The effect of the proposed segmentation method on MC cluster characterization accuracy was evaluated in a case sample of 162 pleomorphic MC clusters (72 malignant and 90 benign). Ten MC cluster features, targeted to capture morphologic properties of individual MCs in a cluster (area, major length, perimeter, compactness, and spread), were extracted and a correlation-based feature selection method yielded a feature subset to feed in a support vector machine classifier. Classification performance of the MC cluster features was estimated by means of the area under receiver operating characteristic curve (Az ± Standard Error) utilizing tenfold cross-validation methodology. A previously developed B-spline active rays segmentation method was also considered for comparison purposes. Results: Interobserver and intraobserver segmentation agreements (median and [25%, 75%] quartile range) were substantial with respect to the distance metrics HDIST{sub cluster} (2.3 [1.8, 2.9] and 2.5 [2.1, 3.2] pixels) and AMINDIST{sub cluster} (0.8 [0.6, 1.0] and 1.0 [0.8, 1.2] pixels), while moderate with respect to AOM{sub cluster} (0.64 [0.55, 0.71] and 0.59 [0.52, 0.66]). The proposed segmentation method outperformed (0.80 ± 0.04) statistically significantly (Mann-Whitney U-test, p < 0.05) the B-spline active rays segmentation method (0.69 ± 0.04), suggesting the significance of the proposed semiautomated method. Conclusions: Results indicate a reliable semiautomated segmentation method for MC clusters offered by deformable models, which could be utilized in MC cluster quantitative image analysis.

60 APPLIED LIFE SCIENCES↗