Search NASA⌕ Search

SEARCH · Search NASA

Results for “test statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Periodicity significance testing with null-signal templates: reassessment of PTF’s SMBH binary candidates

Periodograms are widely employed for identifying periodicity in time series data, yet they often struggle to accurately quantify the statistical significance of detected periodic signals when the data complexity precludes reliable simulations. We develop a data-driven approach to address this challenge by introducing a null-signal template (NST). The NST is created by carefully randomizing the period of each cycle in the periodogram template, rendering it non-periodic. It has the same frequentist properties as a periodic signal template, and we show with simulations that the distribution of false positives is the same as with the original periodic template, regardless of the underlying data. Thus, performing a periodicity search with the NST acts as an effective simulation of the null (no-signal) hypothesis, without having to simulate the noise properties of the data. We apply the NST method to the supermassive black hole binaries (SMBHB) search in the Palomar Transient Factory (PTF), where Charisi et al. had previously proposed 33 high signal-to-noise candidates utilizing simulations to quantify their significance. Our approach reveals that these simulations do not capture the complexity of the real data. There are no statistically significant periodic signal detections above the non-periodic background. To improve the search sensitivity, we introduce a Gaussian quadrature based algorithm for the Bayes Factor with correlated noise as a test statistic. We show with simulations that this improves sensitivity to true signals by more than an order of magnitude. However, the Bayes Factor approach also results in no statistically significant detections in the PTF data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Test Vector Development for Verification and Validation of Heavy-Duty Autonomous Vehicle Operations

The current focus in the ongoing development of autonomous driving systems (ADS) for heavy duty vehicles is that of vehicle operational safety. To this end, developers and researchers alike are working towards a complete understanding of the operating environments and conditions that autonomous vehicles are subject to during their mission. This understanding is critical to the testing and validation phases of the development of autonomous vehicles and allows for the identification of both the nominal and edge case scenarios encountered by these systems. Previous work by the authors saw the development of a comprehensive scenario generation framework to identify an operating domain specification (ODS), or external and internal conditions an autonomous driving system can expect to encounter on its mission to form critical scenario groups for autonomous vehicle testing and validating using statistical patterns, clustering, and correlation. Continuing this prior work, this paper focuses on the generation of test cases based on the critical scenarios identified that can be used to prioritize either the most common nominal driving scenarios or the least common severe driving scenarios. These test cases can then be used validate, through simulation or real-world testing, the operating design domain (ODD) for a generalized driving mission and built upon to identify spatial and temporal impacts on the driving mission of an autonomous vehicle.

Siekmann, Adam↗
DOE OSTI2024

On the use of Graphs for Test Sequence Selection

This report demonstrates that applying graph theory techniques provides a way to obtain sufficient statistics in finding errors when testing complex state machines. It discusses how to define the tests, then demonstrates how to automatically generate test suites that diversify test cases, subject to constraints. If included within a continuous integration approach, these constructs provide an unbiased means to systematically check for errors within the latest controller software release.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

The Aemulus Project. VI. Emulation of Beyond-standard Galaxy Clustering Statistics to Improve Cosmological Constraints

Abstract There is untapped cosmological information in galaxy redshift surveys in the nonlinear regime. In this work, we use the Aemulus suite of cosmological N -body simulations to construct Gaussian process emulators of galaxy clustering statistics at small scales (0.1–50 h −1 Mpc) in order to constrain cosmological and galaxy bias parameters. In addition to standard statistics—the projected correlation function w p ( r p ), the redshift-space monopole of the correlation function ξ 0 ( s ), and the quadrupole ξ 2 ( s )—we emulate statistics that include information about the local environment, namely the underdensity probability function P U ( s ) and the density-marked correlation function M ( s ). This extends the model of Aemulus III for redshift-space distortions by including new statistics sensitive to galaxy assembly bias. In recovery tests, we find that the beyond-standard statistics significantly increase the constraining power on cosmological parameters of interest: including P U ( s ) and M ( s ) improves the precision of our constraints on Ω m by 27%, σ 8 by 19%, and the growth of structure parameter, f σ 8 , by 12% compared to standard statistics. We additionally find that scales below ∼6 h −1 Mpc contain as much information as larger scales. The density-sensitive statistics also contribute to constraining halo occupation distribution parameters and a flexible environment-dependent assembly bias model, which is important for extracting the small-scale cosmological information as well as understanding the galaxy–halo connection. This analysis demonstrates the potential of emulating beyond-standard clustering statistics at small scales to constrain the growth of structure as a test of cosmic acceleration.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Efficient high-fidelity TRISO statistical failure analysis using Bison: Applications to AGR-2 irradiation testing

The ability of tri-structural isotropic (TRISO) fuel to contain fission products is largely dictated by the quality of the manufacturing process, since most of the fission product release is expected to occur due to coating layer failure in a small number of particles containing defects. The Bison fuel performance code has capabilities to predict failure in individual particles, accounting for the presence of defects, and to apply statistical analysis methods to compute the probability of failure in a set of fuel particles. Bison has recently undergone significant development both to improve its physical representations of fuel particle behavior and to improve the efficiency of its statistical failure calculations. Physical model improvements include new capabilities to account for the pressure generated by fission gases on inner pyrolytic carbon (IPyC) crack surfaces and to use local material coordinate orientation to accurately incorporate the anisotropy in the material properties in aspherical particles. To improve statistical modeling efficiency, a direct integration approach which involves directly integrating the failure probability function associated with statistically varying parameters has been developed. The direct integration approach is much more efficient than the Monte Carlo (MC) schemes commonly employed, and allows Bison to directly run high-dimensional fuel performance models, which improves the accuracy of failure probability calculations. Finally, a set of benchmark problems is considered here to compare the MC and direct integration approaches, and a statistical failure analysis of compacts in the Advanced Gas Reactor (AGR)-2 experiments is performed using the direct integration approach.

36 MATERIALS SCIENCE↗
DOE OSTI2024

An Investigation of LES Wall Modeling for Rayleigh–Bénard Convection via Interpretable and Physics-Aware Feedforward Neural Networks with DNS

Abstract The traditional approach of using the Monin–Obukhov similarity theory (MOST) to model near-surface processes in large-eddy simulations (LESs) can lead to significant errors in natural convection. In this study, we propose an alternative approach based on feedforward neural networks (FNNs) trained on output from direct numerical simulation (DNS). To evaluate the performance, we conduct both a priori and a posteriori tests. In the a priori (offline) tests, we compare the statistics of the surface shear stress and heat flux, computed from filtered DNS input variables, to the stress and flux obtained from the filtered DNS. Additionally, we investigate the importance of various input features using the Shapley additive explanations value and the conditional average of the filter grid cells. In the a posteriori (online) tests, we implement the trained models in the System for Atmospheric Modeling (SAM) LES and compare the LES-generated surface shear stress and heat flux with those in the DNS. Our findings reveal that vertical velocity, a traditionally overlooked flow quantity, is one of the most important input features for determining the wall fluxes. Increasing the number of input features improves the a priori test results but does not always improve the model performance in the a posteriori tests because of the differences in input variables between the LES and DNS. Last, we show that physics-aware FNN models trained with logarithmic and scaled parameters can well extrapolate to more intense convection scenarios than in the training dataset, whereas those trained with primitive flow quantities cannot. Significance Statement The traditional near-surface turbulence model, based on a shear-dominated boundary layer flow, does not represent near-surface turbulence in natural convection. Using a feedforward neural network (FNN), we can construct a more accurate model that better represents the near-surface turbulence in various flows and reveals previously overlooked controlling factors and process interactions. Our study shows that the FNN-generated models outperform the traditional model and highlight the importance of the near-surface vertical velocity. Furthermore, the physics-aware FNN models exhibit the potential to extrapolate to convective flows of various intensities beyond the range of the training dataset, suggesting their broader applicability for more accurate modeling of near-surface turbulence.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Test–retest reliability for a social discounting of personal information task

Increasing cybercrime rates means identifying potential victims is critically important. Social discounting tasks show that individuals share less personally identifying information as social distance increases. However, the test–retest reliability and uniqueness of this measure is unclear. The current study assessed social discounting for personally identifying information (SDPII), delay discounting, risk taking, and personality at two measurement waves 30 days apart for 64 undergraduate students. Test–retest reliability was statistically significant for the SDPII and all other measures, replicating previous studies. SDPII rates were not significantly correlated with other measures during both measurement waves, showing discriminant validity. SDPII rates were lower than those reported in a previous study but were still well described by a hyperbolic discounting function, suggesting replicability across studies. Furthermore, the high test–retest reliability, uniqueness, and replicability of the SDPII suggests that it may quantitatively identify cybercrime victimization. Future research should test which measure or combination of measures can accurately predict scam and cybercrime victimization to inform data-based interventions.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Search for Multi-flare Neutrino Emissions in 10 yr of IceCube Data from a Catalog of Sources

A recent time-integrated analysis of a catalog of 110 candidate neutrino sources revealed a cumulative neutrino excess in the data collected by IceCube between 2008 April 6 and 2018 July 10. This excess, inconsistent with the background hypothesis in the Northern Hemisphere at the 3.3σ level, is associated with four sources: NGC 1068, TXS 0506+056, PKS 1424+240, and GB6 J1542+6129. Here, this Letter presents two time-dependent neutrino emission searches on the same data sample and catalog: a point-source search that looks for the most significant time-dependent source of the catalog by combining space, energy, and time information of the events, and a population test based on binomial statistics that looks for a cumulative time-dependent neutrino excess from a subset of sources. Compared to previous time-dependent searches, these analyses enable a feature to possibly find multiple flares from a single direction with an unbinned maximum-likelihood method. M87 is found to be the most significant time-dependent source of this catalog at the level of 1.7σ post-trial, and TXS 0506+056 is the only source for which two flares are reconstructed. The binomial test reports a cumulative time-dependent neutrino excess in the Northern Hemisphere at the level of 3.0σ associated with four sources: M87, TXS 0506+056, GB6 J1542+6129, and NGC 1068.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Validation of the DESI-DR1 3x2-pt analysis: scale cut and shear ratio tests

Combined survey analyses of galaxy clustering and weak gravitational lensing (3x2-pt studies) will allow new and accurate tests of the standard cosmological model. However, careful validation is necessary to ensure that these cosmological constraints are not biased by uncertainties associated with the modelling of astrophysical or systematic effects. In this study we validate the combined 3x2-pt analysis of the Dark Energy Spectroscopic Instrument Data Release 1 (DESI-DR1) spectroscopic galaxy clustering and overlapping weak lensing datasets from the Kilo-Degree Survey (KiDS), the Dark Energy Survey (DES), and the Hyper-Suprime-Cam Survey (HSC). By propagating the modelling uncertainties associated with the non-linear matter power spectrum, non-linear galaxy bias and baryon feedback, we design scale cuts to ensure that measurements of the matter density and the amplitude of the matter power spectrum are biased by less than 30% of the statistical error. We also test the internal consistency of the data and weak lensing systematics by performing new measurements of the lensing shear ratio. We demonstrate that the DESI-DR1 shear ratios can be successfully fit by the same model used to describe cosmic shear correlations, and analyse the additional information that can be extracted about the source redshift distributions and intrinsic alignment parameters. This study serves as crucial preparation for the upcoming cosmological parameter analysis of these datasets.

Emas, N. [Swinburne U., Ctr. Astrophys. Supercompu↗
DOE OSTI2023

Overestimated prediction using polygenic prediction derived from summary statistics

When polygenic risk score (PRS) is derived from summary statistics, independence between discovery and test sets cannot be monitored. We compared two types of PRS studies derived from raw genetic data (denoted as rPRS) and the summary statistics for IGAP (sPRS). Two variables with the high heritability in UK Biobank, hypertension, and height, are used to derive an exemplary scale effect of PRS. sPRS without APOE is derived from International Genomics of Alzheimer’s Project (IGAP), which records ΔAUC and ΔR 2 of 0.051 ± 0.013 and 0.063 ± 0.015 for Alzheimer’s Disease Sequencing Project (ADSP) and 0.060 and 0.086 for Accelerating Medicine Partnership - Alzheimer’s Disease (AMP-AD). On UK Biobank, rPRS performances for hypertension assuming a similar size of discovery and test sets are 0.0036 ± 0.0027 (ΔAUC) and 0.0032 ± 0.0028 (ΔR 2 ). For height, ΔR 2 is 0.029 ± 0.0037. Considering the high heritability of hypertension and height of UK Biobank and sample size of UK Biobank, sPRS results from AD databases are inflated. Independence between discovery and test sets is a well-known basic requirement for PRS studies. However, a lot of PRS studies cannot follow such requirements because of impossible direct comparisons when using summary statistics. Thus, for sPRS, potential duplications should be carefully considered within the same ethnic group.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Convergent Concordant Mode Approach for Molecular Vibrations: CMA-2

The concordant mode approach (CMA) is a promising new scheme for dramatically increasing the system size and level of theory achievable in quantum chemical computations of molecular vibrational frequencies. Here, we achieve advances in the CMA hierarchy by computations targeting CCSD(T)/cc-pVTZ (coupled cluster singles and doubles with perturbative triples using a correlation-consistent polarized-valence triple-ζ basis set) benchmarks within the G2 molecular test set, executing a statistical analysis for 1501 frequencies from 111 compounds and then separately solving the refractory case of pyridine. First, MP2/cc-pVTZ (second-order Møller–Plesset perturbation theory with the same basis set) proves to be an excellent and preferred choice for generating the underlying (Level B) normal modes of the CMA scheme. Utilizing this Level B within the CMA-0A method reproduces the 1501 benchmark frequencies with a mean absolute error (MAE) of only 0.11 cm –1 and an attendant standard deviation of 0.49 cm –1 . Second, a convergent CMA-2 method is constituted that allows efficient computation of higher level (Level A) frequencies to any reasonable accuracy threshold by using only Hartree–Fock (HF) and MP2 or density functional theory (DFT) data to generate ξ parameters, which select the sparse off-diagonal force field elements for explicit evaluation at Level A. When Level B = MP2/cc-pVTZ, a cutoff of ξ = 0.02 provides an average maximum absolute error per molecule of only 0.17 cm –1 by incurring merely a 33% increase in average cost over CMA-0A. This CMA-2 method also eradicates the 4 problematic CMA-0A outliers of pyridine with even less effort (ξ = 0.04, 22% increase). Finally, the newly developed CMA procedures are shown to be highly successful when applied to 1-(1H-pyrrol-3-yl)ethanol, a new test molecule with diverse types of vibration.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Feasibility of Correlation-Aware Inference and Universal Precision Scaling in Bonse–Hart Ultra-Small-Angle Neutron Scattering

Bonse–Hart ultra-small-angle neutron scattering (USANS) provides access to micrometre-scale structure, but useful measurements often require long counting times. In this work, we test whether the expected smoothness of the scattering profile can be exploited to improve data quality at lower counting statistics. We apply a Gaussian-process-based method to Bonse–Hart USANS data and evaluate its performance on pseudo-measurements generated from high-statistics experiments under Poisson statistics. This provides a stringent test of how well the underlying I(Q) profile can be reconstructed when the available counts are substantially reduced. We further show that, in the counting-limited regime, the reconstruction error follows a universal scaling behaviour that differs from the usual independent-counting expectation. At higher counts, the improvement crosses over to a resolution-limited regime set by analyser-angle discretization and rocking-curve width. These results clarify when correlation-aware inference is useful in USANS and provide a practical basis for improving measurement efficiency and beam-time usage.

Tung, Chi-Huan [ORNL] (ORCID:0000000221972074)↗
DOE OSTI2020

Target Detection via Cognitive Radars Using Change-Point Detection, Learning, and Adaptation

Many radar detection algorithms that assume a stationary environment (clutter) have been proposed and analyzed over the years. However, in practice, changes in the nonstationary environment can perturb the parameters of the clutter distribution, or even alter the clutter distribution family, which can greatly deteriorate the target detection capability. To avoid such potential performance degradation, cognitive radar systems are envisioned which are required to rapidly realize the nonstationarity, accurately learn the new characteristics of the environments, and adaptively update the detector. In this paper, aiming to develop a fully cognitive radar for target detection in nonstationary environments, we propose a unifying framework that integrates (i) change-point detection of clutter distributions by using a data-driven cumulative sum (CUSUM) algorithm and its extended version, (ii) learning/identification of clutter distribution by applying sparse theory and kernel density estimation methods, and (iii) adaptive target detection by automatically modifying the likelihood-ratio test and corresponding detection threshold. Further, with extensive numerical examples, we demonstrate the achieved improvements in detection performance due to the proposed framework in comparison to a nonadaptive case, an adaptive matched filter (AMF) method, and the clairvoyant case. Herein, we also use Wilcoxon rank-sum tests to evaluate the statistical significance of the performance improvements

42 ENGINEERING↗
DOE OSTI2024

Experimental investigation of probabilistic failure of SiC/SiC composite tubes under multiaxial loading

This paper presents an experimental investigation of the failure behavior of SiC fiber-reinforced SiC matrix (SiC/SiC) composite tubes under multiaxial loading. A new testing apparatus is designed to independently apply axial stress and internal pressure to SiC/SiC tubes. Acoustic emission (AE) is used to monitor the damage growth in the specimen. Based on the measured stress–strain response, a strain-based criterion is proposed to determine the proportional limit stress (PLS). The proposed strain-based criterion is compared with the PLS determined by the AE measurement. The PLS is determined for different loading ratios to form a multiaxial failure surface. By testing multiple replicates, the statistical variations of the PLS are determined. In conclusion, based on the experimental results, a mathematical model is developed to characterize the probability distribution of the PLS of SiC/SiC composites under multiaxial loading.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Improving ChemCam LIBS long-distance elemental compositions using empirical abundance trends

The ChemCam instrument on the Curiosity rover provides chemical compositions of Martian rocks and soils using remote laser-induced breakdown spectroscopy (LIBS). The elemental calibration is stable as a function of distance for Ti, Fe, Mg, and Ca. The calibration shows small, systematically increasing abundance trends as a function of distance for Al, Na, K, and to some extent, Si. The distance effect is known to be due to a dependence with distance on the relative strengths of atomic transition lines. Emission lines representing transitions from relatively low energy levels remain intense at longer distances while emission lines representing transitions from higher energy levels decrease in intensity more rapidly as a function of distance. The multivariate algorithms used to determine elemental compositions rely on a large number of emission lines in many cases, so rather than trying to correct all emission lines, a study was made of the predicted compositions as a function of distance, in order to determine an empirical correction. Abundance trends can be well approximated by a linear trend with distance within the ranges of abundances and distances observed up to ~6 m. Data from 11 distinct geological members and data groups of the Murray formation in Gale crater, Mars, were used to form the model, selecting the members and data groups yielding the best statistics. The model was tested using data from several targets observed from two different distances, and using data from the Kimberley formation, the composition of which is significantly different from the Murray formation, showing that the model works on other compositions beyond those used to build the model. For long-distance observations up to ~6 m, corrections can be made back to an equivalent composition at the median distance of ChemCam observations (2.6 m). Finally, the model has been validated up to 6.2 m, although ChemCam is able to observe bedrock targets to >7 m, and iron meteorites to distances of >9 m.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Time Matters: A Survival Analysis of Public Electric Vehicle Charging Infrastructure Utilization

The rapid adoption of plug-in electric vehicles (PEVs) places significant demands on public charging infrastructure, making it critical to understand and optimize charger utilization. This study provides one of the most comprehensive analyses of charging behavior to date by applying a survival analysis to a dataset of nearly 16 million level 2 (L2) and direct current (DC) fast charger sessions across the United States from 2017 to 2022. Using Kaplan-Meier curves and log rank tests, our analysis reveals statistically significant and distinct duration patterns influenced by charger type, time of day, and day of the week. We find that L2 charging sessions exhibit high variability tied to venue type, whereas DC sessions are more uniform, typically lasting 30-45 min. This study introduces the operational efficiency score (OES), a metric for standardizing the performance evaluation of charging stations. Our findings offer actionable insights for optimizing charger deployment, developing dynamic pricing strategies to reduce vehicle dwell time, and improving load management for grid operators, ultimately enhancing the efficiency and availability of public charging infrastructure.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Batch Scale Production of 3D Printed Extraction Sorbents Using a Low-Cost Modification to a Desktop Printer

This study reports a simple modification to a commercial resin 3D printer that significantly reduces the amount of prepolymer material needed for the production of extraction sorbents. Here, the modified printing platform is demonstrated in the printing of two imidazolium-based ionic liquid (IL) monomers. Two geometries resembling a blade-type polymeric ionic liquid (PIL) sorbent used in thin-film microextraction and a fiber-type sorbent used in solid-phase microextraction (SPME) were printed. The SPME PIL sorbents were used to extract 10 organic contaminants, including plasticizers, antimicrobial agents, UV filters, and pesticides, from water followed by high-performance liquid chromatographic (HPLC) analysis. To compare the extraction performance of the SPME sorbents, seven fibers printed with the same prepolymer composition from the same printing batch as well as different batches were evaluated. The results revealed highly reproducible extraction efficiencies for all tested sorbents with no statistical difference in their extraction performance. Method validation showed acceptable linearity ($R$ 2 > 0.92) for all analytes with limits of detection and limits of quantification ranging from 0.13 to 45 μg L –1 and 0.43 to 150 μg L –1 , respectively.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗