Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Proteomics Goes to Court: A Statistical Foundation for Forensic Toxin/Organism Identification Using Bottom-Up Proteomics

Bottom-up proteomics is increasingly being used to characterize unknown environmental, clinical, and forensic samples. Proteomics-based bacterial identification typically proceeds by tabulating peptide “hits” (i.e. confidently identified peptides) associated with the organisms in a database; those organisms with enough hits are declared present in the sample. This approach has proven successful in laboratory studies, however, important research gaps remain. First, the common-practice reliance on unique peptides for identification is susceptible to a phenomenon known as signal erosion. Second, no general guidelines are available for determining how many hits are needed to make a confident identification. These gaps inhibit the transition of this approach to real-world samples where conditions vary and large databases may be needed. We propose statistical criteria for organism identification that applies regardless of sample quality or data analysis pipeline. These criteria are straightforward, producing a p-value on the result. We test the criteria on LC-MS/MS datasets representing 919 different bacterial and toxin datasets acquired with multiple data collection platforms. Results reveal a >95% correct species-level identification rate, demonstrating the effectiveness and robustness of proteomics-based organism/toxin identification.

Jarman, Kristin H.↗

A continuous symmetry breaking measure for finite clusters using Jensen-Shannon divergence

A quantitative measure of symmetry breaking is introduced that allows the quantification of which symmetries are most strongly broken due to the introduction of some kind of defect in a perfect structure. The method uses a statistical approach based on the Jensen-Shannon divergence. The measure is calculated by comparing the transformed atomic density function with its original. Software code is presented that carries the calculations out numerically using Monte Carlo methods. The behavior of this symmetry breaking measure is tested for various cases including finite size crystallites (where the surfaces break the crystallographic symmetry), atomic displacements from high symmetry positions, and collective motions of atoms due to rotations of rigid octahedra. Finally, the approach provides a powerful tool for assessing local symmetry breaking and offers new insights that can help researchers understand how different structural distortions affect different symmetry operations.

atomic & molecular structure↗

Synthetic data generators for the evaluation of biosurveillance outbreak detection algorithms

The research and development of new algorithmic and statistical methods of outbreak detection is an ongoing research priority in the field of biosurveillance. The early detection of emergent disease outbreaks is crucial for effective treatment and mitigation. New detection methods must be compared to established approaches for proper evaluation. This comparison requires biosurveillance test data that accurately reflects the complexity of the real-world data it will be applied to. While the test and evaluation of new detection methods is best performed on real data, it is often impractical to obtain such data as it is either proprietary or limited in scope. Thus, scientists must turn to synthetic data generation to provide enough data to properly eval- uate new detection methodologies. This paper evaluates three such synthetic data sources: The WSARE dataset, the Noufilay equation-based approach, and the Project Mimic data generator.

47 OTHER INSTRUMENTATION↗

Maximizing the impact of the Vera Rubin Observatory LSST, and DESI and CMB-S4 experiments in constraining gravity and dark sector physics

The work in this award has addressed our objectives on a number of fronts: Current graduate student Chris Wilson and Bean are determining how cosmic voids can be used to test the properties of gravity, leveraging simulations from DESI collaborator Baojiu Li and refining theoretical Gaussian Streaming Model approaches to predict galaxy dynamics in voids when the cosmology is not GR. This work is still underway, including analyses of the efficacy of void quadrupole correlation statistics and void size functions when studying dark matter halo statistics or the expected galaxy distributions from upcoming galaxy surveys; Current graduate student Yulin Gong, Bean with collaborators are refining techniques to extract out the kinetic Sunyaev Zel’dovich effect from galaxy cluster survey data and CMB temperature anisotropies, with the intent to further ready this pipeline development in readiness for spectroscopic data from DESI and LSST along with CMB-S4 measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

A study of environmental characterization of conventional and advanced aluminum alloys for selection and design. Phase 2: The breaking load test method

A technique is demonstrated for accelerated stress corrosion testing of high strength aluminum alloys. The method offers better precision and shorter exposure times than traditional pass fail procedures. The approach uses data from tension tests performed on replicate groups of smooth specimens after various lengths of exposure to static stress. The breaking strength measures degradation in the test specimen load carrying ability due to the environmental attack. Analysis of breaking load data by extreme value statistics enables the calculation of survival probabilities and a statistically defined threshold stress applicable to the specific test conditions. A fracture mechanics model is given which quantifies depth of attack in the stress corroded specimen by an effective flaw size calculated from the breaking stress and the material strength and fracture toughness properties. Comparisons are made with experimental results from three tempers of 7075 alloy plate tested by the breaking load method and by traditional tests of statistically loaded smooth tension bars and conventional precracked specimens.

Sprowls, D. O.↗

Statistical analysis of trigonometric parallaxes

The present project was initiated with two specific medium-term goals: first, to develop a novel approach, based on global modeling and maximum likelihood, to the study of databases of stellar data, with specific attention to the results to be obtained by the Hipparcos mission; and second, to apply and test the methodology developed to existing ground-based data. The long-term goal was of course to integrate the methodology and the ground-based data into a global study of the results of the Hipparcos mission, which were expected to be made available in 1995 or 1996. The closing of the project is due to the recent change of home institution of the PI, who has moved from the University of Illinois to Johns Hopkins University. As a consequence of this move, the three scientists involved in this project will be in close proximity, thereby hopefully improving their ability to collaborate and increasing the productivity of the project. Continued funding for the project has been requested from Johns Hopkins University. This report describes briefly the results obtained so far both on the technical aspect of software development and on the scientific side of applications to existing ground-based data. Significant progress has been made on both counts, with several papers published in (or submitted to) refereed journals and in conference proceedings. Because it is hoped that the project can be successfully continued with NASA support, the report of the progress in each area includes also an assessment of how the current results fit in the expected continuation of the project. Our results to date include: code development (essentially completed); a detailed study of the kinematics and dynamics of stars escaping from the Hyades cluster, relevant to the question of membership in the Hyades; a study of the kinematics and luminosity calibration of nearby dwarfs; an assessment of the quality of the photometry included in the Hipparcos Input Catalog; and two studies of properties of nearby clusters, including a moving-cluster determination of the distance to Praesepe. The bibliography includes three papers submitted to refereed journals, two of which have already been published, and four contributions to conference proceedings. Finally, the work so far has also provided a very good introduction to stellar dynamics and astrometry for an undergraduate student, with educational benefits that had not been foreseen in the original proposal.

Casertano, Stefano↗

Long-Term Statistical Process Monitoring of an Ultrafiltration Water Treatment Process

As water treatment technology has improved, the amount of available process data has substantially increased, making real-time, data-driven fault detection a reality. One shortcoming of the fault detection literature is that methods are usually evaluated by comparing their performance on hand-picked, short-term case studies, which yields no insight into long-term performance. In this work, we first evaluate multiple statistical and machine learning approaches for detrending process data. Then, we evaluate the performance of a PCA-based fault detection approach, applied to the detrended data, to monitor influent water quality, filtrate quality, and membrane fouling of an ultrafiltration membrane system for indirect potable reuse. Based on two short case studies, the adaptive lasso detrending method is selected, and the performance of the multivariate approach is evaluated over more than a year. The method is tested for different sets of three critical tuning parameters, and we find that for long-term, autonomous monitoring to be successful, these parameters should be carefully evaluated. However, in comparison with industry standards of simpler, univariate monitoring or daily pressure decay tests, multivariate monitoring produces substantial benefits in long-term testing.

ammonia↗

The CosmoVerse White Paper: Addressing observational tensions in cosmology with systematics and fundamental physics.

The standard model of cosmology has provided a good phenomenological description of a wide range of observations both at astrophysical and cosmological scales for several decades. This concordance model is constructed by a universal cosmological constant and supported by a matter sector described by the standard model of particle physics and a cold dark matter contribution, as well as very early-time inflationary physics, and underpinned by gravitation through general relativity. There have always been open questions about the soundness of the foundations of the standard model. However, recent years have shown that there may also be questions from the observational sector with the emergence of differences between certain cosmological probes. In this White Paper, we identify the key objectives that need to be addressed over the coming decade together with the core science projects that aim to meet these challenges. These discordances primarily rest on the divergence in the measurement of core cosmological parameters with varying levels of statistical confidence. These possible statistical tensions may be partially accounted for by systematics in various measurements or cosmological probes but there is also a growing indication of potential new physics beyond the standard model. After reviewing the principal probes used in the measurement of cosmological parameters, as well as potential systematics, we discuss the most promising array of potential new physics that may be observable in upcoming surveys. We also discuss the growing set of novel data analysis approaches that go beyond traditional methods to test physical models. These new methods will become increasingly important in the coming years as the volume of survey data continues to increase, and as the degeneracy between predictions of different physical models grows. There are several perspectives on the divergences between the values of cosmological parameters, such as the model-independent probes in the late Universe and model-dependent measurements in the early Universe, which we cover at length. The White Paper closes with a number of recommendations for the community to focus on for the upcoming decade of observational cosmology, statistical data analysis, and fundamental physics developments.

Dienes, Keith [Univ. of Arizona, Tucson, AZ (Unite↗

Validation of the DESI DR2 measurements of baryon acoustic oscillations from galaxies and quasars

The Dark Energy Spectroscopic Instrument (DESI) Data Release 2 (DR2) galaxy and quasar clustering data represents a significant expansion of data from Data Release 1 (DR1), providing improved statistical precision in baryon acoustic oscillation (BAO) constraints across multiple tracers, including bright galaxies, luminous red galaxies, emission line galaxies, and quasars. In this paper, we validate the BAO analysis of DR2. We present the results of robustness tests on the blinded DR2 data and, after unblinding, consistency checks on the unblinded DR2 data. All results are compared with those obtained from a suite of mock catalogs that replicate the selection and clustering properties of the DR2 sample. We confirm the consistency of DR2 BAO measurements with DR1 while achieving a reduction in statistical uncertainties due to the increased survey volume and completeness. The combined BAO precision, including both statistical and systematic errors, improves from ∼0.52% in DR1 to 0.30% in DR2—a factor of 1.7 gain. We assess the impact of analysis choices, including different data vectors (correlation function vs power spectrum), modeling approaches and systematics treatments, and an assumption of the Gaussian likelihood, finding that our BAO constraints are stable across these variations and assumptions with a few minor refinements to the baseline setup of the DR1 BAO analysis. We summarize a series of pre-unblinding tests that confirmed the readiness of our analysis pipeline, the final systematic errors, and the DR2 BAO analysis baseline. The successful completion of these tests led to the unblinding of the DR2 BAO measurements, ultimately leading to the DESI DR2 cosmological analysis, with their implications for the expansion history of the Universe and the nature of dark energy presented in the DESI key paper (companion paper).

79 ASTRONOMY AND ASTROPHYSICS↗

The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey quasar sample: testing observational systematics on the Baryon Acoustic Oscillation measurement

ABSTRACT Baryon Acoustic Oscillations (BAO) are considered to be a very robust standard ruler against various systematics. This premise has been tested against observational systematics, but not to the level required for the next generation of galaxy surveys such as the Dark Energy Spectroscopic Instrument (DESI) and Euclid. In this paper, we investigate the effect of observational systematics on the BAO measurement of the final sample of quasars from the extended Baryon Oscillation Spectroscopic Survey Data Release 16 in order to prepare and hone a similar analysis for upcoming surveys. We employ catalogues with various treatments of imaging systematic effects using linear and neural network-based non-linear approaches and consider how the BAO measurement changes. We also test how the variations to the BAO fitting model respond to the observational systematics. As expected, we confirm that the BAO measurements obtained from the DR16 quasar sample are robust against imaging systematics well within the statistical error, while reporting slightly modified constraints that shift the line-of-sight BAO signal by less than 1.1 per cent. We use realistic simulations with similar redshift and angular distributions as the DR16 sample to conduct statistical tests for validating the pipeline, quantifying the significance of differences, and estimating the expected bias on the BAO scale in future high-precision data sets. Although we find a marginal impact for the eBOSS QSO data, the work presented here is of vital importance for constraining the nature of dark energy with the BAO feature in the new era of big data cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗

Emergent magnetic ordering and topological frustration in quasicrystal artificial spin ices

Artificial spin ices (ASIs) are nanoscale geometrically engineered arrays of magnetic bars or islands that display magnetic frustration and provide a fertile system for modeling and testing many complex statistical mechanics theories and emergent phenomena. Aperiodic ASIs display spatially varying magnetic frustration as a result of the aperiodicity. We have explored the magnetization reversal of quasicrystalline ASIs (QC-ASIs) patterned on P2 and P3 Penrose tilings, using a statistical graph-theory approach that enables quantitative comparison between the two tilings. Our approach offers insight into the QC-ASIs. We show that the P2 tiling leads to enhanced topological frustration compared to the P3 tiling, and we elucidate the emergence of local antiferromagnetic ordering as well as disordered states in these ferromagnetic aperiodic lattices. Furthermore our method enables quantitative exploration of frustration behavior on any periodic or aperiodic lattice, thereby opening pathways to study collective behavior in various topologically frustrated systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Geometric Tail Approximation for Reliability and Survivability

A common problem in developing high-reliability systems is estimating the reliability for a population of components that cannot be 100% tested. The radiation survivability of a population of components is often estimated by testing a very small sample to some multiple of the required specification level, known as an overtest. Given a successful test with a sufficient overtest margin, the population of components is assumed to have the required survivability or radiation reliability. However, no mathematical justification for such claims has been crafted without making aggressive assumptions regarding the statistics of the unknown distribution. Here we illustrate a new approach that leverages geometric bounding arguments founded on relatively modest distribution assumptions to produce conservative estimates of component reliability.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Statistical tests of additional plate boundaries from plate motion inversions

The application of the F-ratio test, a standard statistical technique, to the results of relative plate motion inversions has been investigated. The method tests whether the improvement in fit of the model to the data resulting from the addition of another plate to the model is greater than that expected purely by chance. This approach appears to be useful in determining whether additional plate boundaries are justified. Previous results have been confirmed favoring separate North American and South American plates with a boundary located beween 30 N and the equator. Using Chase's global relative motion data, it is shown that in addition to separate West African and Somalian plates, separate West Indian and Australian plates, with a best-fitting boundary between 70 E and 90 E, can be resolved. These results are generally consistent with the observation that the Indian plate's internal deformation extends somewhat westward of the Ninetyeast Ridge. The relative motion pole is similar to Minster and Jordan's and predicts the NW-SE compression observed in earthquake mechanisms near the Ninetyeast Ridge.

Stein, S.↗

Design Protocols and Analytical Strategies that Incorporate Structural Reliability Models

Ceramic matrix composites (CMC) and intermetallic materials (e.g., single crystal nickel aluminide) are high performance materials that exhibit attractive mechanical, thermal, and chemical properties. These materials are critically important in advancing certain performance aspects of gas turbine engines. From an aerospace engineers perspective the new generation of ceramic composites and intermetallics offers a significant potential for raising the thrust/weight ratio and reducing NO(sub x) emissions of gas turbine engines. These aspects have increased interest in utilizing these materials in the hot sections of turbine engines. However, as these materials evolve and their performance characteristics improve a persistent need exists for state-of-the-art analytical methods that predict the response of components fabricated from CMC and intermetallic material systems. This need provided the motivation for the technology developed under this research effort. Continuous ceramic fiber composites exhibit an increase in work of fracture, which allows for 'graceful' rather than catastrophic failure. When loaded in the fiber direction these composites retain substantial strength capacity beyond the initiation of transverse matrix cracking despite the fact that neither of its constituents would exhibit such behavior if tested alone. As additional load is applied beyond first matrix cracking, the matrix tends to break in a series of cracks bridged by the ceramic fibers. Any additional load is born increasingly by the fibers until the ultimate strength of the composite is reached. Thus modeling efforts supported under this research effort have focused on predicting this sort of behavior. For single crystal intermetallics the issues that motivated the technology development involved questions relating to material behavior and component design. Thus the research effort supported by this grant had to determine the statistical nature and source of fracture in a high strength, NiAl single crystal turbine blade material; map a simplistic future strength envelope of the material; develop a statistically based reliability computer algorithm; verify the reliability model and computer algorithm-, and model stator vanes for rig tests. Thus establishing design protocols that enable the engineer to analyze and predict the mechanical behavior of ceramic composites and intermetallics would mitigate the prototype (trial and error) approach currently used by the engineering community. The primary objective of the research effort supported by this short term grant is the continued creation of enabling technologies for the macro-analysis of components fabricated from ceramic composites and intermetallic material systems. The creation of enabling technologies aids in shortening the product development cycle of components fabricated from the new high technology materials.

Duffy, Stephen F.↗

Design Protocols and Analytical Strategies that Incorporate Structural Reliability Models

Ceramic matrix composites (CMC) and intermetallic materials (e.g., single crystal nickel aluminide) are high performance materials that exhibit attractive mechanical, thermal and chemical properties. These materials are critically important in advancing certain performance aspects of gas turbine engines. From an aerospace engineer's perspective the new generation of ceramic composites and intermetallics offers a significant potential for raising the thrust/weight ratio and reducing NO(x) emissions of gas turbine engines. These aspects have increased interest in utilizing these materials in the hot sections of turbine engines. However, as these materials evolve and their performance characteristics improve a persistent need exists for state-of-the-art analytical methods that predict the response of components fabricated from CMC and intermetallic material systems. This need provided the motivation for the technology developed under this research effort. Continuous ceramic fiber composites exhibit an increase in work of fracture, which allows for "graceful" rather than catastrophic failure. When loaded in the fiber direction, these composites retain substantial strength capacity beyond the initiation of transverse matrix cracking despite the fact that neither of its constituents would exhibit such behavior if tested alone. As additional load is applied beyond first matrix cracking, the matrix tends to break in a series of cracks bridged by the ceramic fibers. Any additional load is born increasingly by the fibers until the ultimate strength of the composite is reached. Thus modeling efforts supported under this research effort have focused on predicting this sort of behavior. For single crystal intermetallics the issues that motivated the technology development involved questions relating to material behavior and component design. Thus the research effort supported by this grant had to determine the statistical nature and source of fracture in a high strength, NiAl single crystal turbine blade material; map a simplistic failure strength envelope of the material; develop a statistically based reliability computer algorithm, verify the reliability model and computer algorithm, and model stator vanes for rig tests. Thus establishing design protocols that enable the engineer to analyze and predict the mechanical behavior of ceramic composites and intermetallics would mitigate the prototype (trial and error) approach currently used by the engineering community. The primary objective of the research effort supported by this short term grant is the continued creation of enabling technologies for the macroanalysis of components fabricated from ceramic composites and intermetallic material systems. The creation of enabling technologies aids in shortening the product development cycle of components fabricated from the new high technology materials.

Duffy, Stephen F.↗

Satellite Remote Sensing of Tropical Precipitation and Ice Clouds for GCM Verification

This project, supported by the NASA New Investigator Program, has primarily been funding a graduate student, Darren McKague. Since August 1999 Darren has been working part time at Raytheon, while continuing his PhD research. Darren is planning to finish his thesis work in May 2001, thus some of the work described here is ongoing. The proposed research was to use GOES visible and infrared imager data and SSM/I microwave data to obtain joint distributions of cirrus cloud ice mass and precipitation for a study region in the Eastern Tropical Pacific. These joint distributions of cirrus cloud and rainfall were to be compared to those from the CSU general circulation model to evaluate the cloud microphysical amd cumulus parameterizations in the GCM. Existing algorithms were to be used for the retrieval of cloud ice water path from GOES (Minnis) and rainfall from SSM/I (Wilheit). A theoretical study using radiative transfer models and realistic variations in cloud and precipitation profiles was to be used to estimate the retrieval errors. Due to the unavailability of the GOES satellite cloud retrieval algorithm from Dr. Minnis (a co-PI), there was a change in the approach and emphasis of the project. The new approach was to develop a completely new type of remote sensing algorithm - one to directly retrieve joint probability density functions (pdf's) of cloud properties from multi-dimensional histograms of satellite radiances. The usual approach is to retrieve individual pixels of variables (i.e. cloud optical depth), and then aggregate the information. Only statistical information is actually needed, however, and so a more direct method is desirable. We developed forward radiative transfer models for the SSM/I and GOES channels, originally for testing the retrieval algorithms. The visible and near infrared ice scattering information is obtained from geometric ray tracing of fractal ice crystals (Andreas Macke), while the mid-infrared and microwave scattering is computed with Mie scattering. The radiative transfer is performed with the Spherical Harmonic Discrete Ordinate Method (developed by the PI), and infrared molecular absorption is included with the correlated k-distribution method. The SHDOM radiances have been validated by comparison to version 2 of DISORT (the community "standard" discrete-ordinates radiative transfer model), however we use SHDOM since it is computationally more efficient.

Evans, K. Franklin↗

Validating an Air Traffic Management Concept of Operation Using Statistical Modeling

Validating a concept of operation for a complex, safety-critical system (like the National Airspace System) is challenging because of the high dimensionality of the controllable parameters and the infinite number of states of the system. In this paper, we use statistical modeling techniques to explore the behavior of a conflict detection and resolution algorithm designed for the terminal airspace. These techniques predict the robustness of the system simulation to both nominal and off-nominal behaviors within the overall airspace. They also can be used to evaluate the output of the simulation against recorded airspace data. Additionally, the techniques carry with them a mathematical value of the worth of each prediction-a statistical uncertainty for any robustness estimate. Uncertainty Quantification (UQ) is the process of quantitative characterization and ultimately a reduction of uncertainties in complex systems. UQ is important for understanding the influence of uncertainties on the behavior of a system and therefore is valuable for design, analysis, and verification and validation. In this paper, we apply advanced statistical modeling methodologies and techniques on an advanced air traffic management system, namely the Terminal Tactical Separation Assured Flight Environment (T-TSAFE). We show initial results for a parameter analysis and safety boundary (envelope) detection in the high-dimensional parameter space. For our boundary analysis, we developed a new sequential approach based upon the design of computer experiments, allowing us to incorporate knowledge from domain experts into our modeling and to determine the most likely boundary shapes and its parameters. We carried out the analysis on system parameters and describe an initial approach that will allow us to include time-series inputs, such as the radar track data, into the analysis

Statistical emulation↗

Improving the Parameterization of Cloud and Rain Microphysics in E3SM using Novel Observationally-Constrained Bayesian Approach (Final Technical Report)

In this project, we sought to develop new cloud and rain microphysics frameworks within the Energy Exascale Earth System Model (E3SM). This work encompassed two primary avenues of research: 1) Further development of a Bayesian-based scheme called BOSS (Bayesian Observationally-constrained Statistical-physical Scheme) to represent cloud and rain microphysics, testing it in realistic high-resolution cloud models, and implementing it in E3SM; 2) Development of a methodology utilizing machine learning to enable computationally tractable use of tractable use of Markov chain Monte Carlo sampling for Bayesian parameter estimation in Earth system and cloud models. In this project, we adapted the BOSS microphysics scheme, originally formulated for rain-only, to include all liquid-phase microphysical processes for cloud and rain, in particular the processes that mediate between these two categories, for example the conversion from cloud to rain through collision and coalescence of drops. We constrained the scheme via comparison and testing against a detailed model that explicitly represents the evolution of cloud and rain particles, called a bin microphysics scheme.

54 ENVIRONMENTAL SCIENCES↗