Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical Testing Approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Grid-based diffusion Monte Carlo for fermions without the fixed-node approximation

A diffusion Monte Carlo algorithm is introduced that can determine the correct nodal structure of the wave function of a few-fermion system and its ground-state energy without an uncontrolled bias. This is achieved by confining signed random walkers to the points of a uniform infinite spatial grid, allowing them to meet and annihilate one another to establish the nodal structure without the fixed-node approximation. An imaginary-time propagator is derived rigorously from a discretized Hamiltonian, governing a non-Gaussian, sign-flipping, branching, and mutually annihilating random walk of particles. The accuracy of the resulting stochastic representations of a fermion wave function is limited only by the grid and imaginary-time resolutions and can be improved in a controlled manner. Here, the method is tested for a series of model problems including fermions in a harmonic trap as well as the He atom in its singlet or triplet ground state. For the latter case, the energies approach from above with increasing grid resolution and converge within 0.015 E h of the exact basis-set-limit value for the grid spacing of 0.08 a.u. with a statistical uncertainty of 10 –5 E h without an importance sampling or Jastrow factor.

74 ATOMIC AND MOLECULAR PHYSICS↗

Evaluation of a high-throughput method for processing sponge-stick samples to detect viable, non-spore-forming biothreat agents

After a bioterrorism incident, surface sampling is often used to determine the extent of contamination and exposure, guiding decontamination efforts and decisions for re-occupancy of affected sites. The sponge-stick (SS) is a preferred and commonly used device for sample collection to detect both spore-forming and non-spore-forming biothreat agents from non-porous surfaces. Here, in this study, a recently developed high-throughput method (HTM) for processing SS samples to detect viable Bacillus anthracis spores was adapted for detection of non-spore-forming biothreat agents, Yersinia pestis and Francisella tularensis. The scalable HTM was used to process up to 20 SS samples simultaneously, compared to the current stomacher-based method which processes one SS at a time. Comparisons of the HTM and the stomacher-based method were statistically indistinguishable for most experiments (P > 0.05) with HTM recoveries of 37–60 % for Y. pestis inoculated at 102–103 cells/SS and held 48 h at 4 °C to mimic sample transport/storage. The HTM was integrated with Rapid Viability-Polymerase Chain Reaction (RV-PCR) analysis to detect viable Y. pestis in the presence of particulate contamination (Arizona Test Dust, ATD). This approach detected Y. pestis inoculated at 20 cells/SS and ATD did not impact detection (P > 0.05). F. tularensis showed significantly lower recoveries between no-hold time and 48-h hold time (4 °C, P < 0.05) using the HTM, which further testing showed could be due to toxicity of the neutralizing buffer used for SS pre-wetting. With modifications, this method could enhance throughput capacity while maintaining similar recovery efficiencies to current methods for other non-spore-forming bacterial pathogens.

Biological and medical sciences↗

Accelerating quantum optics experiments with statistical learning

Quantum optics experiments, involving the measurement of low-probability photon events, are known to be extremely time-consuming. We present a methodology for accelerating such experiments using physically motivated ansatzes together with simple statistical learning techniques such as Bayesian maximum a posteriori estimation based on few-shot data. We show that it is possible to reconstruct time-dependent data using a small number of detected photons, allowing for fast estimates in under a minute and providing a one-to-two order of magnitude speed-up in data acquisition time. We test our approach using real experimental data to retrieve the second order intensity correlation function, G (2) ($τ$), as a function of time delay τ between detector counts, for thermal light as well as anti-bunched light emitted by a quantum dot driven by periodic laser pulses. The proposed methodology has a wide range of applicability and has the potential to impact the scientific discovery process across a multitude of domains.

36 MATERIALS SCIENCE↗

Light potentials of photosynthetic energy storage in the field: what limits the ability to use or dissipate rapidly increased light energy?

The responses of plant photosynthesis to rapid fluctuations in environmental conditions are critical for efficient conversion of light energy. These responses are not well-seen laboratory conditions and are difficult to probe in field environments. We demonstrate an open science approach to this problem that combines multifaceted measurements of photosynthesis and environmental conditions, and an unsupervised statistical clustering approach. In a selected set of data on mint (Mentha sp.), we show that ‘light potentials’ for linear electron flow and non-photochemical quenching (NPQ) upon rapid light increases are strongly suppressed in leaves previously exposed to low ambient photosynthetically active radiation (PAR) or low leaf temperatures, factors that can act both independently and cooperatively. Further analyses allowed us to test specific mechanisms. With decreasing leaf temperature or PAR, limitations to photosynthesis during high light fluctuations shifted from rapidly induced NPQ to photosynthetic control of electron flow at the cytochrome b 6 f complex. At low temperatures, high light induced lumen acidification, but did not induce NPQ, leading to accumulation of reduced electron transfer intermediates, probably inducing photodamage, revealing a potential target for improving the efficiency and robustness of photosynthesis. We discuss the implications of the approach for open science efforts to understand and improve crop productivity.

59 BASIC BIOLOGICAL SCIENCES↗

Comparative genomics of the Liberibacter genus reveals widespread diversity in genomic content and positive selection history

‘Candidatus Liberibacter’ is a group of bacterial species that are obligate intracellular plant pathogens and cause Huanglongbing disease of citrus trees and Zebra Chip in potatoes. Here, we examined the extent of intra- and interspecific genetic diversity across the genus using comparative genomics. Our approach examined a wide set of Liberibacter genome sequences including five pathogenic species and one species not known to cause disease. By performing comparative genomics analyses, we sought to understand the evolutionary history of this genus and to identify genes or genome regions that may affect pathogenicity. With a set of 52 genomes, we performed comparative genomics, measured genome rearrangement, and completed statistical tests of positive selection. We explored markers of genetic diversity across the genus, such as average nucleotide identity across the whole genome. These analyses revealed the highest intraspecific diversity amongst the ‘Ca. Liberibacter solanacearum’ species, which also has the largest plant host range. We identified sets of core and accessory genes across the genus and within each species and measured the ratio of nonsynonymous to synonymous mutations (dN/dS) across genes. We identified ten genes with evidence of a history of positive selection in the Liberibacter genus, including genes in the Tad complex, which have been previously implicated as being highly divergent in the ‘Ca. L. capsica’ species based on high values of dN.

59 BASIC BIOLOGICAL SCIENCES↗

Learning-Based Inversion-Free Model-Data Integration to Advance Ecosystem Model Prediction

Ecosystem model prediction is important for understanding ecosystem responses to climate change and for management support. Model prediction and quantification of predictive uncertainty of ecosystems have long been investigated. The traditional workflow, which calibrates models to match observations and then uses the calibrated models for predictions, relies heavily on inverse modeling to constrain uncertain parameters in complex forward models. This inversion-based prediction approach is infeasible for complex models with heterogeneous parameter uncertainties and incapable of rapid integration of streaming and multiple sources of data because of the difficulty and computational cost in the model inversion, which is typically ill-posed and can require hundreds of thousands of expensive forward simulations to be performed iteratively. We propose to circumvent inverse modeling by precomputing an ensemble of unconstrained forward simulations and then using machine learning (ML) methods to learn the statistical relationship between simulated observation and prediction quantities. Once the ML model has learned the relationship, it can be used to make predictions of future system behavior with uncertainty quantification based on observations. The proposed learningbased inversion-free model prediction (LIMP) framework is computationally efficient which only requires a few thousands of fully parallelizable forward simulations. Additionally, LIMP can continually update predictions based on streaming observations from multiple locations and sources without necessarily requiring extra model simulations. In this study, we apply LIMP to a regional terrestrial ecosystem model with 47 parameters for testing, refining, and evaluating the approach. We demonstrate that LIMP can be used for efficient model prediction, rapid data assimilation, and cost-effective experimental design for improving robust predictive understanding of ecosystems.

Lu, Dan↗

Epidemiologic Study of One Million U.S. Radiation Workers and Veterans

The single most important question in radiation epidemiology is determining the level of health risks associated with radiation exposures that occur gradually over time. The study of one million early U.S. radiation workers and veterans has been designed to provide information on risk following chronic exposures by focusing on occupational groups with differing radiation exposure patterns, including intakes of radionuclides. The cost-efficient study builds on the investments made and foundations laid by investigators and government agencies over the past 30-40 years, which have established early worker cohorts that can now provide answers to questions on the lifetime human health risks associated with low-level radiation exposures. Within the overall goal of the epidemiologic study of one million U.S. radiation workers and veterans, this project had a total of nine specific aims which included studies of six populations for multiple endpoints including cancer overall mortality, leukemia and non-cancer mortality. The six populations included: Mound, Ohio, workers exposed to polonium, tritium and plutonium; nuclear power plant workers within the Landauer dosimetry and Nuclear Regulatory Commission data files; industrial radiographers; Mallinckrodt uranium workers; uranium workers who linked with the US Renal Data System; and nuclear weapons test participants. Over 400,000 workers and atomic veterans are included in these populations, with vital status being determined and analyses of all causes of death undertaken. A critical, integral component of the studies has been comprehensive evaluations of dosimetry involving, in many cases, complex dose reconstructions, and assessments of uncertainties. The work has also involved development of state-of-the art statistical approaches and modeling. All nine aims were accomplished successfully, resulting in publication of two NCRP documents, 13 literature papers, numerous Boice Reports in Health Physics News and many presentations of the work at scientific meetings. Furthermore, recommendations have been developed for an approach to integrate epidemiologic observations with radiation biology for risk assessment and biological models of radiation effect. The results of this project, as well as ongoing epidemiology studies of US radiation workers and veterans, are providing much-needed insights into complex issues regarding cancer and non-cancer health risks from low dose irradiation, how to apply a "dose and dose rate effectiveness factor" to scale the risks from the A-bomb survivor data to current occupational and environmental circumstances, and how to evaluate risk following intakes of radioactive substances. In addition to application to radiation workers, the results of the studies can provide guidance as society debates the role of nuclear energy and deals with nuclear waste, threats of terrorist attacks with nuclear/radiological devices, the remarkable increase in medical exposures to CT scans and nuclear imaging, and to NASA as radiation protection for astronauts on long-duration mission beyond low-Earth orbit is planned.

61 RADIATION PROTECTION AND DOSIMETRY↗

Benchmarking Microscale Ductility Measurements (Final Report of the Project DE-NE0008799)

Conventional macroscale experimentation is generally considered to be straightforward with few limitations. Conversely, micro/nanoscale experimentation presents numerous challenges in loading device design, sample preparation and handling, as well as accurate understanding of grain size and local texture effects on recorded measurements. Despite these challenges, nanopillar compression, MEMs based micro-tension, and nanoindentation approaches have been able to provide fundamental contributions to the understanding of material behavior at small lengthscales. However, the overarching shortcoming of these micro/nanoscale experimentation approaches, is the inability to directly translate measurements evaluated at the nm and µm length scales (e.g., hardness) to macroscale tensile material behavior (i.e., elastic modulus, yield strength, and ductility). The objectives of the proposed study are, 1) to establish best practices for obtaining tensile microscale ductility measurements, and 2) to validate methodologies to for comparing microscale ductility measurements to macroscale ductility measurements. In order to achieve these objectives, a multi-lengthscale, multi-temperature testing protocol and simulation framework are executed first on copper as a model material to validate the following approach, and second on reactor grade Zircaloy-2. Experiments are conducted on specimens extracted from the same test piece to ensure nominally identical grain size and texture from specimens to specimen. Motivated by the need to isolate the contribution of size-effects on obtained mechanical property measurements, specimens are manufactured with thicknesses at the micro- (1-10 µm), meso- (10-100's µm), and macroscales (sub-sized ASTM E8). In-situ full-field deformation techniques (scanning electron microscopy (SEM) grid methods and optical DIC) are incorporated into testing at each specimen length-scale to capture plasticity localization and evolution. Experimental testing for all specimens is conducted at both room temperature and elevated temperatures to probe the role of thermal activation on plastic deformation accommodation processes. Simulation efforts focus on examining the mechanical behavior of microscale specimens using a finite element approach with explicitly resolved grain morphologies, and an embedded crystal plasticity model. The cost-efficient implementation method allows for the modeling of a statistically significant number of both real (i.e., digital twin) and generated microstructures to obtain an understanding of the interrelationships between specimen microstructure and geometric variables (grain size, texture, specimen geometry, etc.) on microscale mechanical behavior.

36 MATERIALS SCIENCE↗

Can Simple Metrics Identify the Process(es) Driving Extreme Precipitation?

This work seeks an automatic algorithm to determine the primary meteorological cause(s) of individual extreme precipitation events. Such determinations have been made before, but required a by-hand analysis of each separate event. This is very time-consuming and the field would benefit from an automatic process. This is especially relevant when comparing different datasets to determine which ones most closely hew towards reality. This paper tests three simple metrics over the continental United States using the European Center for Medium-Range Weather Forecasting’s (ECMWF) atmospheric reanalysis (ERA5). The metrics tested measure and compare the strength of three meteorological processes associated with extreme precipitation: fronts, convection, and cyclones. A multivariate statistical technique as well as individual case studies show evidence that the three meteorological processes of interest cannot be isolated from one another using these simple physical metrics. This shows the difficulty in finding “pure” cases of these precipitation-generating processes and suggests approaching these processes with an eye toward mixed-type events.

Swenson, Leif M. (ORCID:0000000199708735)↗

Evaluating the Benefits of Bayesian Hierarchical Methods for Analyzing Heterogeneous Environmental Datasets: A Case Study of Marine Organic Carbon Fluxes

Large compilations of heterogeneous environmental observations are increasingly available as public databases, allowing researchers to test hypotheses across datasets. Statistical complexities arise when analyzing compiled data due to unbalanced spatial sampling, variable environmental context, mixed measurement techniques, and other reasons. Hierarchical Bayesian modeling is increasingly used in environmental science to describe these complexities, however few studies explicitly compare the utility of hierarchical Bayesian models to simpler and more commonly applied methods. Here we demonstrate the utility of the hierarchical Bayesian approach with application to a large compiled environmental dataset consisting of 5,741 marine vertical organic carbon flux observations from 407 sampling locations spanning eight biomes across the global ocean. We fit a global scale Bayesian hierarchical model that describes the vertical profile of organic carbon flux with depth. Profile parameters within a particular biome are assumed to share a common deviation from the global mean profile. Individual station-level parameters are then modeled as deviations from the common biome-level profile. The hierarchical approach is shown to have several benefits over simpler and more common data aggregation methods. First, the hierarchical approach avoids statistical complexities introduced due to unbalanced sampling and allows for flexible incorporation of spatial heterogeneitites in model parameters. Second, the hierarchical approach uses the whole dataset simultaneously to fit the model parameters which shares information across datasets and reduces the uncertainty up to 95% in individual profiles. Third, the Bayesian approach incorporates prior scientific information about model parameters; for example, the non-negativity of chemical concentrations or mass-balance, which we apply here. We explicitly quantify each of these properties in turn. We emphasize the generality of the hierarchical Bayesian approach for diverse environmental applications and its increasing feasibility for large datasets due to recent developments in Markov Chain Monte Carlo algorithms and easy-to-use high-level software implementations.

54 ENVIRONMENTAL SCIENCES↗

Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale

A strict throughput requirement has placed a cap on the degree to which we can depend on the execution of single, long, fine spatial grid simulations to explore global atmospheric climate behavior. Alternatively, running an ensemble of short simulations is computationally more efficient. We test the null hypothesis that the climate statistics of a full-complexity atmospheric model derived from an ensemble of independent short simulation is equivalent to that from an equilibrated long simulation. The climate of short simulation ensembles is statistically distinguishable from that of a long simulation in terms of the distribution of global annual means, largely due to the presence of low-frequency atmospheric intrinsic variability in the long simulation. We also find that model climate statistics of the simulation ensemble are sensitive to the choice of compiler optimizations. While some answer-changing optimization choices do not effect the climate state in terms of mean, variability and extremes, aggressive optimizations can result in significantly different climate states.

54 ENVIRONMENTAL SCIENCES↗

Statistical Sampling Considerations in Multifamily Housing

In the past 30 years, some governmental agencies and private-sector owners of multifamily housing properties have limited radon screening to partial screening (e.g., the testing of a subset of the multifamily housing dwelling units). While sampling methods have differed, most have required that if any one unit was found to be “positive,” or have radon levels ≥4 pCi/L, all remaining untested housing units would be tested (e.g. trip-wire approach).

63 RADIATION, THERMAL, AND OTHER ENVIRON. POLLUTAN↗

An application of survival analysis to disruption prediction via Random Forests</strong

We report one of the most pressing challenges facing the fusion community is adequately mitigating or, even better, avoiding disruptions of tokamak plasmas. However, before this can be done, disruptions must first be predicted with sufficient warning time to actuate a response. The established field of survival analysis provides a convenient statistical framework for time-to-event (i.e. time-to-disruption) studies. This paper demonstrates the integration of an existing disruption prediction machine learning algorithm with the Kaplan–Meier estimator of survival probability. Specifically discussed are the implied warning times from binary classification of disruption databases and the interpretation of output signals from Random Forest algorithms trained and tested on these databases. This survival analysis approach is applied to both smooth and noisy test data to highlight important features of the survival and hazard functions. In addition, this method is applied to three Alcator C-Mod plasma discharges and compared to a threshold-based scheme for triggering alarms. In one case, both techniques successfully predict the disruption; although, in another, neither warns of the impending disruption with enough time to mitigate. For the final discharge, the survival analysis approach could avoid the false alarm triggered by the threshold method. Limitations of this analysis and opportunities for future work are also presented.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Single-pixel interior filling function approach for detecting and correcting errors in particle tracking

We present a general method for detecting and correcting biases in the outputs of particle-tracking experiments. Our approach is based on the histogram of estimated positions within pixels, which we term the single-pixel interior filling function (SPIFF). We use the deviation of the SPIFF from a uniform distribution to test the veracity of tracking analyses from different algorithms. Unbiased SPIFFs correspond to uniform pixel filling, whereas biased ones exhibit pixel locking, in which the estimated particle positions concentrate toward the centers of pixels. Although pixel locking is a well-known phenomenon, we go beyond existing methods to show how the SPIFF can be used to correct errors. Here, the key is that the SPIFF aggregates statistical information from many single-particle images and localizations that are gathered over time or across an ensemble, and this information augments the single-particle data. We explicitly consider two cases that give rise to significant errors in estimated particle locations: undersampling the point spread function due to small emitter size and intensity overlap of proximal objects. In these situations, we show how errors in positions can be corrected essentially completely with little added computational cost. Additional situations and applications to experimental data are explored in SI Appendix. In the presence of experimental-like shot noise, the precision of the SPIFF-based correction achieves (and can even exceed) the unbiased Cramér–Rao lower bound. We expect the SPIFF approach to be useful in a wide range of localization applications, including single-molecule imaging and particle tracking, in fields ranging from biology to materials science to astronomy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Approach to Quality Assurance for Complex Environmental Modeling - 20407

A strong Quality Assurance (QA) program for complex environmental modeling is essential for regulatory and public acceptance and trust, but it does not have to be onerous. Neptune and Company, Inc. (Neptune) has developed a strong QA program that improves transparency, traceability, reproducibility, and therefore, defensibility and trust. Neptune's QA program has evolved over the past 27 years, transitioning from an ad hoc QA program, to a program that is currently Nuclear Quality Assurance-1 (NQA-1) compliant, and will soon be NQA-1/DOE approved for DOE EM modeling work. In addition, Neptune is a qualified laboratory assessor and qualified auditor for reference materials, a proficiency testing provider, and fully complies with the Environmental Protection Agency (EPA) QA program. Neptune's President and CEO, Kelly Black, was recently named the Chairperson of the International Organization for Standardization (ISO) Technical Committee 69, Application of Statistical Methods. A strong QA program has been developed for Neptune's radiological performance assessment (PA) program. Although pieces of their QA program are currently in development, their current program includes document control using Subversion, issue tracking and work flow tracking using JIRA, and transparency and traceability via a system of 'calc sheets' for documentation of all data analysis and modeling combined with 'check print' documentation of QA checking, and rigorous model testing and configuration control. All work is reviewed by an independent subject matter expert who is not associated with the collection and assembly of information, for an internal peer review. The program is enforced with a handful of Standard Operation Procedures (SOPs), Work Instructions, QA Project Plans (QAPPs), and Quality Management Plans (QMPs) that are updated frequently, with required annual training and acknowledgment. In addition, effective communication of modeling approaches and results to clients and stakeholders are integral to their QA program. Many of their models are built using the GoldSim modeling platform, for which their models are well-known for their level of transparency, documentation, and QA traceability. This level of QA is also applied to their process-level models. Neptune has taken some lessons learned from the extremely rigorous QA program required for the Yucca Mountain Project (YMP), and imposed the YMP requirements of complete traceability, transparency, and reproducibility, but avoided the inflexibility of a QA program that likely contributed to the suspect e-mails in 2005 that resulted in loss of trust in the YMP, and in nuclear waste disposal (and nuclear power) in general. There are far too many examples of loss of public trust due to poor QA that could have been easily avoided with a simple and straight-forward QA program combined with stakeholder engagement. The purpose of this paper is to share features of Neptune's Radiological Performance Assessment program QA program, and some of their QA related lessons learned over the past 27 years of QA for complex environmental modeling. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Data-Driven Passive Islanding Detection Scheme

This paper proposes a novel statistical parameters based data driven approach for passive islanding detection. The proposed scheme relies in the voltage data, measured at the point of common coupling, and is comprised of three stages. The Stage-1 quickly detects what is termed as coarse islanding, Stage-2 computes the decaying DC detector (DDCD), and 3) finally, the digital relay logic (DRL) is devised in Stage-3. The proposed scheme is tested as per the IEEE-1547, UL 1741 and IEC-62116 standards. Various tests are investigated on the modified IEEE-13 bus system, modeled in PSCAD/EMTDC, under stringent test scenarios such as power mismatch, induction motor starting effect, capacitor bank switching and various level of loads changes, considered for both single and multiple DG systems. The test results reveal that the proposed scheme can detect islanding in less than 2 cycles, and results in nearly zero non detection zone (NDZ). Also, the scheme can very well be used for single-phase microgrids too as it relies only on the single phase voltage information.

anti-islanding protection↗

Optimization of the deep neural network parameters for generating homogenized fuel assembly data for nodal codes

Homogenized fuel assembly (FA) data is a typical input data for nodal codes. Generating that data, however, could be time-consuming. One of promising ways to mitigate the computational burden of generating macroscopic cross-sections is to use trained artificial neural network (ANN) models for predicting nuclear data. However, there is a challenge to make the model support variable FA geometry. In this work, two most common types of FA were combined in one ANN model. Since there could be multiple ways of converting 2-dimensional FA data into 1-dimensional input vector for ANN, three different approaches of data flattening were evaluated. The input parameters included each fuel pin enrichment, fuel temperature, moderator temperature and boron concentration. The output parameters were 2-group macroscopic cross-sections (XS) and pin power distribution (HFF). A fully connected deep neural network (DNN) model was trained and tested using pre-generated data obtained with lattice physics code STREAM. The results of this study showed no statistically significant difference in the accuracy of XS and HFF generation for all 3 tested input vector orders. This means that fully connected DNN for XS generation demonstrated input sequence invariance. Results of comparing predicted XS data with reference solutions were found sufficiently close considering the reduction of computation time offered by ANN. Mean relative difference (MRD) for all output XS parameters was found below 0.7%, while HFF MRD was found higher compared to XS values, in some cases slightly exceeding 1%, mostly near guide tube locations. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗