Search NASA⌕ Search

SEARCH · Search NASA

Results for “test statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Preventing Failures By Dataset Shift Detection in Safety-Critical Graph Applications

Dataset shift refers to the problem where the input data distribution may change over time (e.g., between training and test stages). Since this can be a critical bottleneck in several safety-critical applications such as healthcare, drug-discovery, etc., dataset shift detection has become an important research issue in machine learning. Though several existing efforts have focused on image/video data, applications with graph-structured data have not received sufficient attention. Therefore, in this paper, we investigate the problem of detecting shifts in graph structured data through the lens of statistical hypothesis testing. Specifically, we propose a practical two-sample test based approach for shift detection in large-scale graph structured data. Our approach is very flexible in that it is suitable for both undirected and directed graphs, and eliminates the need for equal sample sizes. Using empirical studies, we demonstrate the effectiveness of the proposed test in detecting dataset shifts. We also corroborate these findings using real-world datasets, characterized by directed graphs and a large number of nodes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Highly accelerated life testing (HALT): A review from a statistical perspective

Despite its use in one form or another for at least four decades, HALT and related techniques [e.g., highly accelerated-stress screening (HASS) and stress audits (HASA)] are not well understood within the statistical community and remain controversial. This largely reflects a conflict in motivation between engineers, testing under harsh conditions to discover and eliminate failure modes, and statisticians, taking a more cautious approach to develop quantitative estimates of parameters such as mean time between failures (MTBF). Here, this review article will clarify HALT concepts and methods and explain where it fits within the universe of methods that involve the application of accelerating factors to compress the time required to evaluate or enhance product reliability. A major distinction is between methods such as HALT, a high-stress test-analyze-fix-test iterative process directed at improving reliability by discovering and fixing weak points in a design, and quantitative accelerated life testing (QALT), whose goal is the estimation of product life for a fixed design. We discuss methods such as physics of failure that offer some hope of bridging the gap between the qualitative nature of HALT, and purely quantitative statistical methods. We present a variety of engineering applications of HALT including metal fatigue, piping and pressure vessels, structural damage, radiation damage, and rotating machinery. We also discuss potential synergies between HALT and QALT, such as rapid identification, through HALT, of failure modes requiring quantitative analysis. For further study, extensive references to the applicable literature are provided as well as an appendix that describes related methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Short-term nodal load forecasting based on machine learning techniques

This paper introduces an advanced Short-term Nodal Load Forecasting (STNLF) method that forecasts nodal load profiles for the next day in power systems, based on the combined use of three machine learning techniques. Least Absolute Shrinkage and Selection Operator (LASSO) is employed to reduce the number of features for a single nodal load forecasting. Principal Component Analysis (PCA) is used to capture the features of historical loads in low-dimensional space compared to the original high-dimensional load space where features are barely possible to depict. Additionally, Bayesian Ridge Regression (BRR) is utilized to decide the parameters of the prediction model from a statistics perspective. Tests based on modified PJM load data demonstrate the effectiveness of the proposed STNLF method compared to the state-of-the-art General Regression Neural Network (GRNN) method. Moreover, the reliability of the day-ahead Unit Commitment (UC) solution is shown to have been improved, based on the forecasted load data using the proposed STNLF method.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

An algorithm for detecting and quantifying disturbance and recovery in high-frequency time series

Determining when a disturbance has occurred, its severity, and when the system recovered, is important to numerous questions in the aquatic sciences. This problem can be conceptualized as the timing and degree of perturbation from a typical state, and when the system returns to that typical state. We present an algorithm for detecting disturbance and recovery designed for high-frequency time series, e.g., data produced by automated sampling devices in instrumented buoys and flux towers. The algorithm quantifies differences in the empirical cumulative distribution functions of moving windows over reference and evaluation periods, and is sensitive to changes in the mean, variance, and higher statistical moments. Tests on simulated data show it accurately identifies disturbance and recovery. Three case studies illustrate the application of our algorithm in different empirical settings. A case study on dissolved oxygen in a Florida, USA estuary following a hurricane identified the disturbance and recovery 73 d later. A case study on air temperature and net ecosystem exchange in the Florida everglades identified cold snaps coinciding with periods of reduced carbon uptake. A case study on rotifer abundance following zebra mussel invasion in the Hudson River, NY showed rotifer collapse following invasion and recovery over a decade later. Methods such as ours can improve understanding response to disturbance and facilitate comparative and synthetic study of disturbance impacts across ecosystems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Analysis of aerosol cloud interactions with a consistent signal of meteorology and other influencing parameters

Quantifying the impact of aerosols on cloud micro/macro physical properties and estimating the signature of Aerosol Cloud Interactions (ACI) is one of the challenging tasks in atmospheric sciences. The Moderate Resolution Imaging Spectroradiometer and the European Centre for Medium-Range Weather Forecasts ERA-5 reanalysis data are employed to systematically study the ACI over the monsoon region in Pakistan. Based on the monsoon occurrence and rainfall intensity, the whole region is divided into three sub-regions labeled as highly intensive (R1), moderately intensive (R2) and weak (R3) monsoon region. The results indicate that the monthly mean Aerosol Optical Depth (AOD) peaks in the summer monsoon months (Jun, Jul, Aug, Sep). Here, the well-known Twomey effect whereby the Cloud Droplet Radius (CDR) decreases with increasing AOD holds only over R3; the opposite effects (Anti-Twomey effect) are found over R1 and R2, all passing the test of statistical significance (p<0.05). The multi-year AOD is found to be positively correlated with Cloud Liquid Water Path (CLWP) and Cloud Optical Depth (COD) over R1 and R2, suggesting that thicker clouds containing more water droplets are formed in polluted atmosphere. Over R3, decreases in CLWP and COD are found with increasing AOD only when AOD is less than~0.325. The analysis of ACI over R1 and R2 during the winter months shows similar but stronger responses of CDR, CLWP and COD to the variation in AOD. The weaker responses during the summer monsoon season may attributed to the occurrence of high level cloud and unstable atmospheric condition. Further investigation of the influences of Relative Humidity and pressure vertical velocity on the CDR-AOD relationships shows that although the magnitude of the CDR-AOD correlations change with meteorological conditions, the sign of correlations remain unchanged with meteorological conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Parametric study and speciation analysis of rare earth precipitation using oxalic acid in a chloride solution system

Oxalic acid precipitation is a common step in the purification of rare earth elements (REE) from a concentrated pregnant leach solution (PLS). However, the presence of contaminants such as Al, Fe, and Ca in given amounts decreases the REE precipitation efficiency and product purity while also increasing the amount of oxalic acid needed to maximize recovery. As such, a statistically designed test program was performed to identify the optimal conditions necessary for a relatively low REE content PLS containing elevated concentrations of contaminant ions. The performance objective was maximization of REE precipitation efficiency while minimizing the oxalic acid dosage. A central composite design was utilized to quantify performance impacts and identify the ultimate set of parameter values for oxalic acid dosage, Fe(III) contamination concentration, solution pH, and reaction temperature. The resultant model suggested that oxalic acid dosage and reaction pH are the most significant factors for the REE precipitation efficiency, followed by the interaction of oxalic dosage and Fe concentration. Test results indicate that increasing the oxalic acid concentration from 0 g/L to 80 g/L improved the REE precipitation efficiency from approximately 4.2% to 95.0%. Furthermore, raising the solution pH from 0.5 to 2.5 considerably enhanced the precipitation efficiency from 0.0% to 98.9%. A solution temperature elevation decreased REE recovery, which indicated an exothermic reaction between REEs and oxalate anions. Finally, a high level of Fe contamination adversely impacted REE precipitation efficiency. Here, to further the understanding of the REE-oxalate system, a fundamental solution chemistry study was performed using the equilibrium constants of the reactions. The study resulted in the development of oxalate speciation diagrams and provided an analysis of the REE precipitation characteristics at various oxalate anion concentrations and Fe(III) contamination levels using MINTEQ software. The dominant Fe(III) species in the solution system were found to be Fe-(C 2 O 4 ) 3 3- , Fe-(C 2 O 4 ) 2- , and Fe-(C 2 O 4 ) + , which consume the majority of the oxalate anions. The simulated model was found to be in agreement with the experimental findings and helped to explain the adverse impact of increased iron concentrations on REE precipitation efficiency.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Combined Neyman–Pearson chi-square: An improved approximation to the Poisson-likelihood chi-square

We describe an approximation to the widely-used Poisson-likelihood chi-square using a linear combination of Neyman’s and Pearson’s chi-squares, namely “combined Neyman–Pearson chi-square” ($X^2_{CNP}$). Through analytical derivations and toy model simulations, we show that leads to a significantly smaller bias on the best-fit model parameters compared to those using either Neyman’s or Pearson’s chi-square. When the computational cost of using the Poisson-likelihood chi-square is high, $X^2_{CNP}$ provides a good alternative given its natural connection to the covariance matrix formalism.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Adaptation Strategies Strongly Reduce the Future Impacts of Climate Change on Simulated Crop Yields

Abstract Simulations of crop yield due to climate change vary widely between models, locations, species, management strategies, and Representative Concentration Pathways (RCPs). To understand how climate and adaptation affects yield change, we developed a meta‐model based on 8703 site‐level process‐model simulations of yield with different future adaptation strategies and climate scenarios for maize, rice, wheat and soybean. We tested 10 statistical models, including some machine learning models, to predict the percentage change in projected future yield relative to the baseline period (2000–2010) as a function of explanatory variables related to adaptation strategy and climate change. We used the best model to produce global maps of yield change for the RCP4.5 scenario and identify the most influential variables affecting yield change using Shapley additive explanations. For most locations, adaptation was the most influential factor determining the projected yield change for maize, rice and wheat. Without adaptation under RCP4.5, all crops are expected to experience average global yield losses of 6%–21%. Adaptation alleviates this average projected loss by 1–13 percentage points. Maize was most responsive to adaptive practices with a projected mean yield loss of −21% [range across locations: −63%, +3.7%] without adaptation and −7.5% [range: −46%, +13%] with adaptation. For maize and rice, irrigation method and cultivar choice were the adaptation types predicted to most prevent large yield losses, respectively. When adaptation practices are applied, some areas are predicted to experience yield gains, especially at northern high latitudes. These results reveal the critical importance of implementing adequate adaptation strategies to mitigate the impact of climate change on crop yields.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Thermodynamics of order and randomness in dopant distributions inferred from atomically resolved imaging

Abstract Exploration of structure-property relationships as a function of dopant concentration is commonly based on mean field theories for solid solutions. However, such theories that work well for semiconductors tend to fail in materials with strong correlations, either in electronic behavior or chemical segregation. In these cases, the details of atomic arrangements are generally not explored and analyzed. The knowledge of the generative physics and chemistry of the material can obviate this problem, since defect configuration libraries as stochastic representation of atomic level structures can be generated, or parameters of mesoscopic thermodynamic models can be derived. To obtain such information for improved predictions, we use data from atomically resolved microscopic images that visualize complex structural correlations within the system and translate them into statistical mechanical models of structure formation. Given the significant uncertainties about the microscopic aspects of the material’s processing history along with the limited number of available images, we combine model optimization techniques with the principles of statistical hypothesis testing. We demonstrate the approach on data from a series of atomically-resolved scanning transmission electron microscopy images of Mo x Re 1- x S 2 at varying ratios of Mo/Re stoichiometries, for which we propose an effective interaction model that is then used to generate atomic configurations and make testable predictions at a range of concentrations and formation temperatures.

25 ENERGY STORAGE↗
DOE OSTI2023

A species’ response to spatial climatic variation does not predict its response to climate change

The dominant paradigm for assessing ecological responses to climate change assumes that future states of individuals and populations can be predicted by current, species-wide performance variation across spatial climatic gradients. However, if the fates of ecological systems are better predicted by past responses to in situ climatic variation through time, this current analytical paradigm may be severely misleading. Empirically testing whether spatial or temporal climate responses better predict how species respond to climate change has been elusive, largely due to restrictive data requirements. Here, we leverage a newly collected network of ponderosa pine tree-ring time series to test whether statistically inferred responses to spatial versus temporal climatic variation better predict how trees have responded to recent climate change. When compared to observed tree growth responses to climate change since 1980, predictions derived from spatial climatic variation were wrong in both magnitude and direction. This was not the case for predictions derived from climatic variation through time, which were able to replicate observed responses well. Future climate scenarios through the end of the 21st century exacerbated these disparities. These results suggest that the currently dominant paradigm of forecasting the ecological impacts of climate change based on spatial climatic variation may be severely misleading over decadal to centennial timescales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Designing an Intrusion Detection for an Adjustable Speed Drive System Controlling a Critical Process

In this article, we address the cyber-security problem of industrial control systems (ICSs) when their sensor measurements may be compromised due to an attacker who has intercepted those measurements via a network. We introduce a general-purpose method “Dynamic Watermarking (DW)” to detect potential cyber-intrusions on speed sensor measurements within industrial control systems, which deploy an adjustable speed drive (ASD) to control a critical process. The DW method is injecting a random private low-amplitude signal with a zero mean Gaussian distribution, “watermark”, into one of the input phase voltages powering the ASD system. The watermark signal propagates through the system including pulse width modulation (PWM) power conversion stage and motor, then ultimately appears in the speed sensor measurements. By deploying two statistical DW tests with two proper thresholds, the system can detect potential cyber-intrusions or unobservable cyber-attacks such as replay attacks and false data injection attacks (FDIA). The DW method tested on a laboratory-scale ASD system experimentally to protect the system against cyber-intrusions. This system, powered by a commercial PWM drive operating at 208 V, 3-phase, and 3.7 kW, served as our experimental platform.

42 ENGINEERING↗
DOE OSTI2021

An Active Detection Scheme for Sensor Spoofing in Grid-tied PV Systems

In this paper an active detection scheme for sensor spoofing (manipulated externally via a cyber attack) in grid-tied PV systems is discussed. The core of the proposed active detection scheme is to introduce a private (secret) watermarking signal into the control inputs of the DC-DC converter and DC-AC inverter stages to detect any malicious spoofing (manipulation) of voltage/current sensor measurements controlling both the DC-DC converter maximum power point tracking (MPPT) stage and the DC-AC inverter of the grid-tied PV system. Several types of possible spoofing mechanisms (attack models) are discussed. The proposed sensor spoofing attack detector system consists of injecting a small magnitude of digital watermarking signal (DWS) and conduct three statistical watermark tests on the reported sensor measurements to determine if a) the proposed system is healthy and operating as expected b) if sensor signals were spoofed (manipulated) externally or c) if a particular sensor is malfunctioning due to a faulty hardware. It is shown via extensive simulations that the proposed DWS approach is robust in detecting malicious external manipulation of sensors controlling the grid tied PV system. A testing platform is currently under development and the experimental results will be discussed in the conference presentation.

Ibrahim, Hasan↗
DOE OSTI2022

Designing an Intrusion Proof Adjustable Speed Drive System Controlling a Critical Process

In this paper, an intrusion proof adjustable speed drive system controlling a critical process in an industrial control system is detailed. In such a system, should the motor speed sensor signal data be compromised and/or altered via a cyber-attack, the system can potentially be unregulated, over speed and/or malfunction thereby disrupting the critical process. The proposed active detection scheme detailed in this paper introduces a private (secret) random signal termed as "watermark" into the inverter control signal that determines the PWM gating signals of the DC-AC inverter powering the motor. The watermarking signal introduced into the PWM modulation for the DC-AC inverter is shown to propagates its unique signature, which appears in all sensors signals at the inverter output such as voltage/current/speed used to control the motor. Now employing the measured data (from sensors), two statistical variance tests are conducted to identify anomalies if any in the presence of the watermarking signal. It is shown when an intrusion occurs to manipulate the sensor data to disturb and/or destabilize the process, the proposed tests immediately display a high value indicating a compromise in sensor data. It is shown that the proposed system is capable of immediate detection of a sophisticated attacks such as record/reply attack in which the actual speed sensor is disconnected and a prerecorded speed signal from the past of the same magnitude is played back to the controller. Several types of cyber-attacks such as speed reduction/increase including vibration have been tested. Extensive simulation results verify the proposed concepts. Experimental results will be discussed in the conference presentation.

Alotaibi, Faris↗
DOE OSTI2022

LCSL-II Cryomodule Testing at Fermilab

Cold powered testing of all LCLS-II production cryomodules at Fermilab is complete as of February 2021. A total of twenty-five tests on both 1.3 GHz and 3.9 GHz cryomodules were conducted over a nearly five year time span beginning in the summer of 2016. During the course of this campaign cutting-edge results for cavity Q₀ and gradient in continuous wave operation were achieved. A summary of all test results will be presented, with a comparison to established acceptance criteria, as well as overall test stand statistics and lessons learned.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

The relationship between stress, anxiety and eating behavior among Chinese students: a cross-sectional study

Background The expansion of higher education and the growing number of college students have led to increased awareness of mental health issues such as stress, anxiety, and eating disorders. In China, the educational system and cultural expectations contribute to the stress experienced by college students. This study aims to clarify the role of anxiety as a mediator in the relationship between stress and eating behaviors among Chinese college students. Methods This study utilized data from the 2021 Psychology and Behavior Investigation of Chinese Residents, which included 1,672 college students under the age of 25. The analysis methods comprised descriptive statistics, t -tests, Pearson correlation analyses, and mediation effect analysis. Results The findings indicate that Chinese college students experience high levels of stress, with long-term stress slightly exceeding short-term stress. Both types of stress were positively correlated with increased anxiety and the adoption of unhealthy eating behaviors. Anxiety was identified as a significant mediator, accounting for 28.3% of the relationship between long-term stress and eating behavior (95% CI = 0.058–0.183). The mediation effect of short-term stress on eating behavior through anxiety was also significant, explaining 61.4% of the total effect (95% CI = 0.185–0.327). Conclusion The study underscores the importance of stress management and mental health services for college students. It recommends a comprehensive approach to reducing external pressures, managing anxiety, and promoting healthy eating behaviors among college students. Suggestions include expanding employment opportunities, providing career guidance, enhancing campus and societal support for holistic development, strengthening mental health services, leveraging artificial intelligence technologies, educating on healthy lifestyles, and implementing targeted health promotion programs.

Chai, Yulin↗
DOE OSTI2023

Development of a High Min-Entropy Quantum Random Number Generator Based on Amplified Spontaneous Emission

We present the theory, architecture, and performance characteristics of a quantum random number generator (QRNG) which operates in a PCI express form factor-compatible plug-and-play design. The QRNG relies on a thermal light source (in this case, amplified spontaneous emission), which exhibits photon bunching according to the Bose–Einstein (BE) statistics. We demonstrate that 98.7% of the unprocessed random bit stream min-entropy is traceable to the BE (quantum) signal. The classical component is then removed using a non-reuse shift-XOR protocol, and the final random numbers are generated at a 200 Mbps rate and shown to pass the statistical randomness test suites FIPS 140-2, Alphabit, SmallCrush, DIEHARD, and Rabbit of the TestU01 library.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

SNM Radiation Signature Classification Using Different Semi-Supervised Machine Learning Models

The timely detection of special nuclear material (SNM) transfers between nuclear facilities is an important monitoring objective in nuclear nonproliferation. Persistent monitoring enabled by successful detection and characterization of radiological material movements could greatly enhance the nuclear nonproliferation mission in a range of applications. Supervised machine learning can be used to signal detections when material is present if a model is trained on sufficient volumes of labeled measurements. However, the nuclear monitoring data needed to train robust machine learning models can be costly to label since radiation spectra may require strict scrutiny for characterization. Therefore, this work investigates the application of semi-supervised learning to utilize both labeled and unlabeled data. As a demonstration experiment, radiation measurements from sodium iodide (NaI) detectors are provided by the Multi-Informatics for Nuclear Operating Scenarios (MINOS) venture at Oak Ridge National Laboratory (ORNL) as sample data. Anomalous measurements are identified using a method of statistical hypothesis testing. After background estimation, an energy-dependent spectroscopic analysis is used to characterize an anomaly based on its radiation signatures. In the absence of ground-truth information, a labeling heuristic provides data necessary for training and testing machine learning models. Supervised logistic regression serves as a baseline to compare three semi-supervised machine learning models: co-training, label propagation, and a convolutional neural network (CNN). In each case, the semi-supervised models outperform logistic regression, suggesting that unlabeled data can be valuable when training and demonstrating value in semi-supervised nonproliferation implementations.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2025

Moving beyond post hoc explainable artificial intelligence: a perspective paper on lessons learned from dynamical climate modeling

AI models are criticized as being black boxes, potentially subjecting climate science to greater uncertainty. Explainable artificial intelligence (XAI) has been proposed to probe AI models and increase trust. In this review and perspective paper, we suggest that, in addition to using XAI methods, AI researchers in climate science can learn from past successes in the development of physics-based dynamical climate models. Dynamical models are complex but have gained trust because their successes and failures can sometimes be attributed to specific components or sub-models, such as when model bias is explained by pointing to a particular parameterization. We propose three types of understanding as a basis to evaluate trust in dynamical and AI models alike: (1) instrumental understanding, which is obtained when a model has passed a functional test; (2) statistical understanding, obtained when researchers can make sense of the modeling results using statistical techniques to identify input–output relationships; and (3) component-level understanding, which refers to modelers' ability to point to specific model components or parts in the model architecture as the culprit for erratic model behaviors or as the crucial reason why the model functions well. We demonstrate how component-level understanding has been sought and achieved via climate model intercomparison projects over the past several decades. Such component-level understanding routinely leads to model improvements and may also serve as a template for thinking about AI-driven climate science. Currently, XAI methods can help explain the behaviors of AI models by focusing on the mapping between input and output, thereby increasing the statistical understanding of AI models. Yet, to further increase our understanding of AI models, we will have to build AI models that have interpretable components amenable to component-level understanding. We give recent examples from the AI climate science literature to highlight some recent, albeit limited, successes in achieving component-level understanding and thereby explaining model behavior. The merit of such interpretable AI models is that they serve as a stronger basis for trust in climate modeling and, by extension, downstream uses of climate model data.

54 ENVIRONMENTAL SCIENCES↗