Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistical change detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Statistical change detection of building energy consumption: Applications to savings estimation

The surge in interval meter data availability and associated activity in energy data analytics has inspired new interest in advanced methods for building efficiency savings estimation. Statistical and machine learning approaches are being explored to improve the energy baseline models used to measure and verify savings. One outstanding challenge is the ability to identify and account for operational changes that may confound savings estimates. In the measurement and verification (M&V) context, ‘non-routine events’ (NREs) cause changes in building energy use that are not attributable to installed efficiency measures, and not accounted for in the baseline model’s independent variables. In the M&V process NREs must be accounted for as ‘adjustments’ to appropriately attribute the estimated energy savings to the specific efficiency interventions that were implemented. Currently this is a manual and custom process, conducted using professional judgment and engineering expertise. As such it remains a barrier in scaling and standardizing meter-based savings estimation. Here in this work, a data driven methodology was developed to (partially) automate, and therefore streamline the process of detecting NREs in the post-retrofit period and making associated savings adjustments. The proposed NRE detection algorithm is based on a statistical change point detection method and a dissimilarity metric. The dissimilarity metric measures the proximity between the actual time series of the post-retrofit energy consumption and the projected baseline, which is generated using a statistical baseline model. The suggested approach for NRE adjustment involves the NRE detection algorithm, the M&V practitioner, and a regression modeling algorithm. The performance of the detection and adjustment algorithm was evaluated using a simulation-generated test data set, and two benchmark algorithms. Results show a high true positive detection rate (75%-100% across the test cases), higher than ideal false positive detection rates (20%-70%), and low errors in energy adjustment (<0.7%). These results indicate that the algorithm holds for helping M&V practitioners to streamline the process of handling NREs. Moreover, the change point algorithm and underlying statistical principles could prove valuable for other building analytics applications such as anomaly detection and fault diagnostics.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

A statistical approach for detection of anatomical change - Paper 115

The purpose of this study was to develop a novel statistics-based method for automated detection of anatomical changes using cone-beam CT (CBCT) images of head and neck (H and N) patients. Vendor supplied CBCT software provides the user with the basic tools that allow for the visual assessment of the co-registration of the reference CT data and daily CBCT images. Currently there is no commercially available CBCT software that is capable of detecting anatomical changes and giving the clinician an early alert for the treatment plan adaptation. An algorithm was developed that can detect statistically significant changes at a given confidence level for H and N patients. This tool provides a reliable and automated early warning system that enables a 'just-in-time' adaptation of the treatment plan. A method was developed for automated detection of anatomical changes in H and N patients under radiation therapy treatment. The method utilized imaging CT data along with daily CBCT images to quantitatively compare the patient anatomy against the reference CT imaging data. The comparison algorithm was developed using a statistics-based approach as opposed to threshold-based methods. The algorithm allows for reliable detection of statistically significant changes in the observed patient anatomy at a given level of confidence. The method can be employed as an integral part of the adaptive radiotherapy framework. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

A Probabilistic Model-Based Diagnostic Framework for Nuclear Engineering Systems

A fault diagnostic framework was investigated in this study for applications in thermal–hydraulic systems of nuclear power plants. The proposed framework consists of quantitative model-based diagnosis, statistical change detection and probabilistic reasoning. The use of physics-based diagnostic models provides high detection sensitivity and allows noise and measurement uncertainty to be incorporated robustly. Performance-related parametric models for each component are constructed based on first principles. Numerical model residuals are generated using the concept of analytical redundancy. Statistical change detection methods are employed to detect non-zero residuals in the presence of uncertainty. The diagnosis task is performed using Bayesian inference to detect and localize possible faults. Application to a single-phase heat exchanger for demonstration showed that the proposed probabilistic framework can provide improved results in comparison with traditional approaches while remaining less sensitive to false alarms in the presence of measurement and modeling uncertainty.

Bayesian network↗

Clutter Identification based on sparse recovery with dynamically changing dictionary sizes for cognitive radar

Existing radar algorithms assume stationary statistical characteristics for environment/clutter. In practical scenarios, the statistical characteristics of the clutter can dynamically change depending on where the radar is operating. Non-stationarity in the statistical characteristics of the clutter may negatively affect the radar performance. Cognitive radar that can sense the changes in the clutter statistics, learn the new statistical characteristics, and adapt to these changes has been proposed to overcome these shortcomings. We have recently developed techniques for detection of statistical changes and learning the new clutter distribution for cognitive radar. In this work, we will extend the learning component. More specifically, in our previous work, we have developed a sparse recovery based clutter distribution identification to learn the distribution of the new clutter characteristics after the detected change in the statistics of the clutter. In our method, we have built a dictionary of clutter distributions and used this dictionary in orthogonal matching pursuit to perform sparse recovery of the clutter distribution assuming that the dictionary includes the new distribution. In this work, we propose a hypothesis testing based approach to detect whether the new distribution of the clutter is included in the dictionary or not, and suggest a method to dynamically update the dictionary. We envision that the successful outcomes of this work will be of high relevance to the adaptive learning and cognitive augmentation of the radar systems that are used in remotely piloted vehicles for surveillance and reconnaissance operations.

Zhu, Yuansheng↗

Change Detection in Constellations of Buried Objects Extracted From Ground-Penetrating Radar Data

Detection of deliberately buried objects in ground-penetrating radar (GPR) data acquired along a path is a clutter-limited problem. Detection-false alarm rate performance can be improved by replacing the detection statistic with a change statistic that incorporates information from previous path traversals. A constellation matching approach is developed for buried-object change detection in GPR data. Network topologies of buried objects detected in GPR data from previous path traversals are maintained in a constellation database. Localized groups of buried objects newly detected on the latest path traversal are matched to the constellation. Buried objects from the latest path traversal whose locations or strengths cannot be reconciled with the constellation are identified as changes. The system has one component that generates constellation databases offline and another component suitable for change detection in real time. It can tolerate paths with significant translational misalignments. The system uses the following: 1) a customized translational relaxation algorithm for point pattern matching that incorporates detection strength and a probabilistic uncertainty model for buried-object location into the objective function and 2) a change statistic that accounts for the magnitude of change relative to predicted detection strength. A constellation database can typically be generated offline from a single path traversal roughly two orders of magnitude faster than the time typically required for a vehicle to travel the extent of the path. Database sizes are typically four to five orders of magnitude smaller than the data sets of GPR signal scans or focused 3-D GPR images that they were generated from. On bumpy dirt roads buried exclusively with nonmetallic objects at various depths, detection-false alarm rate performance is shown to be significantly better for our change statistics than for our detection statistics.

47 OTHER INSTRUMENTATION↗

Trends in atmospheric patterns conducive to seasonal precipitation and temperature extremes in California

Recent evidence suggests that changes in atmospheric circulation have altered the probability of extreme climate events in the Northern Hemisphere. We investigate northeastern Pacific atmospheric circulation patterns that have historically (1949–2015) been associated with cool-season (October-May) precipitation and temperature extremes in California. We identify changes in occurrence of atmospheric circulation patterns by measuring the similarity of the cool-season atmospheric configuration that occurred in each year of the 1949–2015 period with the configuration that occurred during each of the five driest, wettest, warmest, and coolest years. Our analysis detects statistically significant changes in the occurrence of atmospheric patterns associated with seasonal precipitation and temperature extremes. We also find a robust increase in the magnitude and subseasonal persistence of the cool-season West Coast ridge, resulting in an amplification of the background state. Changes in both seasonal mean and extreme event configurations appear to be caused by a combination of spatially nonuniform thermal expansion of the atmosphere and reinforcing trends in the pattern of sea level pressure. In particular, both thermal expansion and sea level pressure trends contribute to a notable increase in anomalous northeastern Pacific ridging patterns similar to that observed during the 2012–2015 California drought. Collectively, our empirical findings suggest that the frequency of atmospheric conditions like those during California’s most severely dry and hot years has increased in recent decades, but not necessarily at the expense of patterns associated with extremely wet years.

54 ENVIRONMENTAL SCIENCES↗

A swarm intelligence-based approach to anomaly detection of dynamic systems

Here we propose a novel Swarm Intelligence-based approach for anomaly detection of dynamic systems. Specifically, we consider observation processes for dynamic systems from a foraging perspective, and ant foraging behavior-based search techniques are applied to the discovery of the ‘intrinsic communication topology’ of systems. The key idea exploited here is that systems can be viewed as ‘communication networks’ where interconnected elements communicate with one another through physical phenomena and the elements ‘process’ the communications through their dynamics; this defines the ‘intrinsic communication topology’ of the system. The behaviors of individual elements can be at least partially observed in the dynamics of other communicating system elements and, hence, condition changes will be reflected in changes in the intrinsic communications. Anomaly detection is then performed by observing the changes in the intrinsic communication topology by tracking graph similarity measures and using change point detection to determine when statistically significant changes have occurred. The performance of the proposed approach is investigated in simulation where we consider a system composed of multiple networks, each with different topologies and connection strengths, and where the individual networks comprising the system can be switched at arbitrary times. The proposed methodology is applied to this system to detect the switches between the networks and to discover the communication topologies associated with each of the network configurations.

97 MATHEMATICS AND COMPUTING↗

Selecting a Classification Ensemble and Detecting Process Drift in an Evolving Data Stream

We characterize the commercial behavior of a group of companies in a common line of business using a small ensemble of classifiers on a stream of records containing commercial activity information. This approach is able to effectively find a subset of classifiers that can be used to predict company labels with reasonable accuracy. Performance of the ensemble, its error rate under stable conditions, can be characterized using an exponentially weighted moving average (EWMA) statistic. The behavior of the EWMA statistic can be used to monitor a record stream from the commercial network and determine when significant changes have occurred. Results indicate that larger classification ensembles may not necessarily be optimal, pointing to the need to search the combinatorial classifier space in a systematic way. Results also show that current and past performance of an ensemble can be used to detect when statistically significant changes in the activity of the network have occurred. The dataset used in this work contains tens of thousands of high level commercial activity records with continuous and categorical variables and hundreds of labels, making classification challenging.

Ensemble classifiers↗

SU-E-J-191: Automated Detection of Anatomic Changes in H'N Patients

Purpose: To develop a novel statistics-based method for automated detection of anatomical changes using cone-beam CT data. A method was developed that can provide a reliable and automated early warning system that enables a “just-in-time” adaptation of the treatment plan. Methods: Anatomical changes were evaluated by comparing the original treatment planning CT with daily CBCT images taken prior treatment delivery. The external body contour was computed on a given CT slice and compared against the corresponding contour on the daily CBCT. In contrast to threshold-based techniques, a statistical approach was employed to evaluate the difference between the contours using a given confidence level. The detection tool used the two-sample Kolmogorov-Smirnov test, which is a non-parametric technique that compares two samples drawn from arbitrary probability distributions. 11 H'N patients were retrospectively selected from a clinical imaging database with a total of 186 CBCT images. Six patients in the database were confirmed to have anatomic changes during the course of radiotherapy. Five of the H'N patients did not have significant changes. The KS test was applied to the contour data using a sliding window analysis. The confidence level of 0.99 was used to moderate false detection. Results: The algorithm was able to correctly detect anatomical changes in 6 out of 6 patients with an excellent spatial accuracy as early as at the 14th elapsed day. The algorithm provided a consistent and accurate delineation of the detected changes. The output of the anatomical change tool is easy interpretable, and can be shown overlaid on a 3D rendering of the patient's anatomy. Conclusion: The detection method provides the basis for one of the key components of Adaptive Radiation Therapy. The method uses tools that are readily available in the clinic, including daily CBCT imaging, and image co-registration facilities.

60 APPLIED LIFE SCIENCES↗

A novel data-driven learning method for radar target detection in nonstationary environments

Most existing radar algorithms are developed under the assumption that the environment (clutter) is stationary. However, in practice, the characteristics of the clutter can vary enormously depending on the radar-operational scenarios. If unaccounted for, these nonstationary variabilities may drastically hinder the radar performance. Therefore, to overcome such shortcomings, we develop a data-driven method for target detection in nonstationary environments. In this method, the radar dynamically detects changes in the environment and adapts to these changes by learning the new statistical characteristics of the environment and by intelligibly updating its statistical detection algorithm. Specifically, we employ drift detection algorithms to detect changes in the environment; incremental learning, particularly learning under concept drift algorithms, to learn the new statistical characteristics of the environment from the new radar data that become available in batches over a period of time. The newly learned environment characteristics are then integrated in the detection algorithm. Furthermore, we use Monte Carlo simulations to demonstrate that the developed method provides a significant improvement in the detection performance compared with detection techniques that are not aware of the environmental changes.

47 OTHER INSTRUMENTATION↗

Quickest Detection for Changes in Maximal kNN Coherence of Random Matrices

This paper addresses the problem of quickest detection of a change in the maximal coherence between columns of a n p random matrix based on a sequence of matrix observations having a single unknown change point. The random matrix is assumed to have identically distributed rows and the maximal coherence is defined as the largest of the ( 2 p) correlation coefficients associated with any row. Likewise the κ nearest neighbor (kNN) coherence is defined as the κ-th largest of these correlation coefficients. The forms of the preand postchange distributions of the observed matrices are assumed to belong to the family of elliptically contoured densities with sparse dispersion matrices but are otherwise unknown. A nonparametric stopping rule is proposed that is based on the maximal kNN sample coherence between columns of each observed random matrix. This is a summary statistic that is related to a test of existence of a hub vertex in a sample correlation graph having degree at least κ. Performance bounds on the delay and false alarm performance of the proposed stopping rule are obtained in the purely high-dimensional regime where p → ∞ and n is fixed. When the prechange dispersion matrix is diagonal it is shown that, among all functions of the proposed summary statistic, the proposed stopping rule is asymptotically optimal under a minimax quickest change detection model as the stopping threshold approaches infinity. Furthermore, the theory developed also applies to sequential hypothesis testing and fixed sample size tests.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Toward Statistical Real-Time Power Fault Detection

We propose statistical fault detection methodology based on high-frequency data streams that are becoming available in modern power grids. Our approach can be treated as an online (sequential) change point monitoring methodology. However, due to the mostly unexplored and very nonstandard structure of high-frequency power grid streaming data, substantial new statistical development is required to make this methodology practically applicable. The paper includes development of scalar detectors based on multichannel data streams, determination of data-driven alarm thresholds and investigation of the performance and robustness of the new tools. Due to a reasonably large database of faults, we can calculate frequencies of false and correct fault signals, and recommend implementations that optimize these empirical success rates.

bolted faults↗

Detection and attribution of climate extremes in the observed record

We present an overview of practices and challenges related to the detection and attribution of observed changes in climate extremes. Detection is the identification of a statistically significant change in the extreme values of a climate variable over some period of time. Issues in detection discussed include data quality, coverage, and completeness. Attribution takes that detection of a change and uses climate model simulations to evaluate whether a cause can be assigned to that change. Additionally, we discuss a newer field of attribution, event attribution, where individual extreme events are analyzed for the express purpose of assigning some measure of whether that event was directly influenced by anthropogenic forcing of the climate system.

54 ENVIRONMENTAL SCIENCES↗

Detecting inhomogeneities in the Twentieth Century Reanalysis over the central United States

The Twentieth Century Reanalysis (20CR), which spans the 138 year period from 1871 to 2008, was intended for a variety of climate applications, including long–term trend assessment. Because over land 20CR only assimilates surface pressure observations and their count increases by an order of magnitude over the course of the record, a key question is whether the 20CR is homogenous and hence suitable for detecting climate–related changes. We use three statistical methods (Pettitt and Bai–Perron tests and segmented regression) to detect abrupt shifts in multiple hydrometeorological variable mean and uncertainty fields over the central United States. For surface air temperature and precipitation, we use the Climate Research Unit (CRU) time series data set for comparison. We find that for warm–season months, there is a consensus change point among all variables between 1940 and 1950, which is not substantiated by the CRU record. While we cannot say with certainty that these shifts in the 20CR analysis fields are artificial, our statistical analyses, coupled with a visual inspection of the underlying assimilated observational count time series, strongly point to this conclusion. Furthermore, our recommendation is therefore for users to restrict climate trend applications over the central United States to the second half century of the 20CR record, after observational density has stabilized.

54 ENVIRONMENTAL SCIENCES↗

Benchmark Tracking System for Performance Monitoring

Benchmarking is essential for high-performance software development, particularly for monitoring performance across code iterations. This project focused on enhancing the benchmarking process for Lamellar, an asynchronous runtime for High-Performance Computing (HPC) systems developed at Pacific Northwest National Laboratory. Prior to this work, benchmark results were difficult to track and compare across code versions, presenting significant challenges in identifying performance regressions and long-term trends. The primary objective was to establish a systematic, reproducible approach for measuring performance and detecting regressions following code commits. Our methodology involved three key components: standardizing benchmark outputs, implementing data versioning, and developing analysis tools. We standardized the benchmark output format to JSON Line records containing specific fields (execution time, hardware specifications, and environmental variables). To address data management challenges, we evaluated several options and eventually chose a git repository dedicated to benchmark data. We developed a suite of Python tools that processed benchmark results, enriched them with metadata, and facilitated search in the repository. The resulting system enables more efficient filtering and comparison of performance metrics across commit histories, hardware configurations, and benchmark variants through a unified query interface. Our implementation reduces computational overhead by first checking for existing results through configuration matching before initiating new benchmark runs, thereby conserving resources. The system has been validated by Lamellar developers. It organizes results by benchmark type and build configurations for efficient retrieval. Future developments include a planned Large Language Model interface for predicting benchmark performance, incorporating the criterion package for statistical analysis, which will enable automated detection of statistically significant performance changes, and integration with continuous integration pipelines. Despite these enhancements being reserved for future work, this project has successfully provided the Lamellar development team with a framework for maintaining consistent performance standards and identifying optimization opportunities across workloads and hardware environments.

97 MATHEMATICS AND COMPUTING↗