Search NASA⌕ Search

SEARCH · Search NASA

Results for “Anomaly Classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Resonant anomaly detection with multiple reference datasets

An important class of techniques for resonant anomaly detection in high energy physics builds models that can distinguish between reference and target datasets, where only the latter has appreciable signal. Such techniques, including Classification Without Labels (CWoLa) and Simulation Assisted Likelihood-free Anomaly Detection (SALAD) rely on a single reference dataset. They cannot take advantage of commonly available multiple datasets and thus cannot fully exploit available information. In this work, we propose generalizations of CWoLa and SALAD for settings where multiple reference datasets are available, building on weak supervision techniques. We demonstrate improved performance in a number of settings with realistic and synthetic data. As an added benefit, our generalizations enable us to provide finite-sample guarantees, improving on existing asymptotic analyses.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Robust Spectral Anomaly Detection in EELS Spectral Images via 3D Convolutional Variational Autoencoders

Abstract A 3D Convolutional Variational Autoencoder (3D‐CVAE) is introduced for automated anomaly detection in electron energy‐loss spectroscopy spectrum imaging (EELS‐SI) data. This approach leverages the full 3D structure of EELS‐SI data to detect subtle spectral anomalies while preserving both spatial and spectral correlations across the datacube. By employing cross‐entropy loss and training on bulk spectra, the model learns to reconstruct bulk features characteristic of the defect‐free material. In exploring methods for anomaly detection, both the 3D‐CVAE approach and principal component analysis (PCA) are evaluated, testing their performance using FeL‐edge ΔEpeak shifts designed to simulate material defects. These results show that 3D‐CVAE achieves superior anomaly detection and maintains consistent performance across various shift magnitudes. The method demonstrates clear bimodal separation between bulk and anomalous spectra, enabling reliable classification. Further analysis verifies that lower‐dimensional representations are robust to anomalies in the data. While performance advantages over PCA diminish with decreasing anomaly concentration, our method maintains high reconstruction quality even in challenging, noise‐dominated spectral regions. This approach provides a robust framework for unsupervised automated detection of spectral anomalies in EELS‐SI data, particularly valuable for analyzing complex material systems.

Chemistry↗

Coincident learning for unsupervised anomaly detection of scientific instruments

Abstract Anomaly detection is an important task for complex scientific experiments and other complex systems (e.g. industrial facilities, manufacturing), where failures in a sub-system can lead to lost data, poor performance, or even damage to components. While scientific facilities generate a wealth of data, labeled anomalies may be rare (or even nonexistent), and expensive to acquire. Unsupervised approaches are therefore common and typically search for anomalies either by distance or density of examples in the input feature space (or some associated low-dimensional representation). This paper presents a novel approach called coincident learning for anomaly detection (CoAD), which is specifically designed for multi-modal tasks and identifies anomalies based on coincident behavior across two different slices of the feature space. We define an unsupervised metric, F ^ β , out of analogy to the supervised classification F β statistic. CoAD uses F ^ β to train an anomaly detection algorithm on unlabeled data , based on the expectation that anomalous behavior in one feature slice is coincident with anomalous behavior in the other. The method is illustrated using a synthetic outlier data set and a MNIST-based image data set, and is compared to prior state-of-the-art on two real-world tasks: a metal milling data set and our motivating task of identifying RF station anomalies in a particle accelerator.

43 PARTICLE ACCELERATORS↗

Detection of anomalous events

A system is described for receiving a stream of events and scoring the events based on anomalousness and maliciousness (or other classification). The system can include a plurality of anomaly detectors that together implement an algorithm to identify low-probability events and detect atypical traffic patterns. The anomaly detector provides for comparability of disparate sources of data (e.g., network flow data and firewall logs.) Additionally, the anomaly detector allows for regulatability, meaning that the algorithm can be user configurable to adjust a number of false alerts. The anomaly detector can be used for a variety of probability density functions, including normal Gaussian distributions, irregular distributions, as well as functions associated with continuous or discrete variables.

97 MATHEMATICS AND COMPUTING↗

Wasserstein normalized autoencoder for anomaly detection

A novel anomaly detection algorithm is presented. The Wasserstein normalized autoencoder (WNAE) is a normalized probabilistic model that minimizes the Wasserstein distance between the learned probability distribution—a Boltzmann distribution where the energy is the reconstruction error of the autoencoder (AE)—and the distribution of the training data. This algorithm has been developed and applied to the identification of semivisible jets—conical sprays of visible standard model (SM) particles and invisible dark matter states—with the CMS experiment at the CERN LHC. Trained on jets of particles from simulated SM processes, the WNAE is shown to learn the probability distribution of the input data in a fully unsupervised fashion, such that it effectively identifies new physics jets as anomalies. The model exhibits stable, convergent training and recovers strong classification performance for a wide range of signals against the selected background process, for which a standard AE fails because of outlier reconstruction. In addition, the model improves upon standard normalized autoencoders while remaining fully agnostic to the signal. The WNAE directly tackles the problem of outlier reconstruction, a common failure mode of autoencoders in anomaly detection tasks.

Hayrapetyan, Aram [Yerevan Phys. Inst.]↗

Anomaly Detection and Mitigation for Dynamic Frequency Regulation in Hydropower-Battery Systems

Hydropower operators and energy storage providers are increasingly interested in participating in frequency regulation services, driven by the incentives offered by independent system operators, such as the PJM Interconnection. This transition, however, unfolds against the backdrop of a modernizing and rapidly digitizing power grid, exposing the integrated legacy infrastructure to a multitude of cybersecurity threats. This work presents an approach for developing an anomaly detection and mitigation system to address cybersecurity challenges during the participation of a hydropower-integrated battery energy storage system (BESS) in a frequency regulation market. The applied anomaly detector utilizes machine learning algorithms to provide detailed classification of cyber-physical events. Later, the applied mitigation system triggers predefined corrective actions to minimize the impact of data integrity attacks on the regulation market and system stability. We evaluated the proposed approach on a hydropower-integrated BESS topology, specifically analyzing the slow regulation signal (Reg A) coming from the PJM market. Our simulation results demonstrate that the proposed approach performs well in detecting data integrity attacks within the allocated time frame and also minimizes the system's transient instability during the participation of hydropower and BESS in the regulation market.

battery energy storage system↗

Anomaly Detection and Mitigation for Dynamic Frequency Regulation in Hydropower-Battery Systems: Preprint

Hydropower operators and energy storage providers are increasingly interested in participating in frequency regulation services, driven by the incentives offered by independent system operators, such as the Pennsylvania-New Jersey-Maryland Interconnection (PJM), in a competitive electricity market. This transition, however, unfolds against the backdrop of a modernizing and rapidly digitizing power grid, exposing the integrated legacy infrastructure and vulnerable communication networks to a multitude of cybersecurity threats. These evolving threats not only endanger grid operations but also have the potential to trigger cascading disruptions across the broader grid network and influence regulation markets. This work presents an approach for developing an anomaly detection and mitigation system to address cybersecurity challenges during the participation of a hydropower-integrated battery energy storage system (BESS) in a frequency regulation market. The applied anomaly detector utilizes machine learning algorithms to provide detailed classification of cyber-physical events and provide a comprehensive situation awareness to grid operators. Later, the applied mitigation system triggers predefined corrective actions to minimize the impact of data integrity attacks on the regulation market and system stability. We evaluated the proposed approach on a fully active BESS topology using the slow regulation signal (Reg A) coming from the PJM market. Our simulation results reveal that the proposed approach performs well in detecting data integrity attacks within the allocated time frame and also minimizes the system's instability and economic loss during the participation of hydropower and BESS in the regulation market.

battery energy storage system↗

Technical Performance and Cost Optimization of Unobtrusive Multi-static Serial LiDAR Imager (UMSLI) for Wide-area Surveillance and Identification of Marine Life at Marine Energy Installations

Florida Atlantic University developed an underwater optical monitoring system prototype - Unobtrusive Multi-static Serial LiDAR Imager (UMSLI) - suitable for marine energy full project lifecycle observation (baseline, commissioning, and decommissioning), with an automated real-time classification of marine animals. With precursor 2014 DOE funding (award DE-EE0006787), a prototype UMSLI was demonstrated in a controlled laboratory environment and achieved a TRL 6. This EERE DE-EE0007828 award aimed to both increase the TRL of the UMSLI by improving the technology performance (e.g., increase distance of marine animal target detection capability, add additional species classification capabilities, improve the system performance during the day, etc.) and reduce the cost. The UMSLI presents a novel application of underwater distributed Light Detection And Ranging (LiDAR), an advanced remote sensing method that uses light in the form of laser pulses for an application, this paired with an algorithm provides 360 degrees underwater detection, imaging, and classification of marine life. This solution for underwater monitoring of biota preserves the advantages of traditional optical and acoustic solutions while overcoming many associated disadvantages for marine energy site environmental monitoring, such as difficulties in species detection and classification in low light or night and turbid environments. This new approach is a purposefully designed, reconfigurable adaptation of an existing class 3B laser technology into one UMSLI instrument that can be easily mounted on or around different classes of marine energy equipment, such as devices to capture ocean current energy or wave energy. The system uses relatively low average power, utilizes far-red (> 635nm) laser illumination to be invisible and eye-safe to marine animals, is compact, and cost-effective. The equipment is designed for long-term, maintenance-free operations (i.e., current design is targeting more than 7 days continuous operation), to inherently generate a sparse primary dataset that only includes detected anomalies, and to allow robust real-time automated animal classification and identification with a low data bandwidth requirement. The technology’s overarching goal for application, is a system that can be deployed to collect pre-installation baseline species observations at a proposed marine energy deployment site with minimal post-processing overhead. The envisioned system will also produce high-resolution imagery of marine animals through a wide range of conditions and support automated tracking and notification of the presence of managed animals within established perimeters of marine energy equipment to satisfy deployed marine energy projects’ endangered and threatened species monitoring requirements. Through the current project, we demonstrated the UMSLI prototype in an operational environment and increased the UMSLI’s Technology Readiness Level from 6 to 7. The project resulted in many novel technologies, including: 1) an eye-safe red laser based, low-cost LiDAR system that can detect targets up to 10 meters distance; 2) the GAN-based machine learning underwater LiDAR image enhancement technique (this is the first known application of GAN technique in underwater LiDAR); 3) LiDAR-based real-time automated detection capabilities; and 4) a template matching based automated classification tool. These technologies build a solid foundation for future efforts to develop an extended range electro-optical monitoring system suitable for marine energy deployments. In addition to technology development, a key lesson learned is that addressing regulatory and safety requirements must be front and center in any marine energy monitoring applications.

16 TIDAL AND WAVE POWER↗

Concept for Inclusion of Analytical and Computational Capability in Optical Plume Anomaly Detection (OPAD) for Measurement of Neutron Flux

Researchers are working on many konts to make possible high speed, automated classification and quantification of constituent materials in numerous environments. NASA's Marshall Space Flight Center has implemented a system for rocket engine flow fields/plumes; the Optical Plume Anomaly Detection (OPAD) system was designed to utilize emission and absorption spectroscopy for monitoring molecular and atomic particulates in gas plasma. An accompanying suite of tools and analytical package designed to utilize information collected by OPAD is known as the Engine Diagnostic Filtering System (EDIFIS). The current combination of these systems identifies atomic and molecular species and quantifies mass loss rates in H2/O2 rocket plumes. Additionally, efforts are being advanced to hardware encode components of the EDIFIS in order to address real-time operational requirements for health monitoring and management. This paper addresses the OPAD with its tool suite, and discusses what is considered a natural progression: a concept for migrating OPAD towards detection of high energy particles, including neutrons and gamma rays. The integration of these tools and capabilities will provide NASA with a systematic approach to monitor space vehicle internal and external environment.

Patrick, M. Clinton↗

Concept for Inclusion of Analytical and Computational Capability in Optical Plume Anomaly Detection (OPAD) for Measurement of Neutron Flux

Researchers are working on many fronts to make possible high-speed, automated classification and quantification of constituent materials in numerous environments. NASA's Marshall Space Flight Center has implemented a system for rocket engine flowfields/plumes. The Optical Plume Anomaly Detector (OPAD) system was designed to utilize emission and absorption spectroscopy for monitoring molecular and atomic particulates in gas plasma. An accompanying suite of tools and analytical package designed to utilize information collected by OPAD is known as the Engine Diagnostic Filtering System (EDiFiS). The current combination of these systems identifies atomic and molecular species and quantifies mass loss rates in H2/O2 rocket plumes. Capabilities for real-time processing are being advanced on several fronts, including an effort to hardware encode components of the EDiFiS for health monitoring and management. This paper addresses the OPAD with its tool suites, and discusses what is considered a natural progression: a concept for taking OPAD to the next logical level of high energy physics, incorporating fermion and boson particle analyses in measurement of neutron flux.

Patrick, Marshall Clint↗

Multi-Class Anomaly Detection in Flight Data using Semi-Supervised Explainable Deep Learning Model

Identifying precursor for safety incidents in aviation data is a crucial task, yet extremely challenging. The main approach, in practice, leverages domain expertise to define expected tolerances in system’s behavior and alarm exceedance from such safety margins. However, this approach is incapable of identifying unknown risk and vulnerabilities. Machine learning has been long studied and deployed to identify precursors for such anomalies, with the great challenge of the need for sufficient labelled set of data to achieve a reliable and accurate performance. In this article, we develop an explainable deep semi-supervised model for anomaly detection in aviation, building upon recent advancements in the machine learning literature. The proposed model combines feature engineering and classification in the feature space, while leveraging all available data (labelled and unlabeled). Validating on two case studies of anomaly detection in take-off and landing phases of commercial aircraft, we show that our model is able to outperform state-of-the-art supervised anomaly detection model and reach significantly high accuracy and low false alarm with minimum amount of available labelled data.

Anomaly Detection↗

Spectral classification of B stars in the ultraviolet

A set of criteria developed for the classification of B stars from ultraviolet spectra alone, using MK standards drawn from the optical region is described. The observational material consists of 100 archival high dispersion spectra obtained by the SWP (Short Wavelength Prime) camera on the IUE (International Ultraviolet Explorer) spacecraft. Only photospheric absorption lines are used as classification criteria. The C IV, SI IV and N V lines, which in early B stars originate in the stellar wind, are not used in the two dimensional spectra type luminosity classification, but the appearance of these lines is compared with the standard stars, and some anomalies noted. On the whole, the ultraviolet spectral types are very consistent with the optical MK types, implying that it is possible to do a two dimensional spectral classification in the ultraviolet without any knowledge of the optical spectrum.

Rountree, Janet↗

A New Approach to Multivariate Network Traffic Analysis

© 2019, Springer Science+Business Media, LLC & Science Press, China. Network traffic analysis is one of the core functions in network monitoring for effective network operations and management. While online traffic analysis has been widely studied, it is still intensively challenging due to several reasons. One of the primary challenges is the heavy volume of traffic to analyze within a finite amount of time due to the increasing network bandwidth. Another important challenge for effective traffic analysis is to support multivariate functions of traffic variables to help administrators identify unexpected network events intuitively. To this end, we propose a new approach with the multivariate analysis that offers a high-level summary of the online network traffic. With this approach, the current state of the network will display patterns compiled from a set of traffic variables, and the detection problems in network monitoring (e.g., change detection and anomaly detection) can be reduced to a pattern identification and classification problem. In this paper, we introduce our preliminary work with clustered patterns for online, multivariate network traffic analysis with the challenges and limitations we observed. We then present a grid-based model that is designed to overcome the limitations of the clustered pattern-based technique. We will discuss the potential of the new model with respect to the technical challenges including streaming-based computation and robustness to outliers.

Kim, Jinoh↗

A Weyl Fermion semimetal with surface Fermi arcs in the transition metal monopnictide TaAs class

Weyl fermions are massless chiral fermions that play an important role in quantum field theory but have never been observed as fundamental particles. A Weyl semimetal is an unusual crystal that hosts Weyl fermions as quasiparticle excitations and features Fermi arcs on its surface. Such a semimetal not only provides a condensed matter realization of the anomalies in quantum field theories but also demonstrates the topological classification beyond the gapped topological insulators. Here, we identify a topological Weyl semimetal state in the transition metal monopnictide materials class. Our first-principles calculations on TaAs reveal its bulk Weyl fermion cones and surface Fermi arcs. Our results show that in the TaAs-type materials the Weyl semimetal state does not depend on fine-tuning of chemical composition or magnetic order, which opens the door for the experimental realization of Weyl semimetals and Fermi arc surface states in real materials.

Science & Technology - Other Topics↗

Advances in Bayesian Model Based Clustering Using Particle Learning

Recent work by Carvalho, Johannes, Lopes and Polson and Carvalho, Lopes, Polson and Taddy introduced a sequential Monte Carlo (SMC) alternative to traditional iterative Monte Carlo strategies (e.g. MCMC and EM) for Bayesian inference for a large class of dynamic models. The basis of SMC techniques involves representing the underlying inference problem as one of state space estimation, thus giving way to inference via particle filtering. The key insight of Carvalho et al was to construct the sequence of filtering distributions so as to make use of the posterior predictive distribution of the observable, a distribution usually only accessible in certain Bayesian settings. Access to this distribution allows a reversal of the usual propagate and resample steps characteristic of many SMC methods, thereby alleviating to a large extent many problems associated with particle degeneration. Furthermore, Carvalho et al point out that for many conjugate models the posterior distribution of the static variables can be parametrized in terms of [recursively defined] sufficient statistics of the previously observed data. For models where such sufficient statistics exist, particle learning as it is being called, is especially well suited for the analysis of streaming data do to the relative invariance of its algorithmic complexity with the number of data observations. Through a particle learning approach, a statistical model can be fit to data as the data is arriving, allowing at any instant during the observation process direct quantification of uncertainty surrounding underlying model parameters. Here we describe the use of a particle learning approach for fitting a standard Bayesian semiparametric mixture model as described in Carvalho, Lopes, Polson and Taddy. In Section 2 we briefly review the previously presented particle learning algorithm for the case of a Dirichlet process mixture of multivariate normals. In Section 3 we describe several novel extensions to the original implementation of Carvalho et al that allow us to retain the computational advantages of particle learning while improving the suitability of the methodology to the analysis of streaming data and simultaneously facilitating the real time discovery of latent cluster structures. Section 4 demonstrates our methodological enhancements in the context of several simulated and classical data sets, showcasing the use of particle learning methods for online anomaly detection, label generation, drift detection, and semi-supervised classification, none of which would be achievable through a standard MCMC approach. Section 5 concludes with a discussion of future directions for research.

99 GENERAL AND MISCELLANEOUS↗

Spaceborne microwave remote sensing of seasonal freeze-thaw processes in theterrestrial high l atitudes : relationships with land-atmosphere CO2 exchange

Landscape transitions between seasonally frozen and thawed conditions occur each year over roughly 50 million square kilometers of Earth's Northern Hemisphere. These relatively abrupt transitions represent the closest analog to a biospheric and hydrologic on/off switch existing in nature, affecting surface meteorological conditions, ecological trace gas dynamics, energy exchange and hydrologic activity profoundly. We utilize time series satellite-borne microwave remote sensing measurements from the Special Sensor Microwave Imager (SSM/I) to examine spatial and temporal variability in seasonal freeze/thaw cycles for the pan-Arctic basin and Alaska. Regional measurements of spring thaw timing are derived using daily brightness temperature measurements from the 19 GHz, horizontally polarized channel, separately for overpasses with 6 AM and 6 PM equatorial crossing times. Spatial and temporal patterns in regional freeze/thaw dynamics show distinct differences between North America and Eurasia, and boreal forest and Arctic tundra biomes. Annual anomalies in the timing of thawing in spring also correspond closely to seasonal atmospheric CO2 concentration anomalies derived from NOAA CMDL arctic and subarctic monitoring stations. Classification differences between AM and PM overpass data average approximately 5 days for the region, though both appear to be effective surrogates for monitoring annual growing seasons at high latitudes.

Sensor Microwave Imager (SSM/I)carbon cycle↗

Spaceborne Microwave Remote Sensing of Seasonal Freeze-Thaw Processes in the Terrestrial High Latitudes: Relationships with Land-Atmosphere CO2 exchange

Landscape transitions between seasonally frozen and thawed conditions occur each year over roughly 50 million square kilometers of Earth's Northern Hemisphere. These relatively abrupt transitions represent the closest analog to a biospheric and hydrologic on/off switch existing in nature, affecting surface meteorological conditions, ecological trace gas dynamics, energy exchange and hydrologic activity profoundly. We utilize time series satellite-borne microwave remote sensing measurements from the Special Sensor Microwave Imager (SSM/I) to examine spatial and temporal variability in seasonal freeze/thaw cycles for the pan-Arctic basin and Alaska. Regional measurements of spring thaw timing are derived using daily brightness temperature measurements from the 19 GHz, horizontally polarized channel, separately for overpasses with 6 AM and 6 PM equatorial crossing times. Spatial and temporal patterns in regional freeze/thaw dynamics show distinct differences between North America and Eurasia, and boreal forest and Arctic tundra biomes. Annual anomalies in the timing of thawing in spring also correspond closely to seasonal atmospheric CO2 concentration anomalies derived from NOAA CMDL arctic and subarctic monitoring stations. Classification differences between AM and PM overpass data average approximately 5 days for the region, though both appear to be effective surrogates for monitoring annual growing seasons at high latitudes.

net primary products↗