Search NASA⌕ Search

SEARCH · Search NASA

Results for “Anomaly Classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Open-source FPGA-ML codesign for the MLPerf Tiny Benchmark

We present our development experience and recent results for the MLPerf Tiny Inference Benchmark on field-programmable gate array (FPGA) platforms. We use the open-source hls4ml and FINN workflows, which aim to democratize AI-hardware codesign of optimized neural networks on FPGAs. We present the design and implementation process for the keyword spotting, anomaly detection, and image classification benchmark tasks. The resulting hardware implementations are quantized, configurable, spatial dataflow architectures tailored for speed and efficiency and introduce new generic optimizations and common workflows developed as a part of this work. The full workflow is presented from quantization-aware training to FPGA implementation. The solutions are deployed on system-on-chip (Pynq-Z2) and pure FPGA (Arty A7-100T) platforms. The resulting submissions achieve latencies as low as 20 $\mu$s and energy consumption as low as 30 $\mu$J per inference. We demonstrate how emerging ML benchmarks on heterogeneous hardware platforms can catalyze collaboration and the development of new techniques and more accessible tools.

Borras, Hendrik↗

Detecting anomalous packets in network transfers: investigations using PCA, autoencoder and isolation forest in TCP

Large-scale scientific workflows rely heavily on high-performance file transfers. These transfers require strict quality parameters such as guaranteed bandwidth, no packet loss or data duplication. To have successful file transfers, methods such as predetermined thresholds and statistical analysis need to be done to determine abnormal patterns. Network administrators routinely monitor and analyze network data for diagnosing and alleviating these, making decisions based on their experience. However, as networks grow and become complex, monitoring large data files and quickly processing them, makes it improbable to identify errors and rectify these. Abnormal file transfers have been classified by simply setting alert thresholds, via tools such as PerfSonar and TCP statistics (Tstat). This paper investigates the feasibility of unsupervised feature extraction methods for identifying network anomaly patterns with three unsupervised classification methods—principal component analysis, autoencoder and isolation forest. Here, we collect file transfer statistics from two experiment sets—synthetic iPerf generated traffic and 1000 Genome workflow runs, with synthetically introduced anomalies. Our results show that while PCA and a simple autoencoder finds it difficult to detect clusters, the tree-variant isolation forest is able to identify anomalous packets by breaking down TCP traces into tree classes early.

97 MATHEMATICS AND COMPUTING↗

Active Learning for Anomaly Detection in Environmental data

Due to the growing amount of data from in-situ sensors in environmental monitoring, it becomes necessary to automatically detect anomalous data points. Nowadays, this is mainly performed using supervised machine learning models, which need a fully labelled data set for their training process. However, the process of labelling data is typically cumbersome and, as a result, a hindrance to the adoption of machine learning methods for automated anomaly detection. In this work, we propose to address this challenge by means of active learning. This method consists of querying the domain expert for the labels of only a selected subset of the full data set. We show that this reduces the time and costs associated to labelling while delivering the same or similar anomaly detection performances. Finally, we also show that machine learning models providing a nonlinear classification boundary are to be recommended for anomaly detection in complex environmental data sets.

54 ENVIRONMENTAL SCIENCES↗

Deep learning model to detect various synchrophasor data anomalies

High-density synchrophasors provide valuable information for power grid situational awareness, operation and control. Unfortunately, due to factors including communication instability and hardware failure, their data quality can be greatly deteriorated by anomalies. Since the anomalies can impact the performance of the synchrophasor applications, it is of paramount significance to propose a model to detect anomalies in synchrophasor. In this study, a convolutional neural network model is established to detect and classify the anomalies in the synchrophasor measurements. Additionally, four types of anomalies observed in actual synchrophasors including erroneous patterns, random spikes, missing points and high-frequency interferences are considered in this study. The proposed model is extensively evaluated via field-collected measurements from the synchrophasor network in Jiangsu grid, China. The superior performance of the proposed model indicates the great potential of using deep learning for the detection of abnormal synchrophasor measurements.

42 ENGINEERING↗

Machine processing of remotely sensed data; Proceedings of the Conference, Purdue University, West Lafayette, Ind., October 16-18, 1973

Topics discussed include the management and processing of earth resources information, special-purpose processors for the machine processing of remotely sensed data, digital image registration by a mathematical programming technique, the use of remote-sensor data in land classification (in particular, the use of ERTS-1 multispectral scanning data), the use of remote-sensor data in geometrical transformations and mapping, earth resource measurement with the aid of ERTS-1 multispectral scanning data, the use of remote-sensor data in the classification of turbidity levels in coastal zones and in the identification of ecological anomalies, the problem of feature selection and the classification of objects in multispectral images, the estimation of proportions of certain categories of objects, and a number of special systems and techniques. Individual items are announced in this issue.

Source record↗

Utility of correlation techniques in gravity and magnetic interpretation

Internal correspondence uses Poisson's Theorem in a moving-window linear regression analysis between the anomalous first vertical derivative of gravity and total magnetic field reduced to the pole. The regression parameters provide critical information on source characteristics. The correlation coefficient indicates the strength of the relation between magnetics and gravity. Slope value gives delta j/delta sigma estimates of the anomalous source. The intercept furnishes information on anomaly interference. Cluster analysis consists of the classification of subsets of data into groups of similarity based on correlation of selected characteristics of the anomalies. Model studies are used to illustrate implementation and interpretation procedures of these methods, particularly internal correspondence. Analysis of the results of applying these methods to data from the midcontinent and a transcontinental profile shows they can be useful in identifying crustal provinces, providing information on horizontal and vertical variations of physical properties over province size zones, validating long wavelength anomalies, and isolating geomagnetic field removal problems.

Chandler, V. W.↗

Automated anomaly detection for Orbiter High Temperature Reusable Surface Insulation

The description, analysis, and experimental results of a method for identifying possible defects on High Temperature Reusable Surface Insulation (HRSI) of the Orbiter Thermal Protection System (TPS) is presented. Currently, a visual postflight inspection of Orbiter TPS is conducted to detect and classify defects as part of the Orbiter maintenance flow. The objective of the method is to automate the detection of defects by identifying anomalies between preflight and postflight images of TPS components. The initial version is intended to detect and label gross (greater than 0.1 inches in the smallest dimension) anomalies on HRSI components for subsequent classification by a human inspector. The approach is a modified Golden Template technique where the preflight image of a tile serves as the template against which the postflight image of the tile is compared. Candidate anomalies are selected as a result of the comparison and processed to identify true anomalies. The processing methods are developed and discussed, and the results of testing on actual and simulated tile images are presented. Solutions to the problems of brightness and spatial normalization, timely execution, and minimization of false positives are also discussed.

Cooper, Eric G.↗

On 2-group global symmetries and their anomalies

In general quantum field theories (QFTs), ordinary (0-form) global symmetries and 1-form symmetries can combine into 2-group global symmetries. We describe this phenomenon in detail using the language of symmetry defects. We exhibit a simple procedure to determine the (possible) 2-group global symmetry of a given QFT, and provide a classification of the related ’t Hooft anomalies (for symmetries not acting on spacetime). We also describe how QFTs can be coupled to extrinsic backgrounds for symmetry groups that differ from the intrinsic symmetry acting faithfully on the theory. Finally, we provide a variety of examples, ranging from TQFTs (gapped systems) to gapless QFTs. Along the way, we stress that the “obstruction to symmetry fractionalization” discussed in some condensed matter literature is really an instance of 2-group global symmetry.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Comparison of Supervised and Un-Supervised Machine Learning Algorithms for Threat Detection and Scintillator Performance for Radiation Portal Monitoring

Following the events of September 11, 2001, international border crossing have been equipped with radiation portal monitors (RPMs) to identify illicit radioactive material. Polyvinyl toluene (PVT) scintillators are commonly used due to their low cost and reasonable maintainability, however they offer low spectral resolution. Despite the fact that over twenty years has transpired since this event, radioisotopes are still typically identified by hand-crafted classification algorithms, e.g., total counts or energy windowing, and exhibit relatively poor performance in detecting threats at the low false alarm rates required to support the stream of commerce. While some improvement to performance has been realized via the use of supervised machine learning, these classification algorithms typically utilize simulations in lieu of real data due to the sparsity of data for one or more classes. Accordingly, the performance of these algorithms is somewhat less than optimal when examining experiments or simulations with model mismatch. Consequently, in this work, we examine the application of a number of unsupervised machine learning, anomaly detection based algorithms, to circumvent the inverse crime when analyzing spectroscopy data for RPMs. We also compare anomaly detection results with those obtained via the use of supervised classification detection ML algorithms when model mismatch is introduced between the simulated threat items utilized for training/testing. Finally, we compared the performance of the PVT scintillators to those obtained with higher resolution detectors using both anomaly detection and supervised classification algorithms.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Weakly supervised anomaly detection in the Milky Way

ABSTRACT Large-scale astrophysics data sets present an opportunity for new machine learning techniques to identify regions of interest that might otherwise be overlooked by traditional searches. To this end, we demonstrate how Classification Without Labels (CWoLa), a weakly supervised anomaly detection method, can help identify cold stellar streams within the more than one billion Milky Way stars observed by the Gaia satellite. CWoLa operates without the use of labelled streams or knowledge of astrophysical principles. Instead, it uses a classifier to distinguish between mixed samples for which the proportions of signal and background samples are unknown. As a proof of concept, we demonstrate that this computationally lightweight strategy is able to detect both simulated streams and the known stream GD-1 in data. Originally designed for high-energy collider physics, this technique may have broad applicability within astrophysics as well as other domains interested in identifying localized anomalies.

79 ASTRONOMY AND ASTROPHYSICS↗

Remote sensing exploration for metallic mineral resources in central Baja California

Remote sensor data (primarily LANDSAT) was analyzed by photogeologic and computer-assisted enhancement techniques to evaluate the metallic mineral potential of Baja California. Overlays were prepared at 1:1,000,000 and 1:500,000 and included known geologic relationships and mineral occurrences, lineament, drainage and structural patterns, tonal anomalies, and enhancement results. Computer-assisted enhancement and classification of the test sites was performed using the IMAGE 100 system to identify subtle tonal anomalies thought related to mineralization using known sites as analysis guides. Mineral potential maps of Baja California were generated from these analyses and the ten highest priority targets visited. Preliminary assay results (atomic absorption analysis) for the samples recovered showed moderate to high geochemical anomalies for Copper (10 of 12 samples), Zinc (3 of 12 samples) and Lead (4 of 12 samples).

Baker, R. N.↗

Global Geochemical Variation on the Lunar Surface: A Three-Element Approach

We present a method for displaying the relative abundances of three important elements (Th, Fe, and Ti) on the same map projection of the lunar surface. Using Th-, Fe-, and Ti-elemental abundances from orbital geochemical data and assigning each element a primary color, a false-color map of the lunar surface was created. This approach is similar to the ternary diagram approach presented by Davis and Spudis with some important differences, discussed later. For the present maps, Th abundances were measured by the Lunar Prospector (LP) Gamma-Ray Spectrometer(GRS).The new LPGRS low-altitude dataset was used in this analysis. Iron and Ti weight percentages were based on Clementine spectral reflectance data smoothed to the LP low altitude footprint. This method of presentation was designed to aid in the location and recognition of three principal lunar compositions: ferroan anorthosite (FAN), mare basalts (MB), and the Mg suite/ KREEP-rich rocks on the lunar surface, with special emphasis on the highlands and specific impact basins. In addition to the recognition of these endmember rock compositions, this method is an attempt to examine the relationship between elemental compositions that do not conform readily to previously accepted or observed endmember rocks in various specific regions of interest, including eastern highlands regions centered on 150 deg longitude, and a northern highlands Th-rich region observed. The LP low-altitude data has full width at half-maximum spatial resolution of about 40 km. The Clementine spectral reflectance datasets were adapted using an equal-area, gaussian smoothing routine to this footprint. In addition, these datasets, reported in weight percent of FeO and of Ti02, were adjusted to Fe and Ti weight percentages. Each dataset was then assigned one of the three primary colors: blue for Th, red for Fe, and green for Ti. For each element, the data range was normalized to represent the ratio of each point to the maximum in the dataset. (To view the color table, go to http://cass.jsc.nasa.gov/meetings/moon99/pdf/8033.pdf.) The full range of lunar longitudes is represented, but due to the lack of coverage of the Clementine data for latitudes > 70 deg and <-70 deg, the data for these regions is excluded. The differences between this approach and the ternary diagram approach of Davis and Spudis eliminate some of the uncertainty and ambiguity of the ternary diagram approach. Rather than using a ratio of Th to Ti normalized to CI chondritic ratios, and a ternary diagram with ternary apexes located at specific endmember compositional values, elemental compositions were used independently, eliminating the errors resulting from dividing numbers that can have high uncertainties, especially at low concentration. The three elements used in this method of presentation were chosen for several reasons. One reason for the inclusion of Th in this study is that it is an accurate indicator of KREEP. Iron and Ti concentrations are both low in highland regolith, causing any small fluctuations in Th to stand out very well. In addition, Fe and Ti are good compositional indicators of different mare basalts. Mixed with red for Fe, the green for Ti produces a yellow signal in high-Ti basalts. While universally high in Fe relative to the surrounding highlands, mare basalts have a diverse range of Ti values, making Ti concentration a valuable asset to the classification and identification of different basalt types. Finally, an important constraint in element selection is the availability of the global data, both from LP and Clementine results. Data for Th, Fe, and Ti are among the highest quality of existing lunar remote-sensing data. In addition, LP data for Fe and Ti will become available, enabling these data to be incorporated into the analysis. Using upper-limit values for end member rock compositions calculated from Korotev et al., attempts were made to locate the different endmember compositions of terranes on this diagram. Most strikingly, ferroan anorthosite (Th < and = 0.37 micro g/g; Fe (wt%)< and =2.29; Ti (wt%) < and = 0.22), which should appear as an almost black, reddish color, does not appear on the diagram at any noticeable frequency. Based on this analysis, the suggestion of extensive FAN regions on the lunar surface is not strong, especially at the presently accepted values for Fe and Th. However, to make sure this effect is not due to systematic errors, a thorough investigation of the precision, accuracy, and uncertainties of the Fe, Ti, and Th abundances needs to be carried out, especially at low concentrations. A particular region of interest is an area of high Th concentrations relative to Fe and Ti content north and east of Humboldtianum Crater. First observed by Lawrence et al., this region does not coincide with any visible impact structure and comprises one of the closest approximations to pure blue (high Th, very low Ti and Fe) on the lunar surface. Such an elemental composition does not lend itself readily to classification, and presents something of an anomaly. More detailed analysis of this region is needed to understand its structure and origin. There seems to be a longitudinal asymmetry in the Th concentrations of the highlands regolith. High-Th, low-Ti, and Fe regions are located between 135 deg and 180 deg longitude and between -30 deg and +30 deg latitude. While the Th levels are not high enough to attract attention in a single elemental display, the variation in the abundance of Th relative to Fe and Ti abundances can be clearly seen. The composition that these data suggest is not well represented in the sample return suite. In addition, these regions were largely missed by the Apollo orbital ground tracks, which only covered the outer edge of the areas of interest. The LP orbital Th data represent the first information about the Th concentrations in these regions of the highlands. Additional information contained in original.

Thomsen, D. R.↗

Data Mining and Machine Learning for Power System Monitoring, Understanding, and Impact Evaluation

This chapter presents results from the Big Data analysis framework to improve power system situational awareness and system reliability. For this purpose, a dataset with real-world phasor measurement unit data and historical transmission system outage data has been created and used to carry out the analysis. Several statistical analysis and machine learning methods have been developed and implemented for event and anomaly detection and modeling. Detection and analysis results for actual examples of power system events are presented. Finally, data-driven characterization and risk assessment methods for weather-related extremes in power systems are developed and demonstrated on the Bonneville Power Administration system. These applications demonstrate the capability of Machine Learning (ML) methods to monitor system abnormalities, to predict system events, and to characterize the impact of extreme events on power grid

data mining, power grid, machine learning, anomaly↗

Analysis of DSN software anomalies

A categorized data base of software errors which were discovered during the various stages of development and operational use of the Deep Space Network DSN/Mark 3 System was developed. A study team identified several existing error classification schemes (taxonomies), prepared a detailed annotated bibliography of the error taxonomy literature, and produced a new classification scheme which was tuned to the DSN anomaly reporting system and encapsulated the work of others. Based upon the DSN/RCI error taxonomy, error data on approximately 1000 reported DSN/Mark 3 anomalies were analyzed, interpreted and classified. Next, error data are summarized and histograms were produced highlighting key tendencies.

Galorath, D. D.↗

Time reversal, SU(N) Yang–Mills and cobordisms: Interacting topological superconductors/insulators and quantum spin liquids in 3+1D

We introduce a web of strongly correlated interacting 3+1D topological superconductors/insulators of 10 particular global symmetry groups of Cartan classes, realizable in electronic condensed matter systems, and their new SU(N) generalizations. The symmetries include SU(N), SU(2), U(1), fermion parity, time reversal and relate to each other through symmetry embeddings. We overview the lattice Hamiltonian formalism. We complete the list of field theories of bulk symmetry-protected topological invariants (SPT invariants/partition functions that exhibit boundary ’t Hooft anomalies) via cobordism calculations, matching their full classification. We also present explicit 4-manifolds that detect these SPTs. On the other hand, once we dynamically gauge part of their global symmetries, we arrive in various new phases of SU(N) Yang–Mills (YM) gauge theories, analogous to quantum spin liquids with emergent gauge fields. We discuss how coupling YM theories to time reversal-SPTs affects the strongly coupled theories at low energy. For example, we point out a possibility of having two deconfined gapless time-reversal symmetric SU(2) YM theories at θ=π as two distinct conformal field theories, which although are secretly indistinguishable by correlators of local operators on orientable spacetimes nor by gapped SPT states, can be distinguished on non-orientable spacetimes or potentially by correlators of extended operators.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Weather patterns and hydro-climatological precursors of extreme floods in Switzerland since 1868

The generation of 24 extreme floods in large catchments of the central Alps is analyzed from instrumental and documentary data, newly digitized observations of precipitation (DigiHom) and 20th Century Reanalysis (20CR) data. Extreme floods are determined by the 95th percentile of differences between an annual flood and a defined contemporary flood. For a selection of six events between 1868 and 1910, we describe preconditioning elements such as precipitation, temperature, and snow cover anomalies. Specific weather patterns are assessed through a subjective analysis of three-dimensional atmospheric circulation. A focus is placed on synoptic-scale features including mid-tropospheric ascent, low-level moisture transport, propagation of cyclones, and temperature anomalies. We propose a hydro-meteorological classification of all 24 investigated events according to flood-generating weather conditions. Key elements of the upper-level synoptic-scale flow are summarized by five types: (i) pivoting cut-off lows, (ii) elongated cut-off lows, (iii) elongated troughs, (iv) waves (with a kink), and (v) approximately zonal flow over the Alpine region. We found that the most extreme floods (as above, but ≥ 98th percentile) in Switzerland since 1868 were caused by the interaction of severe hydro-climatologic conditions with a flood-inducing weather situation. The 20CR data provide plausible synoptic-scale meteorological patterns leading to heavy precipitation. The proposed catalogue of weather patterns and hydro-climatologic precursors can give direction when anticipating the possibility of severe floods in the Alpine region.

Meteorology & Atmospheric Sciences↗

Opportunities for space surveys of moisture anomalies

Review of a combination of infrared scanning, unsupervised spectroscopic classification, change detection, and perturbation spectroscopy for monitoring anomalous moisture exchange from space. Infrared sensors have been developed which can monitor the solar reflectance from droplet distributions in vegetation and clouds, the absorption of thermal radiation by water vapor, and the microwave attenuation by atmospheric water. Unsupervised spectroscopic classification techniques are emerging which have the potential to subdivide strip maps from infrared scanners into different moisture targets. Intersecting and parallel spacecraft orbits provide opportunities to study the change of recognized targets between two scans and to recognize anomalous moisture exchange from those changes which significantly exceed the statistical uncertainty of the spectroscopic target signature. The new concept of perturbation spectroscopy shows a potential to quantitatively determine the change of integrated water vapor pressure with a minimum of 'atmospheric truth' and with low spectroscopic resolution that is typical of simple interference filters.

Krause, F. R.↗