Search NASA⌕ Search

SEARCH · Search NASA

Results for “outlier detection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Unique & challenging aspects of plutonium metal standards exchange program for actinide measurements

The Los Alamos National Laboratory exchange program is the only program of its kind for the distribution of plutonium (Pu) standards materials with a range of impurity contents to multiple laboratories for destructive measurements of elemental concentration. This paper discusses statistical methods used to address challenges in Pu metal exchange data by way of two case studies. Challenges include how to evaluate a data set when a large fraction of the values are minimum detection limits (MDLs), and how to determine potential outliers with limited in-formation on the true spread of the data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Apparatuses and methods for anomalous gas concentration detection

Embodiments of the disclosure are drawn to apparatuses and methods for anomalous gas concentration detection. A spectroscopic system, such as a wavelength modulated spectroscopy (WMS) system may measure gas concentrations in a target area. However, noise, such as speckle noise, may interfere with measuring relatively low concentrations of gas, and may lead to false positives. A noise model, which includes a contribution from a speckle noise model, may be used to process data from the spectroscopic system. An adaptive threshold may be applied based on an expected amount of noise. A speckle filter may remove measurements which are outliers based on a measurement of their noise. Plume detection may be used to determine a presence of gas plumes. Each of these processing steps may be associated with a confidence, which may be used to determine an overall confidence in the processed measurements/gas plumes.

Kreitinger, Aaron Thomas↗

Event-Based Anomaly Detection for Searches for New Physics

This paper discusses model-agnostic searches for new physics at the Large Hadron Collider using anomaly-detection techniques for the identification of event signatures that deviate from the Standard Model (SM). We investigate anomaly detection in the context of a machine-learning approach based on autoencoders. The analysis uses Monte Carlo simulations for the SM background and several selected exotic models. We also investigate the input space for the event-based anomaly detection and illustrate the shapes of invariant masses in the outlier region which will be used to perform searches for resonant phenomena beyond the SM. Challenges and conceptual limitations of this approach are discussed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Weak lensing magnification in the Dark Energy Survey Science Verification data

In this paper the effect of weak lensing magnification on galaxy number counts is studied by cross-correlating the positions of two galaxy samples, separated by redshift, using data from the Dark Energy Survey Science Verification dataset. The analysis is carried out for two photometrically-selected galaxy samples, with mean photometric redshifts in the $0.2 < z < 0.4$ and $0.7 < z < 1.0$ ranges, in the riz bands. A signal is detected with a $3.5\sigma$ significance level in each of the bands tested, and is compatible with the magnification predicted by the $\Lambda$CDM model. After an extensive analysis, it cannot be attributed to any known systematic effect. The detection of the magnification signal is robust to estimated uncertainties in the outlier rate of the pho- tometric redshifts, but this will be an important issue for use of photometric redshifts in magnification mesurements from larger samples. In addition to the detection of the magnification signal, a method to select the sample with the maximum signal-to-noise is proposed and validated with data.

79 ASTRONOMY AND ASTROPHYSICS↗

Autonomous anomaly detection of proliferation in the AGN-201 nuclear reactor digital twin

The expansion of global nuclear power necessitates advanced methods for analyzing proliferation indicators. This study introduces a novel application of the Isolation Forest Machine Learning (IFML) algorithm within a digital twin (DT) of the AGN-201 nuclear reactor to autonomously detect anomalies. Leveraging real-time operational data from the AGN-201 DT, the IFML algorithm identifies outliers without prior data labeling and operates as a lightweight, complementary approach to traditional physics-based anomaly detection methods for nuclear safeguards. In a simulated Red vs. Blue team exercise, the IFML algorithm successfully detected six significant unseen anomalies related to reactivity changes, achieving an accuracy of 99% for identifying operational deviationxs. These anomalies, caused by deliberate perturbations, were detected alongside known physics-based models, underscoring the potential of IFML to enhance real-time monitoring without displacing traditional methods. Further, this study highlights the applicability of IFML in nuclear environments by providing an additional, redundant layer of anomaly detection to improve safeguards and operational safety in complex systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Prescriptive provenance for streaming analysis of workflows at scale

Abstract- We extend our approach capturing and relating the provenance and performance metrics of computational workflows as a diagnostic tool for runtime optimization and placement. One important challenge is the volume of extracted data, both for performance metrics and provenance, even when specifying filters and focusing on quantities of interest in a simulation. We reduce this data by performing anomaly detection on streaming data and store provenance for the detected anomalies, an approach we call prescriptive provenance. This paper discusses the Chimbuko architecture enabling the approach. We present the use of a protein structure propagation workflow based on NWChemEx. We are testing algorithms for anomaly detection and present preliminary results here obtained with Local Outlier Factor. While scaling remains a challenge, these results show that our robust Chimbuko architecture for streaming analysis with prescriptive provenance is a promising approach.

97 MATHEMATICS AND COMPUTING↗

Data Mining for Anomaly Detection

The Vehicle Integrated Prognostics Reasoner (VIPR) program describes methods for enhanced diagnostics as well as a prognostic extension to current state of art Aircraft Diagnostic and Maintenance System (ADMS). VIPR introduced a new anomaly detection function for discovering previously undetected and undocumented situations, where there are clear deviations from nominal behavior. Once a baseline (nominal model of operations) is established, the detection and analysis is split between on-aircraft outlier generation and off-aircraft expert analysis to characterize and classify events that may not have been anticipated by individual system providers. Offline expert analysis is supported by data curation and data mining algorithms that can be applied in the contexts of supervised learning methods and unsupervised learning. In this report, we discuss efficient methods to implement the Kolmogorov complexity measure using compression algorithms, and run a systematic empirical analysis to determine the best compression measure. Our experiments established that the combination of the DZIP compression algorithm and CiDM distance measure provides the best results for capturing relevant properties of time series data encountered in aircraft operations. This combination was used as the basis for developing an unsupervised learning algorithm to define "nominal" flight segments using historical flight segments.

Biswas, Gautam↗

Wasserstein normalized autoencoder for anomaly detection

A novel anomaly detection algorithm is presented. The Wasserstein normalized autoencoder (WNAE) is a normalized probabilistic model that minimizes the Wasserstein distance between the learned probability distribution—a Boltzmann distribution where the energy is the reconstruction error of the autoencoder (AE)—and the distribution of the training data. This algorithm has been developed and applied to the identification of semivisible jets—conical sprays of visible standard model (SM) particles and invisible dark matter states—with the CMS experiment at the CERN LHC. Trained on jets of particles from simulated SM processes, the WNAE is shown to learn the probability distribution of the input data in a fully unsupervised fashion, such that it effectively identifies new physics jets as anomalies. The model exhibits stable, convergent training and recovers strong classification performance for a wide range of signals against the selected background process, for which a standard AE fails because of outlier reconstruction. In addition, the model improves upon standard normalized autoencoders while remaining fully agnostic to the signal. The WNAE directly tackles the problem of outlier reconstruction, a common failure mode of autoencoders in anomaly detection tasks.

Hayrapetyan, Aram [Yerevan Phys. Inst.]↗

THE WISE GAMMA-RAY STRIP PARAMETERIZATION: THE NATURE OF THE GAMMA-RAY ACTIVE GALACTIC NUCLEI OF UNCERTAIN TYPE

Despite the large number of discoveries made recently by Fermi, the origins of the so-called unidentified {gamma}-ray sources remain unknown. The large number of these sources suggests that there could be a population among them that significantly contributes to the isotropic gamma-ray background and it is therefore crucial to understand their nature. The first step toward a complete comprehension of the unidentified {gamma}-ray source population is to identify those that can be associated with blazars, the most numerous class of extragalactic sources in the {gamma}-ray sky. Recently, we discovered that blazars can be recognized and separated from other extragalactic sources using the infrared (IR) WISE satellite colors. The blazar population delineates a remarkable and distinctive region of the IR color-color space, the WISE blazar strip. In particular, the subregion delineated by the {gamma}-ray emitting blazars is even narrower and we named it the WISE Gamma-ray Strip (WGS). In this paper, we parameterize the WGS on the basis of a single parameter s that we then use to determine if {gamma}-ray active galactic nuclei of the uncertain type (AGUs) detected by Fermi are consistent with the WGS and can be considered blazar candidates. We find that 54 AGUs out of a set of 60 analyzed have IR colors consistent with the WGS; only 6 AGUs are outliers. This result implies that a very high percentage (i.e., in this sample about 90%) of the AGUs detected by Fermi are indeed blazar candidates.

79 ASTRONOMY AND ASTROPHYSICS↗

Unsupervised anomaly clustering via offset alignment in multivariate grid sensing data

Modern industries increasingly rely on multi-sensor technologies to acquire complex, high-dimensional data streams, enabling advanced monitoring and control systems. One critical application is online anomaly detection in electrical smart grids, where multivariate and multimodal sensing technologies play a vital role. However, detecting anomalies in such time-series data is challenging due to their inherent temporal dependencies and stochastic behavior. Traditional approaches based on supervised and semi-supervised learning methods depend on labeled datasets, which are often unavailable in real-world scenarios. While unsupervised methods have emerged as promising alternatives, these methods are highly susceptible to noise and outliers commonly present in sensing applications. Furthermore, deep learning-based anomaly detection methods, despite their performance, are often criticized for their black-box nature, limiting their applicability in safety-critical and online environments where interpretability and explainability are paramount. In this work, we propose an unsupervised anomaly clustering method leveraging a cyclic alignment-based offset detection algorithm for multivariate time-series signals. The proposed method is applied to multivariate data collected from vibrational, voltage, and magnetic field sensors deployed in a local grid substation. Our results demonstrate the robustness of the algorithm in accurately clustering various anomalies/events across different sensing modalities. Additionally, we compare the effectiveness of the proposed approach against a simple pattern-based anomaly detection method, which performs well for univariate data but fails to generalize to multivariate and multimodal time-series data.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗

Field intercomparison of ice nucleation measurements: the Fifth International Workshop on Ice Nucleation Phase 3 (FIN-03)

Abstract. The third phase of the Fifth International Ice Nucleation Workshop (FIN-03) was conducted at the Storm Peak Laboratory in Steamboat Springs, Colorado, in September 2015 to facilitate the intercomparison of instruments measuring ice-nucleating particles (INPs) in the field. Instruments included two online and four offline measurement systems for INPs, which are a subset of those utilized in the laboratory study that comprised the second phase of FIN (FIN-02). The composition of the total aerosols was characterized using the Particle Analysis by Laser Mass Spectrometry (PALMS) and Wideband Integrated Bioaerosol Sensor (WIBS) instruments, and aerosol size distributions were measured by a laser aerosol spectrometer (LAS). The dominant total particle compositions present during FIN-03 were composed of sulfates, organic compounds, and nitrates, as well as particles derived from biomass burning. Mineral-dust-containing particles were ubiquitous throughout and represented 67 % of supermicron particles. Total WIBS fluorescing particle concentrations for particles with diameters of > 0.5 µm were 0.04 ± 0.02 cm−3 (0.1 cm−3 highest; 0.02 cm−3 lowest), typical of the warm season in this region and representing ≈ 9 % of all particles in this size range as a campaign average. The primary focus of FIN-03 was the measurement of INP concentrations via immersion freezing at temperatures > −33 °C. Additionally, some measurements were made in the deposition nucleation regime at these same temperatures, representing one of the first efforts to include both mechanisms within a field campaign. INP concentrations via immersion freezing agreed within factors ranging from nearly 1 to 5 times on average between matched (time and temperature) measurements, and disagreements only rarely exceeded 1 order of magnitude for sampling times coordinated to within 3 h. Comparisons were restricted to temperatures lower than −15 °C due to the limits of detection related to sample volumes and very low INP concentrations. Outliers of up to 2 orders of magnitude occurred between −25 and −18 °C; a better agreement was seen at higher and lower temperatures. Although the 5–10 factor agreement of INP measurements found in FIN-03 aligned with the results of the FIN-02 laboratory comparison phase, giving confidence in progress of this measurement field, this level of agreement still equates to temperature uncertainties of 3.5 to 5 °C that may not be sufficient for numerical cloud modeling applications that utilize INP information. INP activity in the immersion-freezing mode was generally found to be an order of magnitude or more, making it more efficient than in the deposition regime at 95 %–99 % water relative humidity, although this limited data set should be augmented in future efforts. To contextualize the study results, an assessment was made of the composition of INPs during the late-summer to early-fall period of this study inferred through comparison to existing ice nucleation parameterizations and through measurement of the influence of thermal and organic carbon digestion treatments on immersion-freezing ice nucleation activity. Consistent with other studies in continental regions, biological INPs dominated at temperatures of > −20 °C and sometimes colder, while arable dust-like or other organic-influenced INPs were inferred to dominate below −20 °C.

54 ENVIRONMENTAL SCIENCES↗

Plasma Density and Radio Echoes in the Magnetosphere

This project provided a opportunity to study a variety of interesting topics related to radio sounding in the magnetosphere. The results of this study are reported in two papers which have been submitted for publication in the Journal of Geophysical Research and Radio Science, and various aspects of this study were also reported at meetings of the American Geophysical Union (AGU) at Baltimore, Maryland and the International Scientific Radio Union (URSI) at Boulder, Colorado. The major results of this study were also summarized during a one-day symposium on this topic sponsored by Marshall Space Flight Center in December 1994. The purpose of the study was to examine the density structure of the plasmasphere and determine the relevant mechanisms for producing radio echoes which can be detected by a radio sounder in the magnetosphere. Under this study we have examined density irregularities, biteouts, and outliers of the plasmasphere, studied focusing, specular reflection, ducting, and scattering by the density structures expected to occur in the magnetosphere, and predicted the echoes which can be detected by a magnetospheric radio sounder.

Calvert, W.↗

Finding gas-rich dwarf galaxies betrayed by their ultraviolet emission

We present ultraviolet (UV) follow-up of a sample of potential dwarf galaxy candidates selected for their neutral hydrogen (HI) properties, taking advantage of the low UV background seen by the GALEX satellite and its large and publicly available imaging footprint. The HI clouds, which are drawn from published Galactic Arecibo L-band Feed Array and Arecibo Legacy Fast Arecibo L-band Feed Array HI survey compact cloud catalogs, are selected to be galaxy candidates based on their spatial compactness and non-association with known high-velocity cloud complexes or Galactic HI emission. Based on a comparison of their UV characteristics to those of known dwarf galaxies, half (48%) of the compact HI clouds have at least one potential stellar counterpart with UV properties similar to those of nearby dwarf galaxies. If they are galaxies, then the star formation rates, HI masses, and star formation efficiencies of these systems follow the trends seen for much larger galaxies. The presence of UV emission is an efficient method to identify the best targets for spectroscopic follow-up, which is necessary to prove that the stars are associated with compact HI. Furthermore, searches of this nature help to refine the salient HI properties of likely dwarfs (even beyond the Local Group). In particular, HI compact clouds considered to be velocity outliers relative to their neighbor HI clouds have the most significant detection rate of single, appropriate UV counterparts. Correcting for the sky coverage of the two all-Arecibo sky surveys yielding the compact HI clouds, these results may imply the presence of potentially hundreds of new tiny galaxies across the entire sky.

79 ASTRONOMY AND ASTROPHYSICS↗

Secure Mass Measurements From Transit Timing: 10 Kepler Exoplanets Between 3 and 8M⊕ with Diverse Densities and Incident Fluxes

We infer dynamical masses in eight multiplanet systems using transit times measured from Keplerʼs complete dataset, including short-cadence data where available. Of the 18 dynamical masses that we infer, 10 pass multiple tests for robustness. These are in systems Kepler-26 (KOI-250), Kepler-29 (KOI-738), Kepler-60 (KOI-2086), Kepler-105 (KOI-115), and Kepler-307 (KOI-1576). Kepler -105 c has a radius of 1.3R⊕ and a density consistent with an Earth-like composition. Strong transit timing variation (TTV) signals were detected from additional planets, but their inferred masses were sensitive to outliers or consistent solutions could not be found with independently measured transit times, including planets orbiting Kepler-49 (KOI-248), Kepler-57 (KOI-1270), Kepler-105 (KOI-115), and Kepler-177 (KOI-523). Nonetheless, strong upper limits on the mass of Kepler-177 cimply an extremely low density of 0.1 g cm−3. In most cases, individual orbital eccentricities were poorly constrained owing to degeneracies in TTV inversion. For five planet pairs in our sample, strong secular interactions imply a moderate to high likelihood of apsidal alignment over a wide range of possible eccentricities. We also find solutions for the three planets known to orbit Kepler-60 in a Laplace-like resonance chain. However, nonlibrating solutions also match the transit timing data. For six systems, we calculate more precise stellar parameters than previously known, enabling useful constraints on planetary densities where we have secure mass measurements. Placing these exoplanets on the mass–radius diagram, we find that a wide range of densities is observed among sub-Neptune-mass planets and that the range in observed densities is anticorrelated with incident flux.

Stars individual↗

Secure Mass Measurements From Transit Timing: 10 Kepler Exoplanets Between 3 and 8 M⊕ With Diverse Densities and Incident Fluxes

We infer dynamical masses in eight multiplanet systems using transit times measured from Keplerʼs complete data set, including short-cadence data where available. Of the 18 dynamical masses that we infer, 10 pass multiple tests for robustness. These are in systems Kepler-26 (KOI-250), Kepler-29 (KOI-738), Kepler-60 (KOI-2086), Kepler-105 (KOI-115), and Kepler-307 (KOI-1576). Kepler-105 c has a radius of 1.3 R(sub ⨁) and a density consistent with an Earth-like composition. Strong transit timing variation (TTV) signals were detected from additional planets, but their inferred masses were sensitive to outliers or consistent solutions could not be found with independently measured transit times, including planets orbiting Kepler-49 (KOI-248), Kepler-57 (KOI-1270), Kepler-105 (KOI-115), and Kepler-177 (KOI-523). Nonetheless, strong upper limits on the mass of Kepler-177 c imply an extremely low density of ∽0.1 g cm(exp −3). In most cases, individual orbital eccentricities were poorly constrained owing to degeneracies in TTV inversion. For five planet pairs in our sample, strong secular interactions imply a moderate to high likelihood of apsidal alignment over a wide range of possible eccentricities. We also find solutions for the three planets known to orbit Kepler-60 in a Laplace-like resonance chain. However, nonlibrating solutions also match the transit timing data. For six systems, we calculate more precise stellar parameters than previously known, enabling useful constraints on planetary densities where we have secure mass measurements. Placing these exoplanets on the mass–radius diagram, we find that a wide range of densities is observed among sub-Neptune-mass planets and that the range in observed densities is anticorrelated with incident flux.

Individual stars↗

INTERPRETING THE DISTANCE CORRELATION RESULTS FOR THE COMBO-17 SURVEY

The accurate classification of galaxies in large-sample astrophysical databases of galaxy clusters depends sensitively on the ability to distinguish between morphological types, especially at higher redshifts. This capability can be enhanced through a new statistical measure of association and correlation, called the distance correlation coefficient, which has more statistical power to detect associations than does the classical Pearson measure of linear relationships between two variables. The distance correlation measure offers a more precise alternative to the classical measure since it is capable of detecting nonlinear relationships that may appear in astrophysical applications. We showed recently that the comparison between the distance and Pearson correlation coefficients can be used effectively to isolate potential outliers in various galaxy data sets, and this comparison has the ability to confirm the level of accuracy associated with the data. In this work, we elucidate the advantages of distance correlation when applied to large databases. We illustrate how the distance correlation measure can be used effectively as a tool to confirm nonlinear relationships between various variables in the COMBO-17 database, including the lengths of the major and minor axes, and the alternative redshift distribution. For these outlier pairs, the distance correlation coefficient is routinely higher than the Pearson coefficient since it is easier to detect nonlinear relationships with distance correlation. The V-shaped scatter plots of Pearson versus distance correlation coefficients also reveal the patterns with increasing redshift and the contributions of different galaxy types within each redshift range.

79 ASTRONOMY AND ASTROPHYSICS↗

Optical/X-ray/radio view of Abell 1213: A galaxy cluster with anomalous diffuse radio emission

Context. Abell 1213, a low-richness galaxy system, is known to host an anomalous radio halo detected in data of the Very Large Array (VLA). It is an outlier with regard to the relation between the radio halo power and the X-ray luminosity of the parent clusters. Aims. Our aim is to analyze the cluster in the optical, X-ray, and radio bands to characterize the environment of its diffuse radio emission and to shed new light on its nature. Methods. We used optical data from the Sloan Digital Sky Survey to study the internal dynamics of the cluster. We also analyzed archival XMM-Newton X-ray data to unveil the properties of its hot intracluster medium. Finally, we used recent data from the LOw Frequency ARray (LOFAR) at 144 MHz, together with VLA data at 1.4 GHz, to study the spectral behavior of the diffuse radio source. Results. Both our optical and X-ray analysis reveal that this low-mass cluster exhibits disturbed dynamics. In fact, it is composed of several galaxy groups in the peripheral regions and, in particular, in the core, where we find evidence of substructures oriented in the NE–SW direction, with hints of a merger nearly along the line of sight. The analysis of the X-ray emission adds further evidence that the cluster is in an unrelaxed dynamical state. At radio wavelengths, the LOFAR data show that the diffuse emission is ~510 kpc in size. Moreover, there are hints of low-surface-brightness emission permeating the cluster center. Conclusions. The environment of the diffuse radio emission is not what we would expect for a classical halo. The spectral index map of the radio source is compatible with a relic interpretation, possibly due to a merger in the N–S or NE–SW directions, in agreement with the substructures detected through the optical analysis. The fragmented, diffuse radio emissions at the cluster center could be attributed to the surface brightness peaks of a faint central radio halo.

79 ASTRONOMY AND ASTROPHYSICS↗

The SXDF-ALMA 2 arcmin{sup 2} deep survey: stacking rest-frame near-infrared selected objects

We present stacking analyses on our ALMA deep 1.1 mm imaging in the Subaru/XMM-Newton Deep Survey Field using 1.6 and 3.6 μm selected galaxies in the CANDELS WFC3 catalog. We detect a stacked flux of ∼0.03–0.05 mJy, corresponding to L{sub IR}<10{sup 11} L{sub ⊙} and a star formation rate (SFR) of ∼15 M{sub ⊙} yr{sup −1} at z = 2. We find that galaxies that are brighter in the rest-frame near-infrared tend to also be brighter at 1.1 mm, and galaxies fainter than m{sub 3.6μm}=23 do not produce detectable 1.1 mm emission. This suggests a correlation between stellar mass and SFR, but outliers to this correlation are also observed, suggesting strongly boosted star formation or extremely large extinction. We also find tendencies that redder galaxies and galaxies at higher redshifts are brighter at 1.1 mm. Our field contains z∼2.5 Hα emitters and a bright single-dish source. However, we do not find evidence of bias in our results caused by the bright source. By combining the fluxes of sources detected by ALMA and fluxes of faint sources detected with stacking, we recover a 1.1 mm surface brightness of up to 20.3 ± 1.2 Jy deg{sup −2}, comparable to the extragalactic background light measured by COBE. Based on the fractions of optically faint sources in our and previous ALMA studies and the COBE measurements, we find that approximately half of the cosmic star formation may be obscured by dust and missed by deep optical surveys. Much deeper and wider ALMA imaging is therefore needed to better constrain the obscured cosmic star formation history.

79 ASTRONOMY AND ASTROPHYSICS↗