Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data noise”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Real-time Data Analytics for Condition Monitoring of Complex Industrial Systems

Modern industrial systems are now fitted with several sensors for condition monitoring. This is advantageous because these sensors can provide mass amounts of data that have the potential for aiding in tasks such as fault detection, diagnosis, and prognostics. However, the information valuable for performing these tasks is often clouded in noise and must be mined from high-dimensional data structures. Therefore, this dissertation presents a data analytics framework for performing these condition monitoring tasks using high-dimensional data. Demonstrations of this framework are detailed for challenges related to power generation systems in automobiles, power plants, and aircraft engines. These implementations leverage data collected from state-of-the-art, industry class test-rigs. Results indicate the ability of this framework to develop effective methodologies for condition monitoring of complex systems.

Peters, Benjamin↗
DOE OSTI2020

Noise-Based Selection of Robust Inherited Model for Accurate Continual Learning

There is a growing demand for an intelligent system to continually learn knowledge from a data stream. Continual learning requires both the preservation of previous knowledge (i.e., avoiding catastrophic forgetting) and the acquisition of new knowledge. Different from previous works that focus only on model adaptation (e.g., regularization, network expansion, memory rehearsal, etc.), we propose a novel training scheme named acquisitive learning (AL), which emphasizes both the knowledge inheritance and knowledge acquisition. AL starts from an elaborately selected model with pre-trained knowledge (the inherited model) and then adapts it to new data using segmented training. The selection is achieved by injecting random noise to various inherited models for better model robustness, which promises higher accuracy in further knowledge acquisition. The approach is validated by the visualization of the loss landscape and quantitative roughness measurement. The combination of the selective inherited model and knowledge acquisition reduces catastrophic forgetting by 10X on the CIFAR-100 dataset.

Du, Xiaocong↗
DOE OSTI2024

Generalization of Deep-Learning Models for Classification of Local Distance Earthquakes and Explosions across Various Geologic Settings

Although accurately classifying signals from earthquakes and explosions at local distance (<250 km) remains an important task for seismic network operations, the growing volume of available seismic data presents a challenge for analysts using traditional source discrimination techniques. In recent years, deep-learning models have proven effective at discriminating between low-magnitude earthquakes and explosions measured at local distances, but it is not clear how well these models are capable of generalizing across different geological settings. To address the issue of generalization between regions, we train deep-learning models (convolutional neural networks [CNNs]) on time–frequency representations (scalograms) of three-component earthquake and explosion signals from eight different regions in the continental United States. We explore scenarios where models are trained on data from all regions, individual regions, or all but one region. We find that although CNN models trained on individual regions do not necessarily generalize well across different settings, models trained on multiple regions that include diverse path coverage generalize to new regions, with station-level accuracy of up to 90% or more for data sets from unseen regions. In general, CNN-based discrimination models significantly outperform models based on uncorrected P/S ratio (measured in the 10–18 Hz frequency band), even when CNN models are tested on data from entirely unseen regions.

58 GEOSCIENCES↗
DOE OSTI2021

Impact of duration and missing data on the long-term photovoltaic degradation rate estimation

Accurate quantification of photovoltaic (PV) system degradation rate (R D ) is essential for lifetime yield predictions. Although R D is a critical parameter, its estimation lacks a standardized methodology that can be applied on outdoor field data. The purpose of this paper is to investigate the impact of time period duration and missing data on R D by analyzing the performance of different techniques applied to synthetic PV system data at different linear R D patterns and known noise conditions. The analysis includes the application of different techniques to a 10-year synthetic dataset of a crystalline Silicon PV system, with emulated degradation levels and imputed missing data. Here, the analysis demonstrated that the accuracy of ordinary least squares (OLS), year-on-year (YOY), autoregressive integrated moving average (ARIMA) and robust principal component analysis (RPCA) techniques is affected by the evaluation duration with all techniques converging to lower R D deviations over the 10-year evaluation, apart from RPCA at high degradation levels. Moreover, the estimated R D is strongly affected by the amount of missing data. Filtering out the corrupted data yielded more accurate R D results for all techniques. It is proven that the application of a change-point detection stage is necessary and guidelines for accurate R D estimation are provided.

14 SOLAR ENERGY↗
DOE OSTI2025

Skipper-CCD Quantum Efficiency Analysis

Scientific skipper-CCDs with single-electron resolution present dozens of possibilities for detecting dark matter candidates. Fermilab's Cosmic Physics Center contributes to the DarkNESS mission, which aims to place a skipper multi-chip module in a 6U CubeSat designed for low earth orbit. The DarkNESS nanosat will have the capability to search for 1-10keV band X-rays that may originate from DM decays. One of the challenges of detection in space is the large amount of cosmic radiation contributing to sensor noise. To mitigate this, an aluminum shield is proposed to be placed on the sensor. This project aims to test and characterize the energy resolution with a shield of various thicknesses (0-100nm) using a single CCD and an iron-55 x-ray source. ROOT analysis was used to parse data from several runs into sections based on shield thickness, create strategic data cuts, and characterize Fano plus signal shot noise in the sensor.

Wells, Megan E. [U. Illinois, Chicago]↗
DOE OSTI2025

Phonon Dispersion Relations and Electron-Phonon Coupling in Iridium

This dataset comprises inelastic neutron scattering measurements of iridium conducted at SNS (ARCS, ITPS-30061) and HFIR (HB-3, TAX, IPTS-25194). ARCS data collected using 50 meV incident energy and include both signal and background files at various temperatures (100 K to 700 K). HB-3 (TAX) measurements span a temperature range from 100 K to 700 K and are organized by run numbers. Background contributions from the sample environment, such as shiver-induced noise, are included for completeness. The details of data description can be found in description.txt.

iridium, phonon, electron-phonon coupling↗
DOE OSTI2021

Automatic Traffic Queue-End Identification using Location-Based Waze User Reports

Traffic queues, especially queues caused by non-recurrent events such as incidents, are unexpected to high-speed drivers approaching the end of queue (EOQ) and become safety concerns. Though the topic has been extensively studied, the identification of EOQ has been limited by the spatial-temporal resolution of traditional data sources. This study explores the potential of location-based crowdsourced data, specifically Waze user reports. It presents a dynamic clustering algorithm that can group the location-based reports in real time and identify the spatial-temporal extent of congestion as well as the EOQ. The algorithm is a spatial-temporal extension of the density-based spatial clustering of applications with noise (DBSCAN) algorithm for real-time streaming data with an adaptive threshold selection procedure. Here, the proposed method was tested with 34 traffic congestion cases in the Knoxville, Tennessee area of the United States. It is demonstrated that the algorithm can effectively detect spatial-temporal extent of congestion based on Waze report clusters and identify EOQ in real-time. The Waze report-based detection are compared to the detection based on roadside sensor data. The results are promising: The EOQ identification time of Waze is similar to the EOQ detection time of traffic sensor data, with only 1.1 min difference on average. In addition, Waze generates 1.9 EOQ detection points every mile, compared to 1.8 detection points generated by traffic sensor data, suggesting the two data sources are comparable in respect of reporting frequency. The results indicate that Waze is a valuable complementary source for EOQ detection where no traffic sensors are installed.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

Machine Learning–Based Condition Monitoring of a Circulating Water System of a Canadian Nuclear Plant

With the need to maintain long-term reliable energy using nuclear power plants, there is an underlying demand to ensure that the maintenance of plant components and systems is also done in an efficient and cost-effective manner. One way to achieve this is by moving from time-based maintenance to condition-based maintenance. The research presented in this paper focuses on applying statistical and machine-learning-based methods to capture anomalies within data for fault detection to further develop into condition monitoring. This paper focuses on system data for a circulating water system (CWS) of a pressurized heavy-water reactor for detecting anomalies. The different methodologies used for detecting and capturing anomalies in the CWS data are matrix profile, density-based spatial clustering of applications with noise (DBSCAN), and support vector machines (SVMs). Matrix profile and DBSCAN are used to distinguish between normal data and anomalous data. This paper presents a hybrid method using DBSCAN and SVM when a portion of the data is used for DBSCAN to generate clusters. This portion of data is then used to train the SVM along with the clusters generated by DBSCAN as output. SVM is then tested on unseen data as a predictive tool, which can work in real time to categorize data points as either normal or anomalous. This paper presents results that show the high accuracies of DBSCAN and SVM in capturing anomalies within the data for a CWS for fault detection. Thus, the maintenance plan would be focused on component condition rather than a time-based schedule by switching to an automated system to identify and predict faults within a CWS.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Concentration fluctuations and flammability of cryo-compressed hydrogen and methane jets

Compressed hydrogen stored at cryogenic temperatures has a much higher density than room-temperature storage, which enables large-scale hydrogen storage and transport. An understanding of the release of cryogenic hydrogen from pressurized vessels is needed to evaluate the risk and safety concerns with the use of this fuel. Here, the present work extends the analysis of previous experimental studies that measured the gas concentrations of cryo-compressed hydrogen jets and methane jets using a laser Raman scattering diagnostic system. Since the Raman signals are very small, a denoising algorithm was applied to significantly reduce the noise to enable statistical analysis of the data. The transient features of the turbulent jets were characterized by their concentration intermittencies and probability density functions (PDFs). A two-part PDF was developed to predict the bimodal features of the jet concentration distributions. Then, the flammability factors of the cryogenic jets were calculated based on the intermittency and the PDF.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

BEYONDPLANCK XI. Bayesian CMB analysis with sample-based end-to-end error propagation

We present posterior sample-based cosmic microwave background (CMB) constraints from Planck LFI and WMAP observations as derived through global end-to-end Bayesian processing within the BeyondPlanck framework. We first use these samples to study correlations between CMB, foreground, and instrumental parameters, and we identify a particularly strong degeneracy between CMB temperature fluctuations and free-free emission on intermediate angular scales (400 ≲ ℓ ≲ 600), which is mitigated through model reduction, masking, and resampling. We compare our posterior-based CMB results with previous Planck products, and find generally good agreement, although with notably higher noise due to our exclusion of HFI data. We find a best-fit CMB dipole amplitude of 3362.7 ± 1.4 µK, in excellent agreement with previous Planck results. The quoted dipole uncertainty is derived directly from the sampled posterior distribution, and does not involve any ad hoc contributions for Planck instrumental systematic effects. Similarly, we find a temperature quadrupole amplitude of ${σ}_{2}^{TT}$ = 229 ± 97 µK 2 , which is in good agreement with previous results in terms of the amplitude, but the uncertainty is an order of magnitude larger than the naive diagonal Fisher uncertainty. Relatedly, we find lower evidence for a possible alignment between the quadrupole and octopole than previously reported due to a much larger scatter in the individual quadrupole coefficients, caused both by marginalizing over a more complete set of systematic effects, but also by our more conservative analysis mask required to mitigate the free-free degeneracy. For higher multipoles, we find that the angular temperature power spectrum is generally in good agreement with both Planck and WMAP. At the same time, we note that this is the first time the sample-based asymptotically exact Blackwell-Rao estimator has been successfully established for multipoles up to ℓ ≤ 600, and it now accounts for the majority of the cosmologically important information. Overall, this analysis demonstrates the unique capabilities of the Bayesian approach with respect to end-to-end systematic uncertainty propagation, and we believe it can and should play an important role in the analysis of future CMB experiments. Cosmological parameter constraints are presented in a companion paper.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Cosmic topology. Part I. Limits on orientable Euclidean manifolds from circle searches

The Einstein field equations of general relativity constrain the local curvature at every point in spacetime, but say nothing about the global topology of the Universe. Cosmic microwave background anisotropies have proven to be the most powerful probe of non-trivial topology since, within ΛCDM, these anisotropies have well-characterized statistical properties, the signal is principally from a thin spherical shell centered on the observer (the last scattering surface), and space-based observations nearly cover the full sky. The most generic signature of cosmic topology in the microwave background is pairs of circles with matching temperature and polarization patterns. No such circle pairs have been seen above noise in the WMAP or Planck temperature data, implying that the shortest non-contractible loop around the Universe through our location is longer than 98.5% of the comoving diameter of the last scattering surface. We translate this generic constraint into limits on the parameters that characterize manifolds with each of the nine possible non-trivial orientable Euclidean topologies, and provide a code which computes these constraints. In all but the simplest cases, the shortest non-contractible loop in the space can avoid us, and be shorter than the diameter of the last scattering surface by a factor ranging from 2 to at least 6. Further, this result implies that a broader range of manifolds is observationally allowed than widely appreciated. Probing these manifolds will require more subtle statistical signatures than matched circles, such as off-diagonal correlations of harmonic coefficients.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Deep structural clustering for single-cell RNA-seq data jointly through autoencoder and graph neural network

Abstract Single-cell RNA sequencing (scRNA-seq) permits researchers to study the complex mechanisms of cell heterogeneity and diversity. Unsupervised clustering is of central importance for the analysis of the scRNA-seq data, as it can be used to identify putative cell types. However, due to noise impacts, high dimensionality and pervasive dropout events, clustering analysis of scRNA-seq data remains a computational challenge. Here, we propose a new deep structural clustering method for scRNA-seq data, named scDSC, which integrate the structural information into deep clustering of single cells. The proposed scDSC consists of a Zero-Inflated Negative Binomial (ZINB) model-based autoencoder, a graph neural network (GNN) module and a mutual-supervised module. To learn the data representation from the sparse and zero-inflated scRNA-seq data, we add a ZINB model to the basic autoencoder. The GNN module is introduced to capture the structural information among cells. By joining the ZINB-based autoencoder with the GNN module, the model transfers the data representation learned by autoencoder to the corresponding GNN layer. Furthermore, we adopt a mutual supervised strategy to unify these two different deep neural architectures and to guide the clustering task. Extensive experimental results on six real scRNA-seq datasets demonstrate that scDSC outperforms state-of-the-art methods in terms of clustering accuracy and scalability. Our method scDSC is implemented in Python using the Pytorch machine-learning library, and it is freely available at https://github.com/DHUDBlab/scDSC.

Gan, Yanglan↗
DOE OSTI2024

Human-in-the-Loop: The Future of Machine Learning in Automated Electron Microscopy

Machine learning (ML) methods are progressively gaining acceptance in the electron microscopy community for de-noising, semantic segmentation, and dimensionality reduction of data post-acquisition. The introduction of the application programming interfaces (APIs) by major instrument manufacturers now allows the deployment of ML workflows in microscopes, not only for data analytics but also for real-time decision-making and feedback for microscope operation. However, the number of use cases for real-time ML remains remarkably small. Furthermore, we discuss some considerations in designing ML-based active experiments and pose that the likely strategy for the next several years will be human-in-the-loop automated experiments (hAE). In this paradigm, the ML learning agent directly controls beam position and image and spectroscopy acquisition functions, and a human operator monitors experiment progression in real and feature space of the system and tunes the policies of the ML agent to steer the experiment toward specific objectives.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Magnetic properties of a staggered S = 1 chain with an alternating single-ion anisotropy direction

Materials composed of spin-1 antiferromagnetic (AFM) chains are known to adopt complex ground states that are sensitive to the single-ion-anisotropy (SIA) energy ( D ), and intrachain ( J 0 ) and interchain ( J 1 , 2 ′ ) exchange energy scales. While theoretical and experimental studies have extended this model to include various other energy scales, the effect of the lack of a common SIA axis is not well explored. Here we investigate the magnetic properties of Ni ( pyrimidine ) ( H 2 O ) 2 ( NO 3 ) 2 , a chain compound where the tilting of Ni octahedra leads to a twofold alternation of the easy-axis directions along the chain. Muon-spin relaxation measurements indicate a transition to long-range order at T N = 2.3 K and the magnetic structure is initially determined to be antiferromagnetic and collinear using elastic neutron diffraction experiments. Inelastic neutron scattering measurements were used to find J 0 = 5.107 ( 7 ) K , D = 2.79 ( 1 ) K , J 1 ′ = 0.00 ( 5 ) K , J 2 ′ = 0.18 ( 3 ) K , and a rhombic anisotropy energy E = 0.19 ( 9 ) K . Mean-field modeling reveals that the ground state structure hosts spin canting of ϕ ≈ 6 . 5 ∘ , which is not detectable above the noise floor of the elastic neutron diffraction data. Monte Carlo simulation of the powder-averaged magnetization, M ( H ) , is then used to confirm these Hamiltonian parameters, while single-crystal M ( H ) simulations provide insight into features observed in the data. Published by the American Physical Society 2025

Vaidya, S. (ORCID:000000033975497X)↗
DOE OSTI2026

RF Digitizer for EIC LLRF

With the shutdown of Relativisitc Heavy Ion Collider (RHIC) in FY26, the former RHIC facility will be upgraded to the new Electron-Ion Collider (EIC). An RF Digitizer for the EIC LLRF system has been developed and tested on a RHIC 197 MHz cavity in Q2 2026 for a baseline per formance. Firmware and software has been developed and validated during the 197 MHz cavity test. Preliminary data from the cavity test shows phase noise performance signifi cantly better than the RHIC LLRF system.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Mitiq: A software package for error mitigation on noisy quantum computers

We introduce Mitiq, a Python package for error mitigation on noisy quantum computers. Error mitigation techniques can reduce the impact of noise on near-term quantum computers with minimal overhead in quantum resources by relying on a mixture of quantum sampling and classical post-processing techniques. Mitiq is an extensible toolkit of different error mitigation methods, including zero-noise extrapolation, probabilistic error cancellation, and Clifford data regression. The library is designed to be compatible with generic backends and interfaces with different quantum software frameworks. We describe Mitiq using code snippets to demonstrate usage and discuss features and contribution guidelines. We present several examples demonstrating error mitigation on IBM and Rigetti superconducting quantum processors as well as on noisy simulators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Anomaly Detection in Liquid Sodium Cold Trap Operation with Multisensory Data Fusion Using Long Short-Term Memory Autoencoder

Sodium-cooled fast reactors (SFR), which use high temperature fluid near ambient pressure as coolant, are one of the most promising types of GEN IV reactors. One of the unique challenges of SFR operation is purification of high temperature liquid sodium with a cold trap to prevent corrosion and obstructing small orifices. We have developed a deep learning long short-term memory (LSTM) autoencoder for continuous monitoring of a cold trap and detection of operational anomaly. Transient data were obtained from the Mechanisms Engineering Test Loop (METL) liquid sodium facility at Argonne National Laboratory. The cold trap purification at METL is monitored with 31 variables, which are sensors measuring fluid temperatures, pressures and flow rates, and controller signals. Loss-of-coolant type anomaly in the cold trap operation was generated by temporarily choking one of the blowers, which resulted in temperature and flow rate spikes. The input layer of the autoencoder consisted of all the variables involved in monitoring the cold trap. The LSTM autoencoder was trained on the data corresponding to cold trap startup and normal operation regime, with the loss function calculated as the mean absolute error (MAE). The loss during training was determined to follow log-normal density distribution. During monitoring, we investigated a performance of the LSTM autoencoder for different loss threshold values, set at a progressively increasing number of standard deviations from the mean. The anomaly signal in the data was gradually attenuated, while preserving the noise of the original time series, so that the signal-to-noise ratio (SNR) averaged across all sensors decreased below unity. Results demonstrate detection of anomalies with sensor-averaged SNR < 1.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Dynamic Transcriptomic and Phosphoproteomic Analysis During Cell Wall Stress in Aspergillus nidulans

The fungal cell-wall integrity signaling (CWIS) pathway regulates cellular response to environmental stress to enable wall repair and resumption of normal growth. This complex, interconnected, pathway has been only partially characterized in filamentous fungi. To better understand the dynamic cellular response to wall perturbation, a β-glucan synthase inhibitor (micafungin) was added to a growing A. nidulans shake-flask culture. From this flask, transcriptomic and phosphoproteomic data were acquired over 10 and 120 min, respectively. To differentiate statistically-significant dynamic behavior from noise, a multivariate adaptive regression splines (MARS) model was applied to both data sets. Over 1800 genes were dynamically expressed and over 700 phosphorylation sites had changing phosphorylation levels upon micafungin exposure. Twelve kinases had altered phosphorylation and phenotypic profiling of all non-essential kinase deletion mutants revealed putative connections between PrkA, Hk-8–4, and Stk19 and the CWIS pathway. Our collective data implicate actin regulation, endocytosis, and septum formation as critical cellular processes responding to activation of the CWIS pathway, and connections between CWIS and calcium, HOG, and SIN signaling pathways.

59 BASIC BIOLOGICAL SCIENCES↗