Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data noise”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Critical and Subcritical Californium Source Driven Noise Analysis Experiments with Fresh PWR Fuels Pins

These experiments were performed in 1983 between August 1 and September 16 and used 35 operational days of critical facility time at the Babcock & Wilcox critical facility in Lynchburg, Va. These measurements were to assess the capability of the Cf source driven noise analysis method to measure the subcriticality of light water reactor fresh fuel configurations. This report documents the experiments of 1983 that were not reported at that time. These measurement with 2.459 wt. % 235 U enriched uranium oxide fresh fuel pins started at the delayed critical configuration of the fully assembled pressurized water reactor (PWR) core configuration with 1511 parts per million (ppm) natural boron (19.8 wt. % 10 B) in the water. This was a cylindrical configuration of 4961 fuel pins. After the initial measurements at delayed criticality, subcritical measurements by the Cf source driven noise analysis method were performed in which the number of detectors and Cf source locations were varied. Additional boron was added to the water moderator and reflector to reduce the neutron multiplication factor, with resulting boron concentrations of 1561, 1613, 1765, 1880, 2104, 2384, 2975, 3606, and 4303 ppm. After the completion of these measurements the increased, the boron concentration was returned to that at delayed critical (1511 ppm) and the reactivity was decreased by reducing the number of fuel pins in steps to 3713, 2553, 1281, 749, and 333 fuel pins and then to that (289) of a s ingle square 17 x 17 pin array, corresponding to a single PW fuel element. For all measurement that started at delayed criticality and then reduced the neutron multiplication factor to various subcritical states, inverse kinetics rod drop measurements at the higher reactivities were also performed but not reported here. At all subcritical states the break frequency noise analysis data was fitted to obtain the prompt neutron decay constant. Some data presented in this report are from notes not in the logbook. The purpose of this report is to document the experimental information for the measurements performed so that a later date someone could perform the required uncertainty and calculational analyses and documentation to use these data for an International Nuclear Criticality Safety Benchmark Program (INCSBEP) or Nuclear Energy Agency (NEA) benchmark. The data from these measurements is available from the Laboratory Records Department of Oak Ridge National Laboratory and the logbook is available from INCSBEP at Idaho National Laboratory.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Subcritical Californium Source Drive Noise Analysis Measurements With Unreflected Uranium (93.15) Hydride

On July 6, 1989, subcritical californium source-driven noise analysis (CSDNA) measurements were performed with bare uranium hydride cylindrical assemblies at the Los Alamos National Laboratory Critical Experiments Facility in KIVA 1. Three configurations of ~7.5 cm radius-enriched (93.15 wt. % 235 U) uranium hydride with a density of ~10 g/cm 3 cylinders were assembled with uranium hydride heights of ~11, ~14, and ~16 cm. The uranium hydride (~2 and ~3 cm high) was in thin-welded stainless steel cans. The neutron multiplication factors obtained on-line from the measured ratios of spectral densities were 0.942 ± 0.002, 0.917 ± 0.003, and 0.867 ± 0.004 for uranium hydride heights of ~16, ~14, and ~11 cm., respectively. Neutron multiplication factors for these three configurations calculated by Los Alamos National Laboratory Monte Carlo methods were 0.952 ± 0.005, 0.922 ± 0.005, and 0.860 ± 0.005, all of which are in good agreement with the measurements. The break frequency noise analysis data could be fitted to obtain the prompt neutron decay constant at all subcritical states. Some data presented in this report are from notes that are not in the logbooks. A discussion of the two different point kinetics theories of the measurements that illustrated the deficiencies of the rigorous theory at low neutron multiplication factors (k eff < 0.80) is given in an Appendix. These measurements may be the only configuration of unreflected, highly enriched uranium hydride configuration assembled. The presence of hydrogen diluted the uranium density, decreasing the reactivity, but this is offset by slowing down the neutron energy to the energy ranges of higher-fission cross sections. Extrapolations to delayed critical indicate that adding one more 3 cm can and one more 2 cm can would result in the unreflected cylindrical system being slightly above critical with a critical mass of ~37 kg, which is considerably less than the critical mass of an unreflected and unmoderated highly enriched uranium metal sphere. An unreflected, highly enriched uranium hydride sphere would have a critical mass less than 37 kg.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Critical and Californium Source-Driven Noise Analysis Subcritical Measurements with an Unreflected Cylindrical Tank of Mixed Uranium-Plutonium Nitrate Solution

The reported experiments were performed by Oak Ridge National Laboratory (ORNL) at the Battelle Northwest Laboratory’s (now Pacific Northwest National Laboratory) critical experiments facility at Hanford, Washington in 1981 and used 16 days of critical facility time, not including 10 days for setup and removal of ORNL equipment. These measurements were to assess the capability of the Cf source-driven noise analysis (CSDNA) method to measure the subcriticality (keff) of mixed U-Pu nitrate solutions. In addition to the CSNDA measurements, measurements were also performed near delayed criticality where CSDNA measurements cannot be performed. This report documents the experiments that were not reported at that time by presenting the ORNL experimental results and any online analysis performed during and shortly after the measurements. The mixed nitrate solution had a U concentration at 188 grams per liter (g/L), a Pu concentration of 280 g/L, free acid normality of 2.80, H ion molarity of 5.9 and a specific gravity of 1.754 g/cm 3 , a 240 Pu isotopic content of 7.981 wt. %, and a 235 U isotopic content of 0.724 wt. %. The stainless-steel tank for the solution had an inside diameter of 35.38 cm, an outside diameter of 35.53 cm, a height of 56.72 cm, and bottom thickness of 0.9525 cm. A Zircaloy pipe with a 3.1496 cm outside diameter, a 2.7788 cm inside diameter, and bottom thickness of 0.635 cm was available for insertion of the Cf source in the center of the fissile solution. The Cf source was also located at the outside surface of the tank (solution height varied from 10 to 53 cm) and in the center of the solution (solution height varied from 10 to 60.7 cm). The CSDNA measurements were not analyzed online to determine the subcritical neutron multiplication factors. At all subcritical states, the break frequency noise analysis data was fitted to obtain the prompt neutron decay constant. The neutron multiplication factors were determined for the two configurations of the measurements near delayed criticality. The subcritical neutron multiplication factors from the CNSDA measurements can be obtained with further analysis. However, the near delayed critical configuration, the prompt neutron decay constants, the count rates, and the measured cross and auto power spectral densities can be calculated directly for benchmarking. Much of data presented in this report are from ORNL notes—not in the ORNL logbooks. For the final benchmark analysis, the data from the Battelle Northwest Laboratory (which operated the critical facility in 1981) critical facility logbook should be consulted and be incorporated where appropriate. The purpose of this report is to document the experimental information for the measurements performed so that at a later date researchers could perform the required uncertainty and calculational analyses and documentation to use these data for an International Criticality Safety Benchmark Program (ICSBEP) or Nuclear Energy Agency benchmark. The data from these measurements are available from the ORNL Records Management Services Department, and the logbook is available from ICSBEP at Idaho National Laboratory. Preparation of the present report is part of a larger cooperative effort between Idaho National Laboratory (INL) and Oak Ridge National Laboratory (ORNL) to document more than 15 undocumented critical and subcritical experiments enumerated in ORNL/TM-2019/18 and performed by ORNL at ORCEF and other USDOE critical experiments facilities using more than 500 operational days of critical facility time.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Machine Learning for Improved Availability of the SNS Klystron High Voltage Converter Modulators

Beam availability has increased at the SNS, however, the targeted availability is greater than 95 %, while the SNS has failed to meet lower targets in the past. The HVCM used to power the linac klystrons have been one source of lost beam time and was chosen to explore using AI/ML techniques to improve reliability. Among the possibilities being explored are automating the tuning of HVCMs and predicting component failures such as capacitor aging, rectifier assemblies containing hundreds of diodes, and insulating oil degradation. The methodology pursued includes data cleaning, de-noising, post-analysis data labeling, and machine learning model development. We explore using Long Short-Term Memory and autoencoders for anomaly detection and prognostication used to schedule maintenance. We evaluate the use of model regularizers and constraints to improve the performance of the model and investigate methods to estimate the uncertainty of the models to provide a robust prediction with statistical interoperability. This paper describes the operational experience and known failures of the HVCMs and the proposed ML methodology and the preliminary results of training the AI/ML algorithms.

Pappas, Chris↗
DOE OSTI2021

Machine Learning for Improved Availability of the SNS Klystron High Voltage Converter Modulators

Beam availability has increased at the SNS, however, the targeted availability is greater than 95 %, while the SNS has failed to meet lower targets in the past. The HVCM used to power the linac klystrons have been one source of lost beam time and was chosen to explore using AI/ML techniques to improve reliability. Among the possibilities being explored are automating the tuning of HVCMs and predicting component failures such as capacitor aging, rectifier assemblies containing hundreds of diodes, and insulating oil degradation. The methodology pursued includes data cleaning, de-noising, post-analysis data labeling, and machine learning model development. We explore using Long Short-Term Memory and autoencoders for anomaly detection and prognostication used to schedule maintenance. We evaluate the use of model regularizers and constraints to improve the performance of the model and investigate methods to estimate the uncertainty of the models to provide a robust prediction with statistical interoperability. This paper describes the operational experience and known failures of the HVCMs and the proposed ML methodology and the preliminary results of training the AI/ML algorithms.

Pappas, Chris↗
DOE OSTI2025

A Privacy First Path Analysis using Clickstream Data

In the modern digital economy, data-driven decision making is crucial for effectively meeting the ever-evolving demands of consumer engagement and satisfaction. Clickstream data has become invaluable for understanding customer behavior, yet concerns over privacy and security persist, especially with some internet service providers profiting from its sale. This article introduces an innovative methodology that blends experiential learning with advanced cryptographic techniques, including differential privacy and graph analytics. The core objective of this methodology is to estimate Customer Lifetime Value (CLV) by analyzing clickstream data, achieving an average prediction accuracy of 92.4% in user engagement levels while ensuring user anonymity through Recency, Frequency, and Monetary (RFM) analysis. Our study introduces the concept of a “data depositor” and a privacy manager, employing the composition theorem to merge non-adaptive queries effectively. Privacy budgets (? = 1.0, d = 10-5), sensitivity-specific techniques, and data partitioning were applied. Randomization and noise addition protect data integrity, with special handling for categorical values. This approach, differing from prior studies, offers a 12.6% improvement in privacy-preserving targeting accuracy while maintaining strict confidentiality, presenting a novel path forward in data-driven decision-making.

Frequency and Monetary (RFM) analysis↗
DOE OSTI2021

Revisiting matrix-based inversion of scanning mobility particle sizer (SMPS) and humidified tandem differential mobility analyzer (HTDMA) data

Abstract. Tikhonov regularization is a tool for reducing noise amplification during data inversion. This work introduces RegularizationTools.jl, a general-purpose software package for applying Tikhonov regularization to data. The package implements well-established numerical algorithms and is suitable for systems of up to ∼ 1000 equations. Included is an abstraction to systematically categorize specific inversion configurations and their associated hyperparameters. A generic interface translates arbitrary linear forward models defined by a computer function into the corresponding design matrix. This obviates the need to explicitly write out and discretize the Fredholm integral equation, thus facilitating fast prototyping of new regularization schemes associated with measurement techniques. Example applications include the inversion involving data from scanning mobility particle sizers (SMPSs) and humidified tandem differential mobility analyzers (HTDMAs). Inversion of SMPS size distributions reported in this work builds upon the freely available software DifferentialMobilityAnalyzers.jl. The speed of inversion is improved by a factor of ∼ 200, now requiring between 2 and 5 ms per SMPS scan when using 120 size bins. Previously reported occasional failure to converge to a valid solution is reduced by switching from the L-curve method to generalized cross-validation as the metric to search for the optimal regularization parameter. Higher-order inversions resulting in smooth, denoised reconstructions of size distributions are now included in DifferentialMobilityAnalyzers.jl. This work also demonstrates that an SMPS-style matrix-based inversion can be applied to find the growth factor frequency distribution from raw HTDMA data while also accounting for multiply charged particles. The outcome of the aerosol-related inversion methods is showcased by inverting multi-week SMPS and HTDMA datasets from ground-based observations, including SMPS data obtained at Bodega Marine Laboratory during the CalWater 2/ACAPEX campaign and co-located SMPS and HTDMA data collected at the US Department of Energy observatory located at the Southern Great Plains site in Oklahoma, USA. Results show that the proposed approaches are suitable for unsupervised, nonparametric inversion of large-scale datasets as well as inversion in real time during data acquisition on low-cost reduced-instruction-set architectures used in single-board computers. The included software implementation of Tikhonov regularization is freely available, general, and domain-independent and thus can be applied to many other inverse problems arising in atmospheric measurement techniques and beyond.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Machine learning for improved current-density reconstruction from two-dimensional vector magnetic images

The reconstruction of electrical current densities from magnetic field measurements is an important technique with applications in materials science, circuit design, quality control, plasma physics, and biology. Analytic reconstruction methods exist for planar currents, but break down in the presence of high-spatial-frequency noise or large standoff distance, restricting the types of systems that can be studied. Here, we demonstrate the use of a deep convolutional neural network for current density reconstruction from two-dimensional images of vector magnetic fields acquired by a quantum diamond microscope . Trained network performance significantly exceeds analytic reconstruction for data with high noise or large standoff distances. This machine learning technique can perform quality inversions on lower-signal-to-noise-ratio data, significantly reducing the data collection time and permitting reconstructions of weaker and three-dimensional current sources. Published by the American Physical Society 2025

Reed, Niko R. (ORCID:0009000305222403)↗
DOE OSTI2024

Algorithms for Non-Negative Matrix Factorization on Noisy Data With Negative Values

Non-negative matrix factorization (NMF) is a dimensionality reduction technique that has shown promise for analyzing noisy data, especially astronomical data. For these datasets, the observed data may contain negative values due to noise even when the true underlying physical signal is strictly positive. Prior NMF work has not treated negative data in a statistically consistent manner, which becomes problematic for low signal-to-noise data with many negative values. In this paper we present two algorithms, Shift-NMF and Nearly-NMF, that can handle both the noisiness of the input data and also any introduced negativity. Both of these algorithms use the negative data space without clipping or masking and recover non-negative signals without any introduced positive offset that occurs when clipping or masking negative data. We demonstrate this numerically on both simple and more realistic examples, and prove that both algorithms have monotonically decreasing update rules.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Preprocessing for Unintended Conducted Emissions Classification with ResNet

Characterization of Unintended Conducted Emissions (UCE) from electronic devices is important when diagnosing electromagnetic interference, performing nonintrusive load monitoring (NILM) of power systems, and monitoring electronic device health, among other applications. Prior work has demonstrated that UCE analysis can serve as a diagnostic tool for energy efficiency investigations and detailed load analysis. While explaining the feature selection of deep networks with certainty is often not fully comprehensive, or in other applications, quite lacking, additional tools/methods for further corroboration and confirmation can help further the understanding of the researcher. This is true especially in the subject application of the study in this paper. Often the focus of such efforts is the selected features themselves, and there is not as much understanding gained about the noise in the collected data. If selected feature and noise characteristics are known, it can be used to further shape the design of the deep network or associated preprocessing. This is additionally difficult when the available data are limited, as in the case which the authors investigated in this study. Here, the authors present a novel work (which is a proposed complementary portion of the overall solution to the deep network classification explainability problem for this application) by applying a systematic progression of preprocessing and a deep neural network (ResNet architecture) to classify UCE data obtained via current transformers. By using a methodical application of preprocessing techniques prior to a deep classifier, hypotheses can be produced concerning what features the deep network deems important relative to what it perceives as noise. For instance, it is hypothesized in this particular study as a result of execution of the proposed method and periodic inspection of the classifier output that the UCE spectral features are relatively close to each other or to the interferers, as systematically reducing the beta parameter of the Kaiser window produced progressively better classification performance, but only to a point, as going below the Beta of eight produced decreased classifier performance, as well as the hypothesis that further spectral feature resolution was not as important to the classifier as rejection of the leakage from a spectrally distant interference. This can be very important in unpredictable low-FNR applications, where knowing the difference between features and noise is difficult. As a side-benefit, much was learned regarding the best preprocessing to use with the selected deep network for the UCE collected from these low power consumer devices obtained via current transformers. Baseline rectangular windowed FFT preprocessing provided a 62% classification increase versus using raw samples. After performing a more optimal preprocessing, more than 90% classification accuracy was achieved across 18 low-power consumer devices for scenarios in which the in-band features-to-noise ratio (FNR) was very poor.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Detailed space–time variations of the seismic response of the shallow crust to small earthquakes from analysis of dense array data

SUMMARY We compute high-resolution space–time variations of subsurface seismic properties from autocorrelation functions (ACF’s) of noise and local earthquakes, recorded by the Sage Brush Flat dense array deployed around the Clark branch of the San Jacinto fault. The resolved temporal changes are referred to as apparent velocity changes because they reflect both nonlinear response and variations of material properties such as cracking and damage. Apparent velocity changes are estimated at four frequency bands (10–15, 10–20, 15–30 and 20–40 Hz) for two local earthquake data sets. In one analysis, ACF’s from P- and S-wave windows of 31 small events with magnitudes below 3.1 are used to compute the apparent velocity variations with respect to the mean ACF of each phase, and we also use the mean ACF of noise data as reference to estimate the changes. In a further analysis, the temporal evolution of properties is computed using moving time windows in continuous waveform over one-hour long data with noise and earthquake signals. The apparent velocity changes and recovery times are frequency dependent and present a strong spatial variability across the array. The resolved changes are larger and recovery time shorter with data associated with higher frequencies. At frequencies larger than 15 Hz, and using the mean ACF of noise data as a reference, the apparent average velocity changes across the array during the passage of the P and S waves from the small local events are 2.5 per cent and 6 per cent, respectively. The apparent velocity changes decrease by one order of magnitude when the earthquake data are used as a reference. The relatively large changes in response to very low ground motion have important implications on nonlinear processes involving degradation and healing of the subsurface material during common earthquake shaking.

Geochemistry & Geophysics↗
DOE OSTI2024

DECOVALEX-2023: Task D Final Report

Task D of DECOVALEX-2023 is focused on the simulation of the coupled thermal hydraulic-mechanical (THM) behaviour in the full-scale engineered barrier system (EBS). The Horonobe EBS experiment is the demonstration of the full-scale EBS in the underground research laboratory (URL) (performed by JAEA in the Horonobe URL in Japan). Task D consisted of the three steps, a preliminary step (Step 0), simulation of the laboratory tests (Step 1) and simulation of the in-situ full-scale EBS experiment (Step 2). Since the Horonobe EBS experiment demonstrates the vertical emplacement option of the EBS, the experiment gallery is also backfilled with the backfill material. Therefore, interaction between the EBS and the backfill material can also be demonstrated, such as deformation (change of density) of the buffer material. The underground water in the Horonobe URL is saline. This fact adds chemical processes to THM behaviour. For example, mechanical properties (such as swelling pressure of the buffer material and backfill material) and hydraulic properties (such as permeability of the buffer material and backfill material) change depending on the water chemistry. Task D was therefore a challenging Task focused on not only the relatively simple THM behaviour but also complex THM behaviour including chemical processes. Six research teams (BGR, CAS, JAEA, KAERI, SNL and Taipower) participated the Task D. BGR, CAS, JAEA, KAERI and Taipower research teams selected a THM approach, while the SNL research team selected a TH approach. Step 1 involved the simulation of laboratory test results and was important to check the numerical codes developed by the research teams. Step 1 was divided into four sub steps. The simulation results through the Step 1 identified the parameters for simulation of the Step 2. Basic parameters of the materials (buffer material, backfill material, rock mass, concrete, sand) were provided by JAEA. Special parameters which research team needed were identified by back analysis of Step 1. Most notably the mechanical behaviour of swelling and displacement depended on the applied model (elastic model or elastoplastic model). Parameters such as Young’s modulus were found to need smaller values than characterised in the fundamental laboratory test results (Step 1-1, 1-2) for the elastic model. Although laboratory experiments are usually simple, test results contained some error. For example, if the saturation level is 100 % or higher, it should be considered an error. This situation was presented in the Step 1-3. A possible reason is that the buffer material is a mixture of bentonite and silica sand. When a specimen is cut to measure volume or weight, sand grains will affect the measurement data. In Step 2, boundary conditions such as temperature on the surface of the simulated overpack, heater power of the electrical heaters installed in the simulated overpack, injection pressure and inflow rate of the test water, were applied. The outer boundary conditions can be selected using measured data (injection pressure and inflow rate of the test water that is controlled by the injection systems installed in the sand layer around the buffer material and in the boundary between backfill material and concrete support). Since such measured data has some noise, research teams developed their own simplified boundary conditions. Inner boundary conditions can be selected using measured data as heater power and temperature on the surface of the simulated overpack. These data also contain some noise, so research teams developed their own simplified developed boundary conditions. Task D validated various approaches thorough the simulation of the in-situ full scale EBS system including backfill of the gallery: variations in the coupling processes (THM or THC), analysis codes, and boundary conditions. Temperature distribution in the buffer material was simulated well by all research teams. This means thermal behaviour is not sensitive to the simulation approaches. Although the water content distribution on the outside of the buffer material was well simulated by all research teams, the simulation results differ from the measured values inside the buffer material (at the centre and inside, near the simulated overpack). The buffer material is made from tap water, but in the in-situ experiment, saline groundwater infiltrates the buffer material. Therefore, the selection of the hydraulic parameters of the buffer material greatly affects the simulation results of the re saturation behaviour of the buffer material. In the Horonobe EBS experiment, measured values suitable for validating the simulation results were not obtained near the simulated overpack. When simulating the pressure and deformation of the buffer material, the measurement data is easily affected by the installation conditions of the measurement sensors, so verifying the measurement data itself remains an issue. Mechanical simulation results differ depending on whether they are considered as elastic or elastoplastic phenomena. The accuracy of measured in-situ data can be assessed by detailed analysis comparing sampling specimen analysis and measured data. The Horonobe EBS experiment is scheduled to be dismantled in the future (FY2026 and 2027). This detailed dismantling investigation will finally confirm the measured data.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Characterizing and mitigating coherent errors in a trapped ion quantum processor using hidden inverses

Quantum computing testbeds exhibit high-fidelity quantum control over small collections of qubits, enabling performance of precise, repeatable operations followed by measurements. Currently, these noisy intermediate-scale devices can support a sufficient number of sequential operations prior to decoherence such that near term algorithms can be performed with proximate accuracy (like chemical accuracy for quantum chemistry problems). While the results of these algorithms are imperfect, these imperfections can help bootstrap quantum computer testbed development. Demonstrations of these algorithms over the past few years, coupled with the idea that imperfect algorithm performance can be caused by several dominant noise sources in the quantum processor, which can be measured and calibrated during algorithm execution or in post-processing, has led to the use of noise mitigation to improve typical computational results. Conversely, benchmark algorithms coupled with noise mitigation can help diagnose the nature of the noise, whether systematic or purely random. Here, we outline the use of coherent noise mitigation techniques as a characterization tool in trapped-ion testbeds. We perform model-fitting of the noisy data to determine the noise source based on realistic physics focused noise models and demonstrate that systematic noise amplification coupled with error mitigation schemes provides useful data for noise model deduction. Further, in order to connect lower level noise model details with application specific performance of near term algorithms, we experimentally construct the loss landscape of a variational algorithm under various injected noise sources coupled with error mitigation techniques. This type of connection enables application-aware hardware codesign, in which the most important noise sources in specific applications, like quantum chemistry, become foci of improvement in subsequent hardware generations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Generating Synthetic Time Series Photovoltaic Data with Real-World Physical Challenges and Noise for Use in Algorithm Test and Validation

The PV Fleet Data Initiative and other projects seek the develop algorithms for automated analysis of PV time series data for extraction of statistical information and other parameters of the data such as degradation rates, soiling loss information, tracker performance, clipping or curtailment, system availability and other valuable information. While there is a vast body of PV data available for application of said extraction algorithms it is difficult to validate these algorithms because the true parameters to be extracted are not known. There has been a wide use of synthetic data in the literature for algorithm validation but this synthetic data is typically very bounded by the problem or topic at hand. The PV Fleet Data Initiative project has demonstrated that real time series PV data almost always includes a host of data quality and physical problems that, in reality, any automated PV abstraction algorithm must handle appropriately. For this reason, this work describes the development of a complex synthetic PV times series data set that includes data quality and physical problems that have been experienced in real world PV data. The various quality and physical problems are documented in the synthetic data so that users can test the validity of various PV extraction algorithms as well as develop new algorithms to solve problems this data set can support.

14 SOLAR ENERGY↗
DOE OSTI2022

Deep-learning-guided high-resolution subsurface reflectivity imaging with application to ground-penetrating radar data

Subsurface reflectivity imaging is one of the most important geophysical characterization methods for revealing subsurface structures. In many cases, accurate subsurface reflectivity imaging is challenging because of, for example, random or coherent noise in the data and sparse source-receiver observation geometry. Here, we develop a deep-learning-guided iterative imaging method to improve subsurface structure imaging. Specifically, we train a supervised neural network to infer a noise-free, high-resolution image from a noisy, low-resolution image and use this estimated image as guidance to regularize least-squares imaging. We develop a systematic method to generate high-quality synthetic training data (data-label pairs) to train the guidance neural network. The trained neural network can provide high-fidelity predictions even for field-data images that are not in the training data. We validate our new imaging method using one synthetic and two field ground-penetrating radar data examples, and find that our method can produce clean, high-resolution subsurface reflectivity images where existing single-pass and least-squares imaging methods fail due to noise and insufficient data coverage.

58 GEOSCIENCES↗
DOE OSTI2021

Analytic continuation of noisy data using Adams Bashforth residual neural network

We propose a data-driven learning framework for the analytic continuation problem in numerical quantum many-body physics. Designing an accurate and efficient framework for the analytic continuation of imaginary time using computational data is a grand challenge that has hindered meaningful links with experimental data. The standard Maximum Entropy (MaxEnt)-based method is limited by the quality of the computational data and the availability of prior information. Also, the MaxEnt is not able to solve the inversion problem under high level of noise in the data. Here we introduce a novel learning model for the analytic continuation problem using a Adams-Bashforth residual neural network (AB-ResNet). Additionally, the advantage of this deep learning network is that it is model independent and, therefore, does not require prior information concerning the quantity of interest given by the spectral function. More importantly, the ResNet-based model achieves higher accuracy than MaxEnt for data with higher level of noise. Finally, numerical examples show that the developed AB-ResNet is able to recover the spectral function with accuracy comparable to MaxEnt where the noise level is relatively small.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Likelihood-based signal and noise analysis for docking of models into cryo-EM maps

Fast, reliable docking of models into cryo-EM maps requires understanding of the errors in the maps and the models. Likelihood-based approaches to errors have proven to be powerful and adaptable in experimental structural biology, finding applications in both crystallography and cryo-EM. Indeed, previous crystallographic work on the errors in structural models is directly applicable to likelihood targets in cryo-EM. Likelihood targets in Fourier space are derived here to characterize, based on the comparison of half-maps, the direction- and resolution-dependent variation in the strength of both signal and noise in the data. Because the signal depends on local features, the signal and noise are analysed in local regions of the cryo-EM reconstruction. The likelihood analysis extends to prediction of the signal that will be achieved in any docking calculation for a model of specified quality and completeness. A related calculation generalizes a previous measure of the information gained by making the cryo-EM reconstruction.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Method for enhancing a computer to estimate an uncertainty of an onset of a signal of interest in time-series noisy data

A computer-implemented method of enhancing a computer to estimate an uncertainty of an onset of a signal of interest in time-series noisy data. A first mathematical model of first time series data that contains only noise is calculated. A second mathematical model of second time series data that contains the noise and an onset of a signal of interest in the second time series data is calculated. A difference is evaluated between a first combination, being the first mathematical model and the second mathematical model, and a second combination, being the first time series data and the second time series data, wherein evaluating is performed using a generalized entropy metric. A specific time when an onset of the signal of interest occurs is estimated from the difference. An “a posteriori” distribution is derived for an uncertainty of the specific time at which the onset occurs.

Stracuzzi, David John↗