Search NASA⌕ Search

SEARCH · Search NASA

Results for “synthetic data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Generating Synthetic Time Series Photovoltaic Data with Real-World Physical Challenges and Noise for Use in Algorithm Test and Validation

The PV Fleet Data Initiative and other projects seek the develop algorithms for automated analysis of PV time series data for extraction of statistical information and other parameters of the data such as degradation rates, soiling loss information, tracker performance, clipping or curtailment, system availability and other valuable information. While there is a vast body of PV data available for application of said extraction algorithms it is difficult to validate these algorithms because the true parameters to be extracted are not known. There has been a wide use of synthetic data in the literature for algorithm validation but this synthetic data is typically very bounded by the problem or topic at hand. The PV Fleet Data Initiative project has demonstrated that real time series PV data almost always includes a host of data quality and physical problems that, in reality, any automated PV abstraction algorithm must handle appropriately. For this reason, this work describes the development of a complex synthetic PV times series data set that includes data quality and physical problems that have been experienced in real world PV data. The various quality and physical problems are documented in the synthetic data so that users can test the validity of various PV extraction algorithms as well as develop new algorithms to solve problems this data set can support.

14 SOLAR ENERGY↗
DOE OSTI2024

Peridynamic neural operators: A data-driven nonlocal constitutive model for complex material responses

Neural operators, which can act as implicit solution operators of hidden governing equations, have recently become popular tools for learning the responses of complex real-world physical systems. Nevertheless, most neural operator applications have thus far been data-driven and neglect the intrinsic preservation of fundamental physical laws in data. Here, in this work, we introduce a novel integral neural operator architecture called the Peridynamic Neural Operator (PNO) that learns a nonlocal constitutive law from data. This neural operator provides a forward model in the form of state-based peridynamics, with objectivity and momentum balance laws automatically guaranteed. As applications, we demonstrate the expressivity and efficacy of our model in learning complex material behaviors from both synthetic and experimental data sets. We also compare the performances with baseline models that use predefined constitutive laws. We show that, owing to its ability to capture complex responses, our learned neural operator achieves improved accuracy and efficiency. Moreover, by preserving the essential physical laws within the neural network architecture, the PNO is robust in treating noisy data. The method shows generalizability to different domain configurations, external loadings, and discretizations.

42 ENGINEERING↗
DOE OSTI2022

Transient Storage Model Parameter Optimization Using the Simulated Annealing Method

Hyporheic exchange in streams is critical to ecosystem functions such as nutrient cycling along river corridors, especially for slowly moving or small stream systems. The transient storage model (TSM) has been widely used for modeling of hyporheic exchange. TSM calibration, for hyporheic exchange, is typically used to estimate four parameters, including the mass exchange rate coefficient, the dispersion coefficient, stream cross-sectional area, and hyporheic zone cross-sectional area. Prior studies have raised concerns regarding the non-uniqueness of the inverse problem for the TSM, that is, the occurrence of different parameter vectors resulting in TSM solution that reproduces the observed in-stream tracer break through curve (BTC) with the same error. This leads to practical non-identifiability in determining the unknown parameter vector values even when global-optimal values exist, and the parameter optimization becomes practically non-unique. To address this problem, we applied the simulated annealing method to calibrate the TSM to BTCs, because it is less susceptible to local minima-induced non-identifiability. A hypothetical (or synthetic) tracer test data set with known parameters was developed to demonstrate the capability of the simulated annealing method to find the global minimum parameter vector, and it identified the “hypothetically-true” global minimum parameter vector even with input data that were modified with up to 10% noise without increasing the number of iterations required for convergence. The simulated annealing TSM was then calibrated using two in-stream tracer tests conducted in East Fork Poplar Creek, Tennessee. In conclusion, simulated annealing was determined to be appropriate for quantifying the TSM parameter vector because of its search capability for the global minimum parameter vector.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Matrix Completion for Improved Observability in Low-Voltage Distribution Grids

This paper considers the problem of recovering missing entries in a partially observed matrix from relatively few measurements (i.e., the so-called matrix completion problem) with the aim of increasing the presently limited observability of low-voltage distribution grids. To this end, the partially observed matrix is formed using scarce voltage magnitude measurements while accounting for their spatial information. Voltage readings are assumed to be collected from distribution utility sensors and/or geographically-distributed cable television network sensors located in immediate proximity to distribution grid nodes. A matrix completion approach built on the parameter-less singular value shrinkage technique is used to estimate voltage magnitudes at otherwise non-observable low-voltage nodes using a small number of single- or multiple-snapshot data. The effectiveness of the proposed approach is demonstrated using a U.S.-style distribution test system from the synthetic SMART- DS data set under very low- to moderate-observability conditions.

low-rank matrix completion↗
NASA NTRS1984

The spatial evolution of t he directional wave spectrum in the Southern Ocean: Its relation to extreme waves in Agulhas Current

An experiment using the Shuttle Imaging Radar-B (SIR-B) to monitor certain properties of the ocean wave directional spectrum and to track the long swell systems as they propagate northward to encounter the Agulhas near the southeastern coast of Africa is discussed. The experiment is designed around the unique capability of SIR-B to overcome key limitations of the Seasat synthetic aperture radar data set, and to extend the existing Seasat results into new areas. Ocean wave systems will be tracked. The variable-incidence-angle capability to examine wave imaging quality will be utilized. Doppler current measurements will be attempted. An effort will be made to verify that the lower range-to-velocity ratio of SIR-B will lead to the improved response of azimuth-traveling wave systems.

Beal, R. C.↗
DOE OSTI2023

Source-encoded waveform inversion in the Northern Hemisphere

SUMMARY We use source-encoded waveform inversion to image Earth’s Northern Hemisphere. The encoding method is based on measurements of Laplace coefficients of stationary wavefields. By assigning to each event a unique frequency, we compute Fréchet derivatives for all events simultaneously based on one ‘super’ forward and one ‘super’ adjoint simulation for a small fraction of the computational cost of classical waveform inversion with the same data set. No cross-talk noise is introduced in the process, and the method does not require all events to be recorded by all stations. Starting from global model GLAD_M25, we performed 100 conjugate gradient iterations using a data set consisting of 786 earthquakes recorded by 9846 stations. Synthetic inversion tests show that we achieve good convergence based on this data set, and we see a consistent misfit reduction during the inversion. The new model, named SE100, has much higher spatial resolution than GLAD_M25, revealing details of the Yellowstone and Iceland hotspots, subduction beneath the Western United States and the upper mantle structure beneath the Arctic Ocean.

Cui, Congyue↗
NASA NTRS1982

Report on the subpanel on remapping procedures

Problems associated with remapping procedures are defined and research tasks are proposed. It is noted that the remapping/rectification process could be significantly aided through engineering systems improvements in attitude control, with subsequent improvement in spacecraft ephemeris modeling accuracy. There is a need for state-of-the-art technology assessments prior to initiation of major programs, and the high potential return from well formulated testing of algorithms on selected data sets of actual and synthetic imagery. In addition, there is a need for tasks that incorporate standard photogrammetric methodology and formulas and that more fully utilize platform and calibration data from current and proposed sensors to reproject digital imagery. The impact of improved platform stability and integration of global positioning system measurements on reduced ground segment processing needs to be critically assessed. Also highlighted is the need for a substantial effort in the development of remapping software and systems that are modular and transportable.

Source record↗
DOE OSTI2025

Contrasting Time-Frequency Representations for Unknown Waveform Detection

Identifying unseen electromagnetic waveforms is critical for many applications, like interference management, electronic warfare and spectrum management. Traditionally this is done using statistical methods for anomaly detection, which has evolved to deep learning models for identifying the unseen data, formally termed as open set recognition. Some prior methods use a generative model to emulate open set data, which face challenges in generating synthetic samples for open set while simultaneously selecting an optimal discriminator for accurate classification. To alleviate this issue, we propose a discriminative model that effectively combines time and frequency domain features of communication signals for accurate predictions. We further introduce a cosine similarity loss that makes the domain specific features unique to enhance the prediction rate. Additionally, our model avoids generic feature vectors by extracting class-specific features during training, resulting in improved class representation. The experiment results show that this combined feature approach with cosine loss outperforms single-domain models and improves accuracy by 10% over models without cosine loss.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Fusion product measurements by nuclear diagnostics in the Joint European Torus deuterium–tritium 2 campaign (invited)

We report a new deuterium–tritium experimental, DTE2, campaign has been conducted at the Joint European Torus (JET) between August 2021 and late December 2021. Motivated by significant enhancements in the past decade at JET, such as the ITER-like wall and enhanced auxiliary heating power, the campaign achieved a new fusion energy world record and performed a broad range of fundamental experiments to inform ITER physics scenarios and operations. New capabilities in the area of fusion product measurements by nuclear diagnostics were available as a result of a decade long enhancement program. These have been tested for the first time in DTE2 and a concise overview is provided here. Confined alpha particle measurements by gamma-ray spectroscopy were successfully demonstrated, albeit with limitations at neutron rates higher than some 10 17 n/s. High resolution neutron spectroscopy measurements with the magnetic proton recoil instrument were complemented by novel data from a set of synthetic diamond detectors, which enabled studies of the supra-thermal contributions to the neutron emission. In the area of escaping fast ion diagnostics, a lost fast ion detector and a set of Faraday cups made it possible to determine information on the velocity space and poloidal distribution of the lost alpha particles for the first time. This extensive set of data provides unique information for fundamental physics studies and validation of the numerical models, which are key to inform the physics and scenarios of ITER.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS2003

Fine Resolution Topographic Mapping of the Jovian Moons: A Ka-Band High Resolution Topographic Mapping Interferometric Synthetic Aperture Radar

The topographic data set obtained by MOLA has provided an unprecedented level of information about Mars' geologic features. The proposed flight of JIMO provides an opportunity to accomplish a similar mapping of and comparable scientific discovery for the Jovian moons through use of an interferometric imaging radar analogous to the Shuttle radar that recently generated a new topographic map of Earth. A Ka-band single pass across-track synthetic aperture radar (SAR) interferometer can provide very high resolution surface elevation maps. The concept would use two antennas mounted at the ends of a deployable boom (similar to the Shuttle Radar Topographic Mapper) extended orthogonal to the direction of flight. Assuming an orbit altitude of approximately 100km and a ground velocity of approximately 1.5 km/sec, horizontal resolutions at the 10 meter level and vertical resolutions at the sub-meter level are possible.

Madsen, S. N.↗
NASA NTRS2003

Fine resolution topographic mapping of the Jovian moons: a Ka-band high resolution topographic mapping interferometric synthetic aperture radar

The topographic data set obtained by MOLA has provided an unprecedented level of information about Mars' geologic features. The proposed flight of JIMO provides an opportunity to accomplish a similar mapping of and comparable scientific discovery for the Jovian moons through us of an interferometric imaging radar analogous to the Shuttle radar that recently generated a new topographic map of Earth. A Ka-band single pass across-track synthetic aperture radar (SAR) interferometer can provide very high resolution surface elevation maps. The concept would use two antennas mounted at the ends of a deployable boom (similar to the Shuttle Radar Topographic Mapper) extended orthogonal to the direction of flight. Assuming an orbit altitude of approximately 100 km and a ground velocity of approximately 1.5 km/sec, horizontal resolutions at the 10 meter level and vertical resolutions at the sub-meter level are possible.

Jupiter Icy Moon Orbiter↗
NASA NTRS2003

A Fast Implementation of the ISOCLUS Algorithm

Unsupervised clustering is a fundamental tool in numerous image processing and remote sensing applications. For example, unsupervised clustering is often used to obtain vegetation maps of an area of interest. This approach is useful when reliable training data are either scarce or expensive, and when relatively little a priori information about the data is available. Unsupervised clustering methods play a significant role in the pursuit of unsupervised classification. One of the most popular and widely used clustering schemes for remote sensing applications is the ISOCLUS algorithm, which is based on the ISODATA method. The algorithm is given a set of n data points (or samples) in d-dimensional space, an integer k indicating the initial number of clusters, and a number of additional parameters. The general goal is to compute a set of cluster centers in d-space. Although there is no specific optimization criterion, the algorithm is similar in spirit to the well known k-means clustering method in which the objective is to minimize the average squared distance of each point to its nearest center, called the average distortion. One significant feature of ISOCLUS over k-means is that clusters may be merged or split, and so the final number of clusters may be different from the number k supplied as part of the input. This algorithm will be described in later in this paper. The ISOCLUS algorithm can run very slowly, particularly on large data sets. Given its wide use in remote sensing, its efficient computation is an important goal. We have developed a fast implementation of the ISOCLUS algorithm. Our improvement is based on a recent acceleration to the k-means algorithm, the filtering algorithm, by Kanungo et al.. They showed that, by storing the data in a kd-tree, it was possible to significantly reduce the running time of k-means. We have adapted this method for the ISOCLUS algorithm. For technical reasons, which are explained later, it is necessary to make a minor modification to the ISOCLUS specification. We provide empirical evidence, on both synthetic and Landsat image data sets, that our algorithm's performance is essentially the same as that of ISOCLUS, but with significantly lower running times. We show that our algorithm runs from 3 to 30 times faster than a straightforward implementation of ISOCLUS. Our adaptation of the filtering algorithm involves the efficient computation of a number of cluster statistics that are needed for ISOCLUS, but not for k-means.

Memarsadeghi, Nargess↗
DOE OSTI2022

Kinetics-Informed Neural Networks

Chemical kinetics and reaction engineering consists of the phenomenological framework for the disentanglement of reaction mechanisms, optimization of reaction performance and the rational design of chemical processes. Here, we utilize feed-forward artificial neural networks as basis functions to solve ordinary differential equations (ODEs) constrained by differential algebraic equations (DAEs) that describe microkinetic models (MKMs). We present an algebraic framework for the mathematical description and classification of reaction networks, types of elementary reaction, and chemical species. Under this framework, we demonstrate that the simultaneous training of neural nets and kinetic model parameters in a regularized multi-objective optimization setting leads to the solution of the inverse problem through the estimation of kinetic parameters from synthetic experimental data. We analyze a set of scenarios to establish the extent to which kinetic parameters can be retrieved from transient kinetic data, and assess the robustness of the methodology with respect to statistical noise. Furthermore, this approach to inverse kinetic ODEs can assist in the elucidation of reaction mechanisms based on transient data.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Resonant anomaly detection with multiple reference datasets

An important class of techniques for resonant anomaly detection in high energy physics builds models that can distinguish between reference and target datasets, where only the latter has appreciable signal. Such techniques, including Classification Without Labels (CWoLa) and Simulation Assisted Likelihood-free Anomaly Detection (SALAD) rely on a single reference dataset. They cannot take advantage of commonly available multiple datasets and thus cannot fully exploit available information. In this work, we propose generalizations of CWoLa and SALAD for settings where multiple reference datasets are available, building on weak supervision techniques. We demonstrate improved performance in a number of settings with realistic and synthetic data. As an added benefit, our generalizations enable us to provide finite-sample guarantees, improving on existing asymptotic analyses.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

A Novel Data Segmentation Method for Data-driven Phase Identification

This paper presents a smart meter phase identification algorithm for two cases: meter-phase-label-known and meter-phase-label-unknown. To improve the identification accuracy, a data segmentation method is proposed to exclude data segments that are collected when the voltage correlation between smart meters on the same phase is weakened. Then, using the selected data segments, a hierarchical clustering method is used to calculate the correlation distances and cluster the smart meters. If the phase labels are unknown, a Connected-Triple-based Similarity (CTS) method is adapted to further improve the phase identification accuracy of the ensemble clustering method. The methods are developed and tested on both synthetic and real feeder data sets. Here, simulation results show that the proposed phase identification algorithm outperforms the state-of-the-art methods in both accuracy and robustness.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Advanced stationary and nonstationary kernel designs for domain-aware Gaussian processes

Gaussian process regression is a widely-applied method for function approximation and uncertainty quantification. The technique has gained popularity recently in the machine learning community due to its robustness and interpretability. The mathematical methods we discuss in this paper are an extension of the Gaussian-process framework. We are proposing advanced kernel designs that only allow for functions with certain desirable characteristics to be elements of the reproducing kernel Hilbert space (RKHS) that underlies all kernel methods and serves as the sample space for Gaussian process regression. These desirable characteristics reflect the underlying physics; two obvious examples are symmetry and periodicity constraints. In addition, non-stationary kernel designs can be defined in the same framework to yield flexible multi-task Gaussian processes. We will show the impact of advanced kernel designs on Gaussian processes using several synthetic and two scientific data sets. The results of our research show that including domain knowledge, communicated through advanced kernel designs, has a significant impact on the accuracy and relevance of the function approximation.

97 MATHEMATICS AND COMPUTING↗