Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data noise”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A New Method for Deriving Composition of S-type Asteroids from Noisy and Incomplete Near-infrared Spectra

The surface composition of S-type asteroids can be determined using band parameters extracted from their near-infrared (NIR) spectra (0.7–2.50 μm) along with spectral calibrations derived from laboratory samples. In the past, these empirical equations have been obtained by combining NIR spectra of meteorite samples with information about their composition and mineral abundance. For these equations to give accurate results, the characteristics of the laboratory spectra they are derived from should be similar to those of asteroid spectral data (i.e., similar signal-to-noise ratio (S/N) and wavelength range). Here we present new spectral calibrations that can be used to determine the mineral composition of ordinary chondrite-like S-type asteroids. Contrary to previous work, the S/N of the ordinary chondrite spectra used in this study has been decreased to recreate the S/N typically observed among asteroid spectra, allowing us to obtain more realistic results. In addition, the new equations have been derived for five wavelength ranges encompassed between 0.7 and 2.50 μm, making it possible to determine the composition of asteroids with incomplete data. The new spectral calibrations were tested using band parameters measured from the NIR spectrum of asteroid (25143) Itokawa, and comparing the results with laboratory measurements of the returned samples. We found that the spectrally derived olivine and pyroxene chemistry, which are given by the molar contents of fayalite (Fa) and ferrosilite (Fs), are in excellent agreement with the mean values measured from the samples (Fa{sub 28.6±1.1} and Fs{sub 23.1±2.2}), with a maximum difference of 0.6 mol% for Fa and 1.4 mol% for Fs.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

High-dimensional Data-driven Energy optimization for Multi-Modal Transit Agencies (HD-EMMA) (Final Technical Report)

Public bus transit services in the U.S. are responsible for at least 19.7 million metric tons of CO 2 emission annually. Electric vehicles (EVs) can have a much lower environmental impact than comparable internal combustion engine vehicles (ICEVs), especially in urban areas. Unfortunately, EVs are also much more expensive than ICEVs. As a result, many public transit agencies can afford only mixed fleets of transit vehicles, consisting of EVs, hybrids (HEVs), and ICEVs. Transit agencies that operate such mixed fleets of vehicles face a challenging optimization problem: these agencies need to decide which vehicles are assigned to serving which transit trips. Since the advantage of EVs over ICEVs varies depending on the route and time of day (e.g., the benefit of EVs is higher in slower traffic with frequent stops and lower on highways), the assignment can have a significant effect on energy use and, hence, environmental impact. Through this project, we have developed reference data about energy collections and constructed a set of machine learning models that can accurately predict the energy consumption for the whole fleet at the level of each trip. We have used these models to develop a scheduling and assignment strategy that can rotate the different vehicle types across the transit agencies’ routes. The optimization algorithm ensures that the vehicles are matched to trips considering weather patterns, expected congestion, and road gradients to minimize the overall energy usage. We list the key observations from our project for other practitioners below. Details are available in the report, and the list of source code and our publications are included in the appendix. 1. We have demonstrated the feasibility of collecting, merging and analyzing large volumes of high-resolution real-world telemetry data from a mixed vehicle fleet. To mitigate the inherent noise of the recorded GPS points, the team developed an algorithm that filters data and maps the points onto a street. The algorithm considers previous and subsequent location measurements and different characteristics of nearby streets to determine how likely the vehicle travels on them. Then, the team segmented the time series into disjoint contiguous samples based on adjacent road segments and repeated the outlier detection and removal. For each data point, the team added features corresponding to elevation changes within the samples, weather features, such as temperature, and traffic data, such as speed ratio between actual speed and free-flow speed. 2. We have developed two forms of machine learning models that be used to understand and analyze the energy operations of a mixed vehicle transit fleet. The micro prediction model provides estimates of instantaneous energy prediction for all types of buses (diesel, hybrid, and electric). Such a model is important in evaluating the energy impacts of real-time bus operation strategies, but it is challenging due to diversified driving cycles of transit buses. The model can help the drivers understand the impact of their driving behaviors and short-term congestions. The macro prediction models estimate average energy consumption across the whole trip considering the features: distance traveled, various road-type features, elevation change, day of the week, time of day, various weather features (temperature, humidity, etc.), and traffic features (speed ratio and jam factor). 3. We have demonstrated that it is possible to transfer the machine learning models we have developed in this project to other teams and cities by using inductive transfer learning. We also showed that the performance of the macro energy prediction models can be improved using a multi-task learning approach where the learning parameters are shared between the models being developed for different vehicle types. The advantage of this approach is improved learning performance as the models can exploit common spatio-temporal and environmental characteristics. 4. Finally, we have developed trip and vehicle assignment and scheduling algorithms that use the energy prediction models and develop a trip to vehicle type (diesel, electric, hybrid) assignment for the whole operation to reduce overall emissions and cost. We have shown through simulations that the proposed algorithms can save $\$$ 48,910 in energy costs and 175 metric tons of CO 2 emission annually for CARTA.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Drifting Acoustic Measurements around C-Power's SeaRay WEC

The repository contains underwater noise measurements and associated metadata collected around C-Power's SeaRay wave energy converter on July 15, 2024 and July 16, 2024 while it was deployed at the U.S. Navy's Wave Energy Test Site (WETS) in Kaneohe, HI. Measurements were obtained using Drifting Acoustic Instrumentation SYstems (DAISYs). DAISYs consist of a surface expression connected to a hydrophone recording package by a tether. Both elements are instrumented to provide metadata (e.g., position, orientation, and depth). Information about how to build DAISYs is available at https://www.pmec.us/research-projects/daisy. The repository's primary content is a compressed archive (.zip format), containing multiple MATLAB binary data files (.mat format). The structure of each file is included in the repository as a Word document (Data Description MHK-DR.docx). Each file contains time series information for a single DAISY deployment (file naming convention: WETS_DAISY_[Drift #].mat) consisting of processed hydrophone data and associated metadata. During these measurements, C-Power's SeaRay was located at approximately 21.48112 N, 157.74451 W.

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

Generative network-based approaches to generate stochastic realizations

Generative Adversarial Network (GAN) – based models have been successfully applied in generating different geological models in the literature. However, it is still challenging to use GAN to generate geological realizations with extremely sparse conditioning data (e.g. several well data), which may be regarded as local noise by GAN during the training process. In this work, we propose a novel conditional Generative Adversarial Neural Operator (cGANO) to tackle this challenge. In cGANO, the mapping between conditioning data and output is established through the U-shaped neural operators (UNO), which better preserves local information. Another advantage of using UNO comes from its grid-independent property, which makes the generation of downscaling stochastic geologic realizations possible. We tested the model performance on the IBDP geostatistical dataset with 100 realizations.

58 GEOSCIENCES↗
DOE OSTI2023

BEYONDPLANCK XIII. Intensity foreground sampling, degeneracies, and priors

We present the intensity foreground algorithms and model employed within the BEYONDPLANCK analysis framework. The BEYONDPLANCK analysis is aimed at integrating component separation and instrumental parameter sampling within a global framework, leading to complete end-to-end error propagation in the Planck Low Frequency Instrument (LFI) data analysis. Given the scope of the BEYONDPLANCK analysis, a limited set of data is included in the component separation process, leading to foreground parameter degeneracies. In order to properly constrain the Galactic foreground parameters, we improve upon the previous Commander component separation implementation by adding a suite of algorithmic techniques. These algorithms are designed to improve the stability and computational efficiency for weakly constrained posterior distributions. These are: (1) joint foreground spectral parameter and amplitude sampling, building on ideas from MIRAMARE; (2) component-based monopole determination; (3) joint spectral parameter and monopole sampling; and (4) application of informative spatial priors for component amplitude maps. We find that the only spectral parameter with a significant signal-to-noise ratio using the current BEYONDPLANCK data set is the peak frequency of the anomalous microwave emission component, for which we find $ν$ p = 25.3 ± 0.5 GHz; all others must be constrained through external priors. Future works will be aimed at integrating many more data sets into this analysis, both map and time-ordered based, thereby gradually eliminating the currently observed degeneracies in a controlled manner with respect to both instrumental systematic effects and astrophysical degeneracies. When this happens, the simple LFI-oriented data model employed in the current work will need to be generalized to account for both a richer astrophysical model and additional instrumental effects. This work will be organized within the Open Science-based COSMOGLOBE community effort.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

BEYONDPLANCK VI. Noise characterization and modeling

We present a Bayesian method for estimating instrumental noise parameters and propagating noise uncertainties within the global BeyondPlanck Gibbs sampling framework, and apply this to Planck Low Frequency Instrument (LFI) time-ordered data. Following previous literature, we initially adopt a 1/ f model for the noise power spectral density (PSD), but find the need for an additional lognormal component in the noise model for the 30 and 44 GHz bands. We implement an optimal Wiener-filter (or constrained realization) gap-filling procedure to account for masked data. We then use this procedure to both estimate the gapless correlated noise in the time-domain, n corr , and to sample the noise PSD parameters, ξ n = {σ 0 , f knee , α, A p }. In contrast to previous Planck analyses, we assume piecewise stationary noise only within each pointing period (PID), not throughout the full mission, but we adopt the LFI Data Processing Center (DPC) results as priors on α and f knee . On average, we find best-fit correlated noise parameters that are mostly consistent with previous results, with a few notable exceptions. However, a detailed inspection of the time-dependent results reveals many important findings. First and foremost, we find strong evidence for statistically significant temporal variations in all noise PSD parameters, many of which are directly correlated with satellite housekeeping data. Second, while the simple 1/ f model appears to be an excellent fit for the LFI 70 GHz channel, there is evidence for additional correlated noise not described by a 1/ f model in the 30 and 44 GHz channels, including within the primary science frequency range of 0.1–1 Hz. In general, most 30 and 44 GHz channels exhibit deviations from 1/ f at the 2–3σ level in each one hour pointing period, motivating the addition of the lognormal noise component for these bands. For some periods of time, we also find evidence of strong common mode noise fluctuations across the entire focal plane. Overall, we conclude that a simple 1/ f profile is not adequate to fully characterize the Planck LFI noise, even when fitted hour-by-hour, and a more general model is required. These findings have important implications for large-scale CMB polarization reconstruction with the Planck LFI data, and the current work is a first attempt at understanding and mitigating these issues.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Learning Constitutive Relations From Soil Moisture Data via Physically Constrained Neural Networks

Abstract The constitutive relations of the Richardson‐Richards equation encode the macroscopic properties of soil water retention and conductivity. These soil hydraulic functions are commonly represented by models with a handful of parameters. The limited degrees of freedom of such soil hydraulic models constrain our ability to extract soil hydraulic properties from soil moisture data via inverse modeling. We present a new free‐form approach to learning the constitutive relations using physically constrained neural networks. We implemented the inverse modeling framework in a differentiable modeling framework, JAX, to ensure scalability and extensibility. For efficient gradient computations, we implemented implicit differentiation through a nonlinear solver for the Richardson‐Richards equation. We tested the framework against synthetic noisy data and demonstrated its robustness against varying magnitudes of noise and degrees of freedom of the neural networks. We applied the framework to soil moisture data from an upward infiltration experiment and demonstrated that the neural network‐based approach was better fitted to the experimental data than a parametric model and that the framework can learn the constitutive relations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

The Squeezed Bispectrum from CHIME H I Emission and Planck Cosmic Microwave Background Lensing: Current Sensitivity and Forecasts

Line intensity mapping using atomic hydrogen (H I) has the potential to efficiently map large volumes of the Universe if the signal can be successfully separated from overwhelmingly bright radio foreground emission. This motivates cross correlations, to ascertain the cosmological nature of measured H I fluctuations, and to study their connections with galaxies and the underlying matter density field. However, these same foregrounds render the cross correlation with projected fields such as the lensing of the cosmic microwave background (CMB) difficult. Indeed, the correlated Fourier modes vary slowly along the line of sight and are thus most contaminated by the smooth-spectrum radio continuum foregrounds. In this paper, we implement a method that avoids this issue by attempting to measure the nonlinear gravitational coupling of the small-scale 21 cm power from the Canadian Hydrogen Intensity Mapping Experiment (CHIME) with large-scale Planck CMB lensing. This measurement is a position-dependent power spectrum, i.e., a squeezed integrated bispectrum. Using 94 nights of CHIME data between 1.0 < z < 1.3 and aggressive foreground filtering, we find that the expected signal is 5 times smaller than the current noise. We forecast that incorporating the additional nights of CHIME data already collected would enable a signal-to-noise ratio of 3, without any further improvements in filtering for foreground cleaning.

21cm↗
DOE OSTI2020

Development of an MEMS ultrasonic microphone array system and its application to compressed wavefield imaging of concrete

Abstract Although contactless ultrasonic wavefield imaging shows potential for effective nondestructive inspection of various engineering materials, it has been rarely applied to concrete materials owing to technical challenges including low signal-to-noise ratio (SNR) caused by inherent heterogeneity of concrete. This paper presents development of a multi-channel MEMS ultrasonic microphone array system and its application to compressed wavefield imaging of concrete materials. The developed multi-channel MEMS ultrasonic microphone array system contains eight MEMS ultrasonic microphone elements and a signal conditioning circuit that enables measurements of ultrasonic signals with high SNR. A compressed sensing approach, based on the multiple measurement vector (MMV) concept, is applied to reconstruct a full dense ultrasonic wavefield data from sparsely sampled ultrasonic wavefield data. Experiments are carried out on a laboratory concrete sample to verify the performance of the developed MEMS microphone array system and proposed compressed sensing approach and then large-scale concrete samples to demonstrate practical application. The experimental results demonstrate that the developed MEMS microphone array system provides high-quality (SNR > 20 dB) ultrasonic data collected from concrete elements; furthermore, the proposed compressed sensing approach provides accurate reconstruction of dense wavefield data, as determined by peak signal-to-noise ratio (PSNR), from sparsely measured wavefield data with compression ratios up to 85% and PSNR above 25 dB in data collected form realistic large-scale concrete samples. By combining the MEMS array system and compressed sensing approach, the total ultrasonic data acquisition time needed to produce dense wavefield data can be significantly reduced.

Instruments & Instrumentation↗
DOE OSTI2023

Cross-correlating radial peculiar velocities and CMB lensing convergence

We study, for the first time, the cross correlation between the angular distribution of radial peculiar velocities (PV) and the lensing convergence of cosmic microwave background (CMB) photons. We derive theoretical expectations for the signal and its covariance and assess its detectability with existing and forthcoming surveys. We find that such cross-correlations are expected to improve constraints on different gravitational models by partially breaking degeneracies with the matter density. We identify in the distance-scaling dispersion of the peculiar velocities the most relevant source of noise in the cross correlation. For this reason, we also study how the above picture changes assuming a redshift-independent scatter for the PV, obtained for example using a reconstruction technique. Our results show that the cross correlation might be detected in the near future combining PV measurements from DESI and the convergence map from CMB-S4. Using realistic direct PV measurements we predict a cumulative signal-to-noise ratio of approximately 3.8σ using data on angular scales 3 ≤ ℓ ≤ 200. For an idealized reconstructed peculiar velocity map extending up to redshift z = 0.15 and a smoothing scale of 4 Mpc h -1 we predict a cumulative signal-to-noise ratio of approximately 27σ from angular scales 3 ≤ ℓ ≤ 200. We conclude that currently reconstructed peculiar velocities have more constraining power than directly observed ones, even though they are more cosmological-model dependent.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

A novel method for thermal noise reduction, enabling measurements of broadband, low-amplitude electron temperature fluctuations using individual radiometer channels

A new analysis method has been developed for measurements of broadband, low-amplitude turbulent electron temperature fluctuations in fusion plasmas using individual radiometer channels of a correlation electron cyclotron emission diagnostic. This method takes advantage of differences in the correlation time of thermal noise compared to the correlation time of plasma fluctuations in fusion reactors. The validation of this single-channel method is demonstrated using comparisons with the standard dual-channel radiometer spectral decorrelation method for measurements of turbulent electron temperature fluctuations in the core and edge of low confinement (L), improved confinement (I), and high confinement (H)-mode plasmas at the ASDEX Upgrade tokamak.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Sparse measurement medical CT reconstruction using multi-fused block matching denoising priors

A major challenge for medical X-ray CT imaging is reducing the number of X-ray projections to lower radiation dosage and reduce scan times without compromising image quality. However these under-determined inverse imaging problems rely on the formulation of an expressive prior model to constrain the solution space while remaining computationally tractable. Traditional analytical reconstruction methods like Filtered Back Projection (FBP) often fail with sparse measurements, producing artifacts due to their reliance on the Shannon-Nyquist Sampling Theorem. Consensus Equilibrium, which is a generalization of Plug and Play, is a recent advancement in Model-Based Iterative Reconstruction (MBIR), has facilitated the use of multiple denoisers are prior models in an optimization free framework to capture complex, non-linear prior information. However, 3D prior modelling in a Plug and Play approach for volumetric image reconstruction requires long processing time due to high computing requirement. Instead of directly using a 3D prior, this work proposes a BM3D Multi Slice Fusion (BM3D-MSF) prior that uses multiple 2D image denoisers fused to act as a fully 3D prior model in Plug and Play reconstruction approach. Our approach does not require training and are thus able to circumvent ethical issues related with patient training data and are readily deployable in varying noise and measurement sparsity levels. In addition, reconstruction with the BM3D-MSF prior achieves similar reconstruction image quality as fully 3D image priors, but with significantly reduced computational complexity. We test our method on clinical CT data and demonstrate that our approach improves reconstructed image quality.

Hossain, Maliha [ORNL]↗
DOE OSTI2021

Synergistic data analytics for electromechanical oscillation in electric power systems

Accurate real-time estimation of the four electromechanical oscillation properties, i.e., dominant oscillation modes, mode shapes, participation factors, and coherent groups, is of great importance to assess and mitigate potential electromechanical oscillations in interconnected power systems. While eigenvalue analysis can realize such estimation, it requires precise linearized dynamic models and accurate parameters, which are highly difficult to obtain in practice. Data fusion-based modal estimation methods can extract the properties of electromechanical oscillations from measurement data without the power system model and parameters, but most of the time only one or two property assessments can be accomplished each time. To overcome this challenge, this paper presents a synergistic data analytics solution to characterize the dynamic behaviors of electromechanical oscillations from real-time measurement data. Here, the proposed method uses optimized variable projection, and it is capable of estimating all four electromechanical oscillation behavior properties from measured responses. Case studies are performed using the simulated measurement data of a 16-generator 68-bus test system and the field measurements collected by the PMUs deployed in the Yunnan Power Grid. The results demonstrate that the proposed synergistic data analytics solution can achieve satisfactory performance in capturing the properties of electromechanical oscillations from measurement data and exhibit strong robustness against measurement noise when compared with existing measurement-based methods.

42 ENGINEERING↗
DOE OSTI2021

Recent Advances in Machine Learning for Fiber Optic Sensor Applications

Over the last three decades, fiber optic sensors (FOS) have gained a lot of attention for their wide range of monitoring applications across many industries, including aerospace, defense, security, civil engineering, and energy. FOS technologies hold great promise to form the backbone for next‐generation intelligent sensing platforms that offer long‐distance, high‐accuracy, distributed measurement capabilities and multiparametric monitoring with resilience to harsh environmental conditions. The major limitations posed by FOS are 1) cross‐sensitivity, 2) enormous volume and large data generation, 3) low data processing speed, 4) degradation of signal‐to‐noise ratio over the fiber length, and 5) overall cost of sensor and interrogator systems. These challenges can be overcome by building advanced data analytics engines enabled by recent breakthroughs in machine learning (ML) and artificial intelligence (AI). This article presents a comprehensive review of recent studies that integrate ML and AI algorithms with FOS technologies. This review also highlights several FOS technology development directions that promise a significant impact on widespread use for several industrial applications, with an emphasis on energy systems monitoring. A perspective on future directions for further research development is also provided.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Translation and rotation equivariant normalizing flow (TRENF) for optimal cosmological analysis

ABSTRACT Our Universe is homogeneous and isotropic, and its perturbations obey translation and rotation symmetry. In this work, we develop translation and rotation equivariant normalizing flow (TRENF), a generative normalizing flow (NF) model which explicitly incorporates these symmetries, defining the data likelihood via a sequence of Fourier space-based convolutions and pixel-wise non-linear transforms. TRENF gives direct access to the high dimensional data likelihood p(x|y) as a function of the labels y, such as cosmological parameters. In contrast to traditional analyses based on summary statistics, the NF approach has no loss of information since it preserves the full dimensionality of the data. On Gaussian random fields, the TRENF likelihood agrees well with the analytical expression and saturates the Fisher information content in the labels y. On non-linear cosmological overdensity fields from N-body simulations, TRENF leads to significant improvements in constraining power over the standard power spectrum summary statistic. TRENF is also a generative model of the data, and we show that TRENF samples agree well with the N-body simulations it trained on, and that the inverse mapping of the data agrees well with a Gaussian white noise both visually and on various summary statistics: when this is perfectly achieved the resulting p(x|y) likelihood analysis becomes optimal. Finally, we develop a generalization of this model that can handle effects that break the symmetry of the data, such as the survey mask, which enables likelihood analysis on data without periodic boundaries.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Reactive particle-tracking solutions to a benchmark problem on heavy metal cycling in lake sediments

Geochemical systems are known to exhibit highly variable spatiotemporal behavior. This may be observed both in non-smooth concentration curves in space for a single sampling time and also in variability between samples taken from the same location at different times. However, most models that are designed to simulate these systems provide only single-solution smooth curves and fail to capture the noise and variability seen in the data. We apply a recently developed reactive particle-tracking method to a system that displays highly complex geochemical behavior. When the method is made to most closely resemble a corresponding Eulerian method, in its unperturbed form, we see near-exact match between solutions of the two models. More importantly, we consider two approaches for perturbing the model and find that the spatially-perturbed condition is able to capture a greater degree of the variability present in the data. This method of perturbation is a task to which particle methods are uniquely suited and Eulerian models are not well-suited. Additionally, because of the nature of the algorithm, noisy spatial gradients can be highly resolved by a large number of mobile particles, and this incurs negligible computational cost, as compared to expensive chemistry calculations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

On the measurement of hardness at high strain rates by nanoindentation impact testing

Recent advances in electronics have enabled nanomechanical measurements with very low noise, fast time constants and high data acquisition rates. Furthermore, these capabilities open the door for a wide range of ultra-fast nanomechanical testing. Given the inherent dynamic nature of high-speed testing, a thorough understanding of the testing system's dynamics and electronics is extremely important for accurate measurements. In this work, an analytical framework that includes the mechanical and electronic contributions of the instrument and the material constitutive response is presented to provide guidelines for performing high strain rate measurements of hardness by nanoindentation testing. Simple closed-form solutions that provide insights on the choice of test methodology, test parameters and instrument design are presented along with the strain rate range over which accurate measurements can be performed with the commercially available nanoindenters.

36 MATERIALS SCIENCE↗