Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data noise”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Fault Detection via Occupation Kernel Principal Component Analysis

Reliable operation of automatic systems is heavily dependent on the ability to detect faults in the underlying dynamics. While traditional model-based methods have been widely used for fault detection, data-driven approaches have garnered increasing attention due to their ease of deployment and minimal need for expert knowledge. In this letter, we present a novel principal component analysis (PCA) method that uses occupation kernels. Occupation kernels result in feature maps that are tailored to the measured data, have inherent noise-robustness due to the use of integration, and can utilize irregularly sampled system trajectories of variable lengths for PCA. The occupation kernel PCA method is used to develop a reconstruction error approach to fault detection and its efficacy is validated using numerical simulations.

42 ENGINEERING↗
DOE OSTI2020

Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations

For centuries, flow visualization has been the art of making fluid motion visible in physical and biological systems. Although such flow patterns can be, in principle, described by the Navier-Stokes equations, extracting the velocity and pressure fields directly from the images is challenging. We addressed this problem by developing hidden fluid mechanics (HFM), a physics-informed deep-learning framework capable of encoding the Navier-Stokes equations into the neural networks while being agnostic to the geometry or the initial and boundary conditions. We demonstrate HFM for several physical and biomedical problems by extracting quantitative information for which direct measurements may not be possible.

Raissi, Maziar↗
DOE OSTI2021

Utah FORGE: Seismic Velocity Models, February 2021

This dataset contains a map, showing the Utah FORGE seismic stations, and seismic velocity model data. There are 61 1-D velocity models which are in a compressed TAR file. A paper is referenced at the end of this description which discusses the use of these data in 3D modelling. The paper summary follows: We expand the application of spatial autocorrelation (SPAC) from typical 1-D Vs profiles to quasi-3-D imaging via Bayesian Monte Carlo inversion (BMCI) using a dense nodal array (49 nodes) located at the Utah Frontier Observatory for Research in Geothermal Energy (FORGE) site. Combinations of 4 and 9 geophones in subarrays provide for 36 and 25 1-D Vs profiles, respectively. Profiles with error bars are determined by calculating coherency functions that fit observations in a frequency range of 0.2-5 Hz. Thus, a high-resolution quasi-3-D Vs model from the surface to 2.0 km depth is derived and shows that surface-parallel sedimentary strata deepen to the west, consistent with a 3-D seismic reflection survey. Moreover, the resulting Vs profile is consistent with a Vs profile derived from distributed acoustic sensing (DAS) data located in a borehole at the FORGE site. The quasi-3-D velocity model shows that the base of the basin dips ~22 degrees to the west and topography on the basement interface coincident with the Mag Lee Wash suggests that the bedrock interface is an unconformity. Reference: Zhang, H. and K. L. Pankow (2021). High-resolution Bayesian spatial auto-correlation (SPAC) pseudo-3D Vs model of Utah FORGE site with a dense geophone array, Geophys. Res. Int, https://doi.org/10.1093/gji/ggab049

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Imperial Valley Dark Fiber Project Continuous DAS Data

The Imperial Valley Dark Fiber Project acquired Distributed Acoustic Sensing (DAS) seismic data on a ~28 km segment of dark fiber between the cities of Calipatria and Imperial in the Imperial Valley, Southern California. Dark fiber refers to unused optical fiber cables in telecommunications networks and is repurposed in this project for DAS applications. The objective, which is further detailed in the attached journal article from Ajo-Franklin et al., is to demonstrate dark fiber DAS as a tool for basin-scale geothermal exploration and monitoring. The included DAS data were recorded during two days at the beginning the project. Data is stored in the .h5 (HDF5) file format, readable using various software tools, including the 'h5read' and 'h5info' functions in Matlab. Provided here are examples of methods to read and use the data with the 'h5py' package in Python.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Integrated Approach to Investigating Historic Cemeteries

Ground-penetrating radar (GPR) and terrestrial laser scanning (TLS) surveys were conducted at a historic cemetery at Cape Canaveral Air Force Station, Florida, U.S., in order to confirm the presence of burials corresponding to grave markers and detect potential unmarked burials. Noise in the GPR data from surface features and subtle terrain differences must be addressed to determine the extent of anomalies of interest. We use singular value decomposition (SVD) to isolate and remove energy from GPR data. SVD allows one to remove unwanted signals that traditional processing techniques cannot. With SVD filtering, we resolve an anomaly adjacent to confirmed burials otherwise overprinted by unwanted signal. The migration of SVD-filtered data produces more distinct, spatially constrained point reflectors. Ground elevation is derived from georeferenced TLS data and compared to that from airborne laser scanning (ALS) to highlight subtle terrain that can assist data interpretation. TLS elevations show a subtle modern mound over the burial plot where ALS elevations show a depression. The targets of interest are approximately 20–30 cm higher in elevation if a topographic correction is performed using TLS versus ALS. In archaeological applications, a notable change is often recorded at the sub-meter scale. The combined approach presented here better resolves geophysical response of buried features and their positions in the ground relative to each other.

Downs, Christine (ORCID:0000000237229381)↗
DOE OSTI2020

A Fast, Two-dimensional Gaussian Process Method Based on Celerite: Applications to Transiting Exoplanet Discovery and Characterization

Gaussian processes (GPs) are commonly used as a model of stochastic variability in astrophysical time series. In particular, GPs are frequently employed to account for correlated stellar variability in planetary transit light curves. The efficient application of GPs to light curves containing thousands to tens of thousands of data points has been made possible by recent advances in GP methods, including the celerite method. Here we present an extension of the celerite method to two input dimensions where, typically, the second dimension is small. This method scales linearly with the total number of data points when the noise in each large dimension is proportional to the same celerite kernel and only the amplitude of the correlated noise varies in the second dimension. We demonstrate the application of this method to the problem of measuring precise transit parameters from multiwavelength light curves and show that it has the potential to improve transit parameters measurements by orders of magnitude. Applications of this method include transit spectroscopy and exomoon detection, as well a broader set of astronomical problems.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

An Optical Spectrum of the Diffuse Galactic Light from BOSS and IRIS

We present a spectrum of the diffuse Galactic light (DGL) between 3700 and 10,000 Å, obtained by correlating optical sky intensity with far-infrared dust emission. We use nearly 250,000 blank-sky spectra from BOSS/SDSS-III together with IRIS-reprocessed maps from the IRAS satellite. The larger sample size compared to SDSS-II results in a factor-of-2 increase in signal to noise. We combine these data sets with a model for the optical/far-infrared correlation that accounts for self-absorption by dust. The spectral features of the DGL agree remarkably well with the features present in stellar spectra. There is evidence for a difference in the DGL continuum between the regions covered by BOSS in the northern and southern Galactic hemispheres. We interpret the difference at red wavelengths as the result of a difference in stellar populations, with mainly old stars in both regions, but a higher fraction of young stars in the south. There is also a broad excess in the southern DGL spectrum over the prediction of a simple radiative transfer model, without a clear counterpart in the north. We interpret this excess, centered at ~6500 Å, as evidence for luminescence in the form of extended red emission. The observed strength of the 4000 Å break indicates that at most ~7% of the dust-correlated light at 4000 Å can be due to blue luminescence. Our DGL spectrum provides constraints on dust scattering and luminescence, independent of measurements of extinction.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Searching for Spectroscopic Signatures of Ongoing Quenching in SDSS Galaxies

In this paper, we estimate the “star formation change parameter,” SFR 79 , which characterizes the current SFR relative to the average during the last 800 Myr, for ~300,000 galaxies selected from the Sloan Digital Sky Survey (SDSS). The goals are to examine, in a much larger and independent sample, the trends previously reported in a sample of star-forming (SF) MaNGA galaxies and also to search for spectroscopic signatures of ongoing quenching in the so-called “Green Valley,” which is generally believed to contain galaxies that are migrating from the SF population to the quenched population of galaxies. Measuring SFR 79 for our large sample of SDSS galaxies, we first confirm the basic results of SF galaxies published by Wang & Lilly. We then discuss in detail the calibration and meaning of SFR 79 for galaxies that are well below the SFMS and establish the expected statistical signature of systematic ongoing quenching from modeling the z ~ 0 quenching rate of the SF population. We conclude that it is not possible at present to establish unambiguous observational evidence for systematic ongoing quenching processes, due to limitations both in the noise of the observational data, in particular in the measurements of H δ absorption, and in the calibration of SFR 79 , as well as biases introduced by the necessity of selecting objects with significant H α emission. We do however see plausible indications of ongoing quenching, which are quantitatively consistent with expectations from “growth+quenching” models of galaxy evolution and a typical e-folding timescale for quenching of ~500 Myr.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

dlppi2 (b1)

The Doppler lidar (DL) is an active remote-sensing instrument that provides range- and time-resolved measurements of the line-of-sight component of air velocity (i.e., radial velocity) and attenuated aerosol backscatter. The DL operates in the near-infrared and is sensitive to backscatter from atmospheric aerosol, which are assumed to be ideal tracers of atmospheric wind fields. The DL works by transmitting short pulses of infrared laser light into the atmosphere. Atmospheric aerosols scatter a small fraction of that light energy back to the transceiver, where it is collected and recorded as a time-resolved signal. From the delay between the outgoing pulse and the backscattered signal, the instrument infers the distance to the scattering volume. Coherent detection is used to measure the Doppler frequency shift of the backscatter signal. This is accomplished by mixing the backscatter signal with a reference laser beam (i.e., local oscillator) of known frequency. The onboard signal processor then determines the Doppler frequency shift from the spectrum of the mixed signal. The Doppler frequency shift and thus the radial air velocity is determined from the peak of the Doppler spectrum. The attenuated backscatter is determined from the energy content of the Doppler spectra. The DL provides accurate measurements of radial velocity in regions of the atmosphere where aerosol concentrations are high enough to ensure good signal-to-noise ratio. Thus, valid data are usually limited to the atmospheric boundary layer where aerosol is ubiquitous. Valid measurements can also be obtained in elevated aerosol layers or in optically thin clouds above the boundary layer. Most of the ARM DLs have full upper-hemispheric scanning capability, enabling 3D mapping of turbulent flows in the atmospheric boundary layer. With the scanner pointed vertically, the DL provides height- and time-resolved measurements of vertical velocity.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

CaloTrilogy: Toward a Breakthrough in One-Step, End-to-End, Physics-Guided Shower Generation for Modern Calorimeters

High-precision calorimeter simulation at current and future colliders imposes rapidly growing computational demands, motivating the development of machine-learning surrogates for traditional Monte Carlo tools such as Geant4. Flow matching and diffusion-based generative models have become leading approaches for high-dimensional fast simulation because of their sample quality, but typically require ${\cal O}(100)$ function evaluations at inference and often rely on auxiliary networks to constrain global observables, compromising streamlined end-to-end generation. We introduce a unified framework that improves the balance between speed, shower quality, and physics fidelity. The method combines: (i) an average velocity field integrator that enables sampling in one or a few evaluations; (ii) a learned generative prior in shower space, constructed from data rather than random noise; and (iii) physics-guided loss terms that impose inductive biases on key observables during training. These elements are training time regularizers, preserving end-to-end inference with no additional cost. With only one or a few evaluation steps, the model achieves shower quality competitive with state-of-the-art flow and diffusion approaches, tested on several public high granularity calorimeter datasets. The results demonstrate inter-layer shower structure consistent with the underlying physics, providing a strong candidate for future fast simulation workflows.

Jiang, Cheng [Edinburgh U.]↗
DOE OSTI2023

Source-encoded waveform inversion in the Northern Hemisphere

SUMMARY We use source-encoded waveform inversion to image Earth’s Northern Hemisphere. The encoding method is based on measurements of Laplace coefficients of stationary wavefields. By assigning to each event a unique frequency, we compute Fréchet derivatives for all events simultaneously based on one ‘super’ forward and one ‘super’ adjoint simulation for a small fraction of the computational cost of classical waveform inversion with the same data set. No cross-talk noise is introduced in the process, and the method does not require all events to be recorded by all stations. Starting from global model GLAD_M25, we performed 100 conjugate gradient iterations using a data set consisting of 786 earthquakes recorded by 9846 stations. Synthetic inversion tests show that we achieve good convergence based on this data set, and we see a consistent misfit reduction during the inversion. The new model, named SE100, has much higher spatial resolution than GLAD_M25, revealing details of the Yellowstone and Iceland hotspots, subduction beneath the Western United States and the upper mantle structure beneath the Arctic Ocean.

Cui, Congyue↗
DOE OSTI2024

Beam Loss Assessment Through Use of Photomultiplier Tubes

The first machine in the Fermilab Accelerator chain, the Linac, delivers a 400 MeV proton beam. The first portion of the Fermilab Linac, the Drift Tube Linac, lacks the degree of instrumentation necessary for beam tuning. To compensate for this, photomultiplier tube (PMT s) based loss monitors were installed on either side of the first two drift tube tanks, but are not yet operational. One of the main goals in this is to make PMT's operational beam loss monitors for tuning. Noise reduction and peak finding on the PMT data is a requirement for this. A method for noise reduction and peak finding has been developed and implemented to produce a consistent and stable output. Future work includes integration with ACNET to automate input and output of data for analysis of beam loss.

Waggoner, Alexander↗
DOE OSTI2022

Early arrival waveform inversion using data uncertainties and matching filters with application to near-surface seismic refraction data

We develop an early arrival waveform inversion (EAWI) technique for high-resolution near-surface velocity estimation by iteratively updating the P-wave velocity model to minimize the difference between the observed and calculated seismic refraction data. Traditional EAWI uses a least-squares penalty function and an acoustic forward-modeling engine. Conventional least-squares error is sensitive to data with low signal-to-noise ratio (S/N) and iterations of EAWI stop at a local-minimum data misfit or at the preassigned maximum number of iterations. These stopping criteria can result in overfitting the data. In addition, fitting the elastic field data with an acoustic modeling engine can introduce artifacts in velocity estimation, especially in land data with significant elastic effects. To overcome these challenges, we develop a robust EAWI (REAWI) method by (1) incorporating the data uncertainties into the penalty function and (2) mitigating the elastic effects using a matching filter workflow. The data uncertainties are estimated from waveform reciprocal errors. When full-waveform reciprocity is not available, trace interpolation is applied. The proposed method prevents closely fitting data with low S/N, avoids overall overfitting by stopping the iterations when a normalized chi-square ([Formula: see text]) waveform misfit of one is achieved, and is less affected by elastic effects. Numerical examples and application to near-surface refraction data at a groundwater contamination site suggest that the final REAWI models are more accurate than the corresponding EAWI models, at the same level of misfit. This is the first known application of a matching filter workflow to real land data. The final REAWI models satisfy an appropriate misfit between the real data and predicted elastic P-wave data, making this approach in this respect equivalent to elastic waveform inversion. We also develop a method to analyze model constraint by examining the energy of the wavefield Fréchet derivative thereby avoiding the influence of the data residuals in traditional Fréchet kernels.

Geochemistry & Geophysics↗
DOE OSTI2026

Infrared-enhanced Photometric Redshifts for the Dark Energy Survey Y6 Gold catalogue

The Dark Energy Survey (DES) provides optical data across 5000 square degrees of the southern sky, enabling a broad range of extragalactic and cosmological studies. Combining DES data with infrared surveys offers the opportunity to improve its photometric redshift (photo-z) estimates. We aim to investigate improvements in photometric redshift estimation achieved by combining DES optical data with infrared measurements from the VISTA Hemisphere Survey (VHS) and the Wide-field Infrared Survey Explorer (WISE), and release an updated version of the catalogue. We performed a positional sky cross-match between the DES Y6 Gold catalogue matched to a spectroscopic dataset, the 2013 AllWISE Data Release, and VHS Data Release 5, in order to test these improvements using the Directional Neighbourhood Fitting (DNF) algorithm (Y6 Gold catalogue reference estimator). We additionally matched it to the unWISE catalogue to verify the performance against this deeper dataset. Adding infrared data reduces all the metrics (scatter, bias and outlier fraction) in photo-z estimates, particularly at higher redshifts in comparison with only using optical data from DES. The obtained results are globally better for the DES+WISE sample, with improvements that are statistically significant. On the other hand, the addition of the VHS bands to available depth is only marginal. The combined use of DES and WISE W1 and W2 data improves the photometric redshift metrics analysed here. The addition of VHS data at the DES and VHS depths explored here does not provide any further improvement at z less than 1.5, indicating that, under these constraints, WISE data may already capture the key infrared features and depth needed for accurate photo-z estimation. In addition, low signal-to-noise (less than 10) infrared data does not contribute to any improvement beyond the DES optical dataset.

Puebla, M. M. [Madrid U.; Madrid, CIEMAT]↗
DOE OSTI2021

Primary Velocity and Orbital Phase Effects on Planetary Detectability from Small Epoch Number Data Sets

Cross-correlation analyses of high-resolution spectroscopic data have recently shown great success in directly detecting planetary signals and enabling the characterization of their atmospheres. One such technique aims to observe a system at multiple epochs and combine the measured planetary radial velocities from each epoch into a measurement of the planetary Keplerian orbital velocity K {sub p}, constituting a direct detection of the planetary signal. Recent work has shown that in few-epoch (∼5) data sets, unintended structure can arise at a high level, obscuring the planetary detection. In this work, we look to simulations to examine whether there are ways to reduce this structured noise in few-epoch data sets by careful planning of observations. The choice of observation date allows observers to select the primary (stellar) velocity through a set systemic velocity and chosen barycentric velocity and the planetary orbital phase so we focus on the effects of these two parameters. We find that epochs taken when the primary velocity is near zero and the stellar lines remain relatively fixed to the telluric rest-frame greatly reduce the level of structured noise and allow for much stronger planetary detections, on average more than twice the significance of detections made with epochs using randomly selected primary velocities. Following these results, we recommend that observers looking to build up high-resolution multi-epoch data sets target nights when their system has a near-zero primary velocity.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Super resolution for root imaging

Premise High‐resolution cameras are very helpful for plant phenotyping as their images enable tasks such as target vs. background discrimination and the measurement and analysis of fine above‐ground plant attributes. However, the acquisition of high‐resolution images of plant roots is more challenging than above‐ground data collection. An effective super‐resolution (SR) algorithm is therefore needed for overcoming the resolution limitations of sensors, reducing storage space requirements, and boosting the performance of subsequent analyses. Methods We propose an SR framework for enhancing images of plant roots using convolutional neural networks. We compare three alternatives for training the SR model: (i) training with non‐plant‐root images, (ii) training with plant‐root images, and (iii) pretraining the model with non‐plant‐root images and fine‐tuning with plant‐root images. The architectures of the SR models were based on two state‐of‐the‐art deep learning approaches: a fast SR convolutional neural network and an SR generative adversarial network. Results In our experiments, we observed that the SR models improved the quality of low‐resolution images of plant roots in an unseen data set in terms of the signal‐to‐noise ratio. We used a collection of publicly available data sets to demonstrate that the SR models outperform the basic bicubic interpolation, even when trained with non‐root data sets. Discussion The incorporation of a deep learning–based SR model in the imaging process enhances the quality of low‐resolution images of plant roots. We demonstrate that SR preprocessing boosts the performance of a machine learning system trained to separate plant roots from their background. Our segmentation experiments also show that high performance on this task can be achieved independently of the signal‐to‐noise ratio. We therefore conclude that the quality of the image enhancement depends on the desired application.

Ruiz‐Munoz, Jose F.↗