Search NASA⌕ Search

SEARCH · Search NASA

Results for “Sparse measurements”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Forecasting high-dimensional spatio-temporal systems from sparse measurements

This paper introduces a new neural network architecture designed to forecast high-dimensional spatio-temporal data using only sparse measurements. The architecture uses a two-stage end-to-end framework that combines neural ordinary differential equations (NODEs) with vision transformers. Initially, our approach models the underlying dynamics of complex systems within a low-dimensional space; and then it reconstructs the corresponding high-dimensional spatial fields. Many traditional methods involve decoding high-dimensional spatial fields before modeling the dynamics, while some other methods use an encoder to transition from high-dimensional observations to a latent space for dynamic modeling. In contrast, our approach directly uses sparse measurements to model the dynamics, bypassing the need for an encoder. This direct approach simplifies the modeling process, reduces computational complexity, and enhances the efficiency and scalability of the method for large datasets. We demonstrate the effectiveness of our framework through applications to various spatio-temporal systems, including fluid flows and global weather patterns. Although sparse measurements have limitations, our experiments reveal that they are sufficient to forecast system dynamics accurately over long time horizons. Our results also indicate that the performance of our proposed method remains robust across different sensor placement strategies, with further improvements as the number of sensors increases. This robustness underscores the flexibility of our architecture, particularly in real-world scenarios where sensor data is often sparse and unevenly distributed.

97 MATHEMATICS AND COMPUTING↗

Bayesian-based response expansion and uncertainty quantification using sparse measurement sets

Systems subjected to dynamic loads often require monitoring of their vibrational response, but limitations on the total number and placement of the measurement sensors can hinder the data-collection process. Here, we present an indirect approach to estimate a system’s full-field dynamic response, including all uninstrumented locations, using response measurements from sensors sparsely located on the system. This approach relies on Bayesian inference that utilizes a system model to estimate the full-field response and quantify the uncertainty in these estimates. By casting the estimation problem in the frequency domain, this approach utilizes the modal frequency response functions as a natural, frequency-dependent weighting scheme for the system mode shapes to perform the expansion. This frequency-dependent weighting scheme enables an accurate expansion, even with highly correlated mode shapes that may arise from spatial aliasing due to the limited number of sensors, provided these correlated modes do not have natural frequencies that are closely spaced. Furthermore, the inherent regularization mechanism that arises in this Bayesian-based procedure enables the utilization of the full set of system mode shapes for the expansion, rather than any reduced subset. This approach can produce estimates when considering a single realization of the measured responses, and with some modification, it can also produce estimates for power spectral density matrices measured from many realizations of the responses from statistically stationary random processes. A simply supported beam provides an initial numerical validation, and a cylindrical test article excited by acoustic loads in a reverberation chamber provides experimental validation.

42 ENGINEERING↗

Sparse measurement medical CT reconstruction using multi-fused block matching denoising priors

A major challenge for medical X-ray CT imaging is reducing the number of X-ray projections to lower radiation dosage and reduce scan times without compromising image quality. However these under-determined inverse imaging problems rely on the formulation of an expressive prior model to constrain the solution space while remaining computationally tractable. Traditional analytical reconstruction methods like Filtered Back Projection (FBP) often fail with sparse measurements, producing artifacts due to their reliance on the Shannon-Nyquist Sampling Theorem. Consensus Equilibrium, which is a generalization of Plug and Play, is a recent advancement in Model-Based Iterative Reconstruction (MBIR), has facilitated the use of multiple denoisers are prior models in an optimization free framework to capture complex, non-linear prior information. However, 3D prior modelling in a Plug and Play approach for volumetric image reconstruction requires long processing time due to high computing requirement. Instead of directly using a 3D prior, this work proposes a BM3D Multi Slice Fusion (BM3D-MSF) prior that uses multiple 2D image denoisers fused to act as a fully 3D prior model in Plug and Play reconstruction approach. Our approach does not require training and are thus able to circumvent ethical issues related with patient training data and are readily deployable in varying noise and measurement sparsity levels. In addition, reconstruction with the BM3D-MSF prior achieves similar reconstruction image quality as fully 3D image priors, but with significantly reduced computational complexity. We test our method on clinical CT data and demonstrate that our approach improves reconstructed image quality.

Hossain, Maliha [ORNL]↗

Learning and meta-learning of stochastic advection–diffusion–reaction systems from sparse measurements

Physics-informed neural networks (PINNs) were recently proposed in [18] as an alternative way to solve partial differential equations (PDEs). A neural network (NN) represents the solution, while a PDE-induced NN is coupled to the solution NN, and all differential operators are treated using automatic differentiation. Here, we first employ the standard PINN and a stochastic version, sPINN, to solve forward and inverse problems governed by a non-linear advection–diffusion–reaction (ADR) equation, assuming we have some sparse measurements of the concentration field at random or pre-selected locations. Subsequently, we attempt to optimise the hyper-parameters of sPINN by using the Bayesian optimisation method (meta-learning) and compare the results with the empirically selected hyper-parameters of sPINN. In particular, for the first part in solving the inverse deterministic ADR, we assume that we only have a few high-fidelity measurements, whereas the rest of the data is of lower fidelity. Hence, the PINN is trained using a composite multi-fidelity network, first introduced in [12], that learns the correlations between the multi-fidelity data and predicts the unknown values of diffusivity, transport velocity and two reaction constants as well as the concentration field. For the stochastic ADR, we employ a Karhunen–Loève (KL) expansion to represent the stochastic diffusivity, and arbitrary polynomial chaos (aPC) to represent the stochastic solution. Correspondingly, we design multiple NNs to represent the mean of the solution and learn each aPC mode separately, whereas we employ a separate NN to represent the mean of diffusivity and another NN to learn all modes of the KL expansion. For the inverse problem, in addition to stochastic diffusivity and concentration fields, we also aim to obtain the (unknown) deterministic values of transport velocity and reaction constants. The available data correspond to 7spatial points for the diffusivity and 20 space–time points for the solution, both sampled 2000 times. We obtain good accuracy for the deterministic parameters of the order of 1–2% and excellent accuracy for the mean and variance of the stochastic fields, better than three digits of accuracy. In the second part, we consider the previous stochastic inverse problem, and we use Bayesian optimisation to find five hyper-parameters of sPINN, namely the width, depth and learning rate of two NNs for learning the modes. Here, we obtain much deeper and wider optimal NNs compared to the manual tuning, leading to even better accuracy, i.e., errors less than 1% for the deterministic values, and about an order of magnitude less for the stochastic fields.

97 MATHEMATICS AND COMPUTING↗

Nonlinear Signal Processing for Removing Microphonic Noise from Nuclear Spectrometer Measurements: Sparse Linear Modeling via L1 Norm Regularization [Slides]

The focus of this initial work is to apply recent breakthroughs in sparse linear modeling and nonlinear signal processing to the problem of removing microphonic noise from nuclear spectrum measurements. The resolution of nuclear spectrum measurements is commonly degraded by microphonic noise caused by the vibration of supporting equipment (i.e. cryocoolers) as well as motion of the detector itself in mobile applications. Current signal processing techniques cannot remove microphonic noise without modifying the desired characteristics of the spikes induced by nuclear detection events. The LANL Engineering Institute has been working with NEN‐1 to remedy this problem. Initial work focused on developing active control systems to cancel the vibrations experienced by nuclear detectors. As work on progressed along these lines the team realized that a more robust, lower‐energy, lower‐cost solution to the microphonic noise problem could be realized using recent breakthroughs in nonlinear signal processing. Over the course of the last decade significant advances have been made in the field of sparse linear modeling using L1 norm minimization to find linear representations of sparse signals. The problem of removing microphonic noise from nuclear detection measurements appears to be well suited to the L1 minimization approach because these measurements tend to be inherently sparse in two different domains. The nuclear detections are sparse in a spike domain, and the microphonic noise is sparse in the Fourier basis. L1 minimization allows us to decompose the measurements into these two domains. The result is that we can potentially separate the spikes from the microphonic noise. Initial investigations into this technique look very promising. In this work microphonic noise is induced in an HE‐3 detector by a wrench impact. A pulser is used to generate uniform, synthetic, nuclear events and is fed into the detector front end electronics. Nearly all the microphonic noise is separated from the spike measurements. The histograms in Figure 2 illustrate that spectrum widening caused by noise is significantly reduced. The goal of future work to further develop this technique to account for variations in spike characteristics, as well as to use adaptive signal processing and modern Graphical Processing Unit (GPU) technology to speed up the signal decompositions.

42 ENGINEERING↗

Bayesian inference of anisotropic 2D small-angle scattering from sparse measurement

Here, we present a Bayesian inference framework for reconstructing anisotropic two-dimensional small-angle scattering (2D SAS) patterns from sparse, noisy, or partially missing data. The method combines a symmetry-aware angular basis with radial Gaussian process priors to enable accurate, training-free interpolation and denoising. Computational benchmarks demonstrate reliable recovery of both isotropic and high-order anisotropic features under severe data reduction. Experimental validations on stretched polymers, sheared wormlike micelles, and carbon fibers show improved fidelity and resolution compared to raw measurements, achieving comparable accuracy with up to 50-fold fewer detected neutrons. This approach enables quantitative structural analysis under low-flux, time-limited, or single-shot conditions, extending the applicability of 2D SAS techniques to compact neutron sources and mechanically driven soft matter systems undergoing transient structural changes.

Tung, Chi-Huan [Oak Ridge National Laboratory (ORN↗

Kalman-filtered compressive sensing for high resolution estimation of anthropogenic greenhouse gas emissions from sparse measurements.

The estimation of fossil-fuel CO2 emissions (ffCO2) from limited ground-based and satellite measurements of CO2 concentrations will form a key component of the monitoring of treaties aimed at the abatement of greenhouse gas emissions. The limited nature of the measured data leads to a severely-underdetermined estimation problem. If the estimation is performed at fine spatial resolutions, it can also be computationally expensive. In order to enable such estimations, advances are needed in the spatial representation of ffCO2 emissions, scalable inversion algorithms and the identification of observables to measure. To that end, we investigate parsimonious spatial parameterizations of ffCO2 emissions which can be used in atmospheric inversions. We devise and test three random field models, based on wavelets, Gaussian kernels and covariance structures derived from easily-observed proxies of human activity. In doing so, we constructed a novel inversion algorithm, based on compressive sensing and sparse reconstruction, to perform the estimation. We also address scalable ensemble Kalman filters as an inversion mechanism and quantify the impact of Gaussian assumptions inherent in them. We find that the assumption does not impact the estimates of mean ffCO2 source strengths appreciably, but a comparison with Markov chain Monte Carlo estimates show significant differences in the variance of the source strengths. Finally, we study if the very different spatial natures of biogenic and ffCO2 emissions can be used to estimate them, in a disaggregated fashion, solely from CO2 concentration measurements, without extra information from products of incomplete combustion e.g., CO. We find that this is possible during the winter months, though the errors can be as large as 50%.

Ray, Jaideep↗

Performance Calculations for a Boundary-Layer-Ingesting Fan Stage from Sparse Measurements

A test of the Boundary Layer Ingesting-Inlet / Distortion-Tolerant Fan was completed in NASA Glenn's 8-Foot by 6-Foot supersonic wind tunnel. Inlet and fan performance were measured by surveys using a set of rotating rake arrays upstream and downstream of the fan stage. Surveys were conducted along the 100 percent speed line and a constant exit corrected flow line passing through the aerodynamic design point. These surveys represented only a small fraction of the data collected during the test. For other operating points, data was recorded as snapshots without rotating the rakes which resulted in a sparser set of recorded data. This paper will discuss analysis of these additional, lower measurement density data points to expand our coverage of the fan map. Several techniques will be used to supplement the snapshot data at test conditions where survey data also exists. The supplemented snapshot data will be compared with survey results to assess the quality of the approach. Effective methods will be used to analyze the data set for which only snapshots exist.

fan efficiency↗

Generating data ensembles over a model grid from sparse climate measurements.

Parameterizations in high-end climate models can be evaluated with observed climate and meteorological data. Often this evaluation is achieved by averaging measured quantities over time and space to match the spatial and temporal resolution of a gridded climate model without any regard for the statistical errors in doing so. We present a statistical method to interpolate sparsely located surface measurements into a uniform spatial grid representative of global and regional models of the atmosphere and climate. This method provides estimates of mean values over the entire domain containing the measurement sites as well as the uncertainty in the estimated quantities at the grid locations through multiple simulations to create 'data ensembles.' We demonstrate this method using measurements of surface sensible heat flux over the southern Great Plains region gathered through the Department of Energy's Atmospheric Radiation Measurement (ARM) program. Application to the numerous other climate variables measured through the ARM program and the development of a software tool to streamline data management and implementation of the statistical models is also discussed.

54 ENVIRONMENTAL SCIENCES↗

Theoretical and numerical studies of inverse source problem for the linear parabolic equation with sparse boundary measurements

We consider the inverse source problem in the parabolic equation, where the unknown source possesses the semi-discrete formulation. Theoretically, we prove that the flux data from any nonempty open subset of the boundary can uniquely determine the semi-discrete source. This means the observed area can be extremely small, and that is the reason we call it sparse boundary data. For the numerical reconstruction, we formulate the problem from the Bayesian sequential prediction perspective and conduct the numerical examples which estimate the space-time-dependent source state by state. To better demonstrate the method’s performance, we solve two common multiscale problems from two models with a long source sequence. The numerical results illustrate that the inversion is accurate and efficient.

97 MATHEMATICS AND COMPUTING↗

Comparison of meteorological measurements from sparse and dense surface observational networks in the U.S. southern Great Plains.

The primary objective of this study was to analyze the spatial variability of temperature and relative humidity across Kansas (KS) and Oklahoma (OK) for sparse and dense networks by comparing data from (1) the Surface Meteorological Observing System (SMOS) installations at the Atmospheric Radiation Measurement (ARM; Peppler et al. 2007) Program's Southern Great Plains site and (2) the Oklahoma Mesonet (OKM; McPherson et al. 2007). Given the wealth of observations available from these networks, this study provided the unique opportunity to determine, within a quantifiable statistical limit, an optimal distance between stations deployed for observation of the climatological values of temperature and relative humidity. Average distances between a given station and its closest neighboring station for the ARM SMOS ({approx} 70 km) and the OKM ({approx} 30 km; Brotzge and Richardson 2003) networks provided an excellent framework for comparisons of sparse and dense observations (Figure 1). This study further lays groundwork for a future investigation to determine the necessary spacing between observations for initialization of gridded numerical models. The spatial variability of temperature and relative humidity was examined over KS and OK by comparing observations between station pairs located in three primary domains: (1) a sparse domain in KS, consisting only of ARM SMOS stations; (2) a dense domain centered in northern OK, consisting of both ARM SMOS and OKM stations; and (3) a dense domain centered in central OK, also consisting of both ARM SMOS and OKM stations (Figure 2). In addition, the ARM SMOS stations in OK were utilized to create two secondary sparse domains. Before the observations were compared, quality control (QC) beyond the standard ARM range test was added through implementation of tighter range tests specified by data quality objectives (DQOs). Furthermore, instances of poor-quality data were removed from the data set on the basis of ARM data quality reports (DQRs). Finally, to account for spatial differences in terrain, temperature observations were corrected to mean sea level by using a standard lapse rate of 6.5 C km{sup -1} and the elevation of each observing station. For the comparison, a central station was chosen in each domain. Observations during the time period 2004-2006 from each of the other stations within a respective domain were compared to those from this central station. The Pearson correlation coefficient ({rho}) and root-mean-square difference (RMSD) were the statistics used to quantify the relationship between station pairs. For each domain, the {rho} and RMSD values were plotted against the distance separating each station pair, and a least-squares (LS) regression line was fitted to the values. The regression slopes and intercepts were compared between the various domains. The results of this analysis demonstrated positive correlations between all individual station pairs for both temperature and relative humidity. In addition, the {rho} and RMSD values for both temperature and relative humidity exhibited, in general, a linear relationship with distance from a central station. The calculated slope and intercept values were comparable across most domains, and spatial differences in temperature were smaller than those for relative humidity. The findings suggest that although the sparse networks studied might provide an accurate spatial representation for climatological values of temperature and relative humidity over the specific distances between stations, the relative importance of the temperature and relative humidity observations is a critical consideration in network design.

54 ENVIRONMENTAL SCIENCES↗

Signal discovery, limits, and uncertainties with sparse on/off measurements: an objective bayesian analysis

For decades researchers have studied the On/Off counting problem where a measured rate consists of two parts. One part is due to a signal process and the other is due to a background process, the magnitudes for both of which are unknown. While most frequentist methods are adequate for large number counts, they cannot be applied to sparse data. Here, I want to present a new objective Bayesian solution that only depends on three parameters: the number of events in the signal region, the number of events in the background region, and the ratio of the exposure for both regions. First, the probability of the counts only being due to background is derived analytically. Second, the marginalized posterior for the signal parameter is also derived analytically. With this two-step approach it is easy to calculate the signal's significance, strength, uncertainty, or upper limit in a unified way. This approach is valid without restrictions for any number count, including zero, and may be widely applied in particle physics, cosmic-ray physics, and high-energy astrophysics. In order to demonstrate the performance of this approach, I apply the method to gamma-ray burst data.

79 ASTRONOMY AND ASTROPHYSICS↗

Tensor-based flow reconstruction from optimally located sensor measurements

Reconstructing high-resolution flow fields from sparse measurements is a major challenge in fluid dynamics. Existing methods often vectorize the flow by stacking different spatial directions on top of each other, hence confounding the information encoded in different dimensions. Here, we introduce a tensor-based sensor placement and flow reconstruction method which retains and exploits the inherent multidimensionality of the flow. We derive estimates for the flow reconstruction error, storage requirements and computational cost of our method. We show, with examples, that our tensor-based method is significantly more accurate than similar vectorized methods. Furthermore, the variance of the error is smaller when using our tensor-based method. While the computational cost of our method is comparable to similar vectorized methods, it reduces the storage cost by several orders of magnitude. The reduced storage cost becomes even more pronounced as the dimension of the flow increases. We demonstrate the efficacy of our method on three examples: a chaotic Kolmogorov flow, in situ and satellite measurements of the global sea surface temperature and three-dimensional unsteady simulated flow around a marine research vessel.

Mechanics↗

Real Time Applications Using Linear State Estimation Technology (RTA/LSE)

Electric Power Group, LLC (EPG) was awarded DOE OE0000849 to design, develop, and demonstrate three real-time applications for monitoring power system stability. The applications use phasor measurements and processing by a linear state estimator (LSE) to improve system visibility and accuracy. These applications leverage the large and expanding phasor measurement systems being deployed by utilities throughout the world, and specifically in the United States. Phasor measurements provide a much more detailed view of the power systems than traditional SCADA systems, so can provide better visibility of events and an early warning of developing problems. These three applications are real-time contingency analysis (RTCA), area angle monitoring (AAM), and a voltage stability index (VSI). The project was fully completed as proposed. All three applications were successfully implemented and demonstrated. There were challenges the caused project delays, however. While the RTCA is based on well-known concepts and readily available tools, its deployment using phasor measurements meant it needed to be adapted to sometimes sparse measurements and limited coverage areas. EPG met these challenges with extensive modeling and testing. The AAM is based on unproven research, so EPG had to deal with a lot of unknowns and develop additional methods for practical implementation. These activities took more time than anticipated, so required extra time for development. In addition, there was difficulty getting adequate measurement locations for successful deployment and utility installation delays. Consequently, the project required a time extension to complete. These three real-time applications, RTCA, AAM, and VSI, use only phasor measurement input. Since they do not require the EMS or other measurement systems, they can serve as a backup and security check for the EMS. Phasor measurements are validated and extended by an LSE. The LSE will always produce an output even when some inputs are impaired, so the RT applications will operate even when the EMS state estimator does not converge and the applications it supports cannot function. Consequently, these RT applications can provide valuable additional reliability for control center operation.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Global Ocean Evaporation Increases Since 1960 in Climate Reanalyses: How Accurate Are They?

AGCMs w/ Specified SSTs (AMIPs) GEOS-5, ERA-20CM Ensembles Incorporate best historical estimates of SST, sea ice, radiative forcing Atmospheric "weather noise" is inconsistent with specified SST. Instantaneous Sfc fluxes can be wrong sign (e.g. Indian Ocean Monsoon, high latitude oceans). Averaging over ensemble members helps isolate SST-forced signal. Reduced Observational Reanalyses: NOAA 20CR V2C, ERA-20C, JRA-55C Incorporate observed Sfc Press (20CR), Marine Winds (ERA-20C) and rawinsondes (JRA-55C) to recover much of true synoptic or weather w/o shock of new sat obs. Comprehensive Reanalyses (MERRA-2) Full suite of observational constraints- both conventional and remote sensing. But... substantial uncertainties owing to evolving satellite observing system. Multi-source Statistically Blended OAFlux, LargeYeager Blend reanalysis, satellite, and ocean buoy information. While climatological biases are removed, non-physical trends or variations in components remain. Satellite Retrievals GSSTF3, SeaFlux, HOAPS3... Global coverage. Retrieved near sfc wind speed, & humidity used with SST to drive accurate bulk aerodynamic flux estimates. Satellite inter-calibration, spacecraft pointing variations crucial. Short record ( late 1987-present). In situ Measurements ICOADS, IVAD, Res Cruises VOS and buoys offer direct measurements. Sparse data coverage (esp south of 30S. Changes in measurement techniques (e.g. shipboard anemometer height).

Climate↗