SEARCH · Search NASA

Results for “sparse sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

All sources NASA NTRS DOE OSTI

NASA NTRS1991

Diversity of micro-fungi in an Antarctic dry valley

The fungal microflora of a dry valley in Southern Victoria Land near McMurdo Sound, Antarctica, was investigated. Samples were collected from introduced objects such as a mummified penguin and spent chewing tobacco in addition to the sparse soil found in rock fissures, isolated moss colonies, shoreline deposit materials, CaCO3 precipitates, and microbial mat debris obtained from the frozen surface of the lake in the basin of Taylor Valley. Using conventional media and techniques, all collection sites yielded populations of yeasts and filamentous fungi. Water samples and live microbial mats from beneath the lake ice yielded species of fungi along with an abundance of bacteria.

NASA Discipline Exobiology↗

DOE OSTI2023

A Bayesian model for multivariate discrete data using spatial and expert information with application to inferring building attributes

When modeling sparsely observed multivariate data, strong prior information elicited from experts can be used to bolster predictive accuracy and counteract sampling bias. Similarly, modeling autocorrelation in space can help make use of co-occurrence patterns present in many types of spatial data. To make use of both expert prior information and spatial structure, we propose a novel graphical model for a spatial Bayesian network developed specifically to address challenges in inferring the attributes of buildings from geographically sparse observational data. This model is implemented as the sum of a spatial multivariate Gaussian random field and a tabular conditional probability function in real-valued space prior to projection onto the probability simplex. This modeling form is especially suitable for the usage of prior information in the form of sets of atomic rules obtained from experts. To perform inference with missing data, we implement a Markov chain Monte Carlo scheme composed of alternating steps of Gibbs sampling of missing entries and Hamiltonian Monte Carlo for model parameters. A case study in building attribution is presented to highlight the advantages and limitations of this approach.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2014

A new estimate of the China temperature anomaly series and uncertainty assessment in 1900–2006

While global warming during the last century has been well recognized, the magnitude of the climate warming in regions such as China over the past 100 years still has some uncertainty due to limited observations during the early years. Several series of temperature anomalies for the 20th century in China have been independently developed by different groups. The uncertainty arises mainly from the sparse observations before 1950, where statistics are sensitive to the small and potentially biased sample. In this study, BSHADE–MSN (Biased Sentinel Hospitals Areal Disease Estimation and Means of Stratified Nonhomogeneous Surface), a combination of two novel distinct statistical methods that are applicable with different sample situations to a spatial heterogeneous surface, is applied to estimate annual mean temperature anomalies for China. This method takes into account prior knowledge of geographical spatial autocorrelation and nonhomogeneity of target domains, remedies the biased sample, and maximizes an objective function for the best linear unbiased estimation (BLUE) of the regional mean quantity. For the period 1900–1999, the overall trend estimated by BSHADE–MSN is 0.80°C with a 95% confidential interval between 0.41°C and 1.18°C. This is significantly lower than that calculated by Climate Anomaly Method (CAM) and Block Kriging. The new temperature anomaly series for China exhibits slightly warmer conditions for the period before 1950 than existing studies. All the methods applied so far agree well with each other for the period after 1950, when there are sufficient stations across the country for the estimation of temperature anomaly series. Cross validation shows that the new regional mean temperature anomaly series has smaller estimation error variance and higher accuracy than those based on the other methods assessed in this study.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Ultrasparse View X-ray Computed Tomography for 4D Imaging

X-ray computed tomography (CT) is a noninvasive, nondestructive approach to imaging materials, material systems, and engineered components in two and three dimensions. Acquisition of three-dimensional (3D) images requires the collection of hundreds or thousands of through-thickness X-ray radiographic images from different angles. Such 3D data acquisition strategies commonly involve suboptimal temporal sampling for in situ and operando studies (4D imaging). Herein, we introduce a sparse-view imaging approach, Tomo-NeRF, which is capable of reconstructing high-fidelity 3D images from <10 twodimensional radiographic images. Experimental 2D and 3D X-ray images were used to test the reconstruction capability in two-view, four-view, and six-view scenarios. Tomo-NeRF is capable of reconstructing 3D images with a structural similarity of 0.9971–0.9975 and a voxel-wise accuracy of 81.83–89.59% from 2D experimentally obtained images. Furthermore, the reconstruction accuracy for the experimentally obtained images is less than the synthetic structures. Experimentally obtained images demonstrate a similarity of 0.9973–0.9984 and a voxelwise accuracy of 84.31–95.77%.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Addressing APC Data Sparsity in Predicting Occupancy and Delay of Transit Buses: A Multitask Learning Approach

Public transit is a vital mode of transportation in urban areas, and its efficiency is crucial for the daily commute of millions of people. To improve the reliability and predictability of transit systems, researchers have developed separate single-task learning models to predict the occupancy and delay of buses at the stop or route level. However, these models provide a narrow view of delay and occupancy at each stop and do not account for the correlation between the two. We propose a novel approach that leverages broader generalizable patterns governing delay and occupancy for improved prediction. We introduce a multitask learning toolchain that takes into account General Transit Feed Specification feeds, Automatic Passenger Counter data, and contextual temporal and spatial information. The toolchain predicts transit delay and occupancy at the stop level, improving the accuracy of the predictions of these two features of a trip given sparse and noisy data. We also show that our toolchain can adapt to fewer samples of new transit data once it has been trained on previous routes/trips as compared to state-of-the-art methods. Finally, we use actual data from Chattanooga, Tennessee, to validate our approach. We compare our approach against the state-of-the-art methods and we show that treating occupancy and delay as related problems improves the accuracy of the predictions. We show that our approach improves delay prediction significantly by as much as 4% in F1 scores while producing equivalent or better results for occupancy.

Zulqarnain, Ammar Bin↗

DOE OSTI2015

Fast generation of sparse random kernel graphs

The development of kernel-based inhomogeneous random graphs has provided models that are flexible enough to capture many observed characteristics of real networks, and that are also mathematically tractable. We specify a class of inhomogeneous random graph models, called random kernel graphs, that produces sparse graphs with tunable graph properties, and we develop an efficient generation algorithm to sample random instances from this model. As real-world networks are usually large, it is essential that the run-time of generation algorithms scales better than quadratically in the number of vertices n. We show that for many practical kernels our algorithm runs in time at most ο(n(logn)²). As an example, we show how to generate samples of power-law degree distribution graphs with tunable assortativity.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

Seismic Characterization of the Nevada National Security Site Using Joint Body Wave, Surface Wave, and Gravity Inversion

As a part of the series of Source Physics Experiments (SPE) conducted on the Nevada National Security Site in southern Nevada, we have developed a local–to–regional scale seismic velocity model of the site and surrounding area. Accurate earth models are critical for modeling sources like the SPE to investigate the role of earth structure on the propagation and scattering of seismic waves. We combine seismic body waves, surface waves, and gravity data in a joint inversion procedure to solve for the optimal 3D seismic compressional and shear–wave velocity structures and earthquake locations subject to model smoothness constraints. Earthquakes, which are relocated as part of the inversion, provide P – and S –body–wave absolute and differential travel times. Active source experiments in the region augment this dataset with P –body–wave absolute times and surface–wave dispersion data. Dense ground–based gravity observations and surface–wave dispersion derived from ambient noise in the region fill in many areas where body–wave data are sparse. In general, the top 1–2 km of the surface is relatively poorly sampled by the body waves alone. However, the addition of gravity and surface waves to the body–wave dataset greatly enhances structural resolvability in the near surface. Here, we discuss the methodology we developed for simultaneous inversion of these disparate data types and briefly describe results of the inversion in the context of previous work in the region.

58 GEOSCIENCES↗

DOE OSTI2024

Effect of Biomass Water Dynamics in Cosmic-Ray Neutron Sensor Observations: A Long-Term Analysis of Maize–Soybean Rotation in Nebraska

Precise soil water content (SWC) measurement is crucial for effective water resource management. This study utilizes the Cosmic-Ray Neutron Sensor (CRNS) for area-averaged SWC measurements, emphasizing the need to consider all hydrogen sources, including time-variable plant biomass and water content. Near Mead, Nebraska, three field sites (CSP1, CSP2, and CSP3) growing a maize–soybean rotation were monitored for 5 (CSP1 and CSP2) and 13 (CSP3) years. Data collection included destructive biomass water equivalent (BWE) biweekly sampling, epithermal neutron counts, atmospheric meteorological variables, and point-scale SWC from a sparse time domain reflectometry (TDR) network (four locations and five depths). In 2023, dense gravimetric SWC surveys were collected eight (CSP1 and CSP2) and nine (CSP3) times over the growing season (April to October). The N0 parameter exhibited a linear relationship with BWE, suggesting that a straightforward vegetation correction factor may be suitable (fb). Results from the 2023 gravimetric surveys and long-term TDR data indicated a neutron count rate reduction of about 1% for every 1 kg m−2 (or mm of water) increase in BWE. This reduction factor aligns with existing shorter-term row crop studies but nearly doubles the value previously reported for forests. This long-term study contributes insights into the vegetation correction factor for CRNS, helping resolve a long-standing issue within the CRNS community.

Chemistry↗

NASA NTRS1992

Airborne flux measurements of trace species in an Arctic boundary layer

In situ airborne flux values for O3, CO, an CH4 over selected wetlands of Alaska are reported, and airborne CH4 flux measurements are presented for the first time. The source/sink distribution over the Yukon-Kuskokwim Delta (YKD) is qualitatively correlated with surface vegetation type. The CH4 source strength over the YKD ranged from 25 to 85 mg/sq m/d. A spatially averaged, seasonally adjusted source strength of 51 mg/sq m/d was established for the YKD. Indirect CH4 flux estimates obtained over the Alaskan North Slope indicate a much lower source strength. The global CH4 emission from tundra are estimated to be 44 Tg/a at an upper limit. Airborne CO flux measurements over the YKD indicate low negative flux values over the coastal areas, while some positive fluxes were observed in the inland sparsely forested regions. An inspection of the cospectrum of CO with vertical velocity for sample runs in coastal areas indicate the possibility of in situ photochemical destruction/production of CO.

Ritter, John A.↗

DOE OSTI2022

Pan-sharpening for microscopy

Techniques for generating full-spatial resolution, full spectral resolution image(s) from a 3D spectral-data cube for any spectral value within a given spectral range are provided without requiring the acquisition of all full-spatial resolution, full spectral resolution data by an instrument. The 3D spectral-data cube is generated from a limited number of full-spatial resolution, sparse spectral resolution data and a sparse-spatial resolution, full-spectral resolution data of the same area of the sample. The use of the 3D spectral-data cube reduces the data acquisition time.

Ovchinnikova, Olga S.↗

DOE OSTI2015

X-ray computed tomography using curvelet sparse regularization

Purpose: Reconstruction of x-ray computed tomography (CT) data remains a mathematically challenging problem in medical imaging. Complementing the standard analytical reconstruction methods, sparse regularization is growing in importance, as it allows inclusion of prior knowledge. The paper presents a method for sparse regularization based on the curvelet frame for the application to iterative reconstruction in x-ray computed tomography. Methods: In this work, the authors present an iterative reconstruction approach based on the alternating direction method of multipliers using curvelet sparse regularization. Results: Evaluation of the method is performed on a specifically crafted numerical phantom dataset to highlight the method’s strengths. Additional evaluation is performed on two real datasets from commercial scanners with different noise characteristics, a clinical bone sample acquired in a micro-CT and a human abdomen scanned in a diagnostic CT. The results clearly illustrate that curvelet sparse regularization has characteristic strengths. In particular, it improves the restoration and resolution of highly directional, high contrast features with smooth contrast variations. The authors also compare this approach to the popular technique of total variation and to traditional filtered backprojection. Conclusions: The authors conclude that curvelet sparse regularization is able to improve reconstruction quality by reducing noise while preserving highly directional features.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2016

Efficient Uncertainty Quantification in Stochastic Economic Dispatch

Stochastic economic dispatch models usually address uncertainties in forecasts of renewable generation output by considering a finite number of realizations drawn from a stochastic process model, typically via Monte Carlo sampling. Accurate evaluations of expectations or higher order moments for quantities of interest, e.g., generating cost, can require a prohibitively large number of samples. We propose an alternative to Monte Carlo sampling based on polynomial chaos expansions. These representations enable efficient and accurate propagation of uncertainties in model parameters, using sparse quadrature methods. Furthermore, we use Karhunen-Loève expansions for efficient representation of uncertain renewable energy generation that follows geographical and temporal correlations derived from historical data at each wind farm. Considering expected production cost, we show that the proposed approach can yield several orders of magnitude reduction in computational cost for solving stochastic economic dispatch relative to Monte Carlo sampling, for a given target error threshold.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

A dictionary learning algorithm for compression and reconstruction of streaming data in preset order

There has been an emerging interest in developing and applying dictionary learning (DL) to process massive datasets in the last decade. Many of these efforts, however, focus on employing DL to compress and extract a set of important features from data, while considering restoring the original data from this set a secondary goal. On the other hand, although several methods are able to process streaming data by updating the dictionary incrementally as new snapshots pass by, most of those algorithms are designed for the setting where the snapshots are randomly drawn from a probability distribution. In this paper, we present a new DL approach to compress and denoise massive dataset in real time, in which the data are streamed through in a preset order (instances are videos and temporal experimental data), so at any time, we can only observe a biased sample set of the whole data. Here, our approach incrementally builds up the dictionary in a relatively simple manner: if the new snapshot is adequately explained by the current dictionary, we perform a sparse coding to find its sparse representation; otherwise, we add the new snapshot to the dictionary, with a Gram-Schmidt process to maintain the orthogonality. To compress and denoise noisy datasets, we apply the denoising to the snapshot directly before sparse coding, which deviates from traditional dictionary learning approach that achieves denoising via sparse coding. Compared to full-batch matrix decomposition methods, where the whole data is kept in memory, and other mini-batch approaches, where unbiased sampling is often assumed, our approach has minimal requirement in data sampling and storage: i) each snapshot is only seen once then discarded, and ii) the snapshots are drawn in a preset order, so can be highly biased. Through experiments on climate simulations and scanning transmission electron microscopy (STEM) data, we demonstrate that the proposed approach performs competitively to those methods in data reconstruction and denoising.

97 MATHEMATICS AND COMPUTING↗

NASA NTRSDate not supplied

Multiscale Modeling of Reconstructed Tricalcium Silicate using NASA Multiscale Analysis Tool

To study microstructure characteristics of cementitious materials hydrated in space; previously, cement binder formations were processed under microgravity conditions and was further compared against ground-based experiments. For accurate estimation of process-structure-property linkage, particularly on samples hydrated in the microgravity environment, it is desired to have a high-fidelity volumetric representation of the microstructure. However, owing to small sample size and high porosity of the space-returned samples, conventional experimental characterization techniques are not viable. Hence, a deep learning-based reconstruction algorithm was employed to obtain high fidelity 3D volumes from sparse high resolution 2D Scanning Electron Microscopy (SEM) images, as inputs to micromechanics-based modeling. This machine learning-based reconstruction methodology validated against low-order statistical descriptors, captured the microstructural topology of both sample types (ground, 1g and microgravity, μg). Due to the lack of gravity, hydration products of the samples processed in space differed from those processed-on ground. Such AI-generated virtual samples were analyzed in a multiscale recursive micromechanics approach using the NASA Multiscale Analysis Tool (NASMAT). Here, we present a methodology to rapidly integrate and evaluate these AI-generated volumes in NASMAT. The synthesized microstructural volumes are directly employed as Representative Volume Elements (RVEs) to preserve the fidelity (1 pixel = 0.54 m). Invariably, analysis of such largescale problems (5123 voxels) requires huge amount of computational resources. By taking advantage of the NASMAT architecture, we also focused on systematic multiscale integration of these AI-reconstructed virtual volumes to reduce the computational demands. In this work, this methodology is demonstrated on the ground-based, 1g samples. The estimated stiffness value of 15.90 GPa is comparable to experimentally obtained modulus of hydrated tricalcium silicate sample. The workflow presented here paves the way for utilizing the NASMAT tool to perform multiscale analyses of other multi-phase material systems using either 3D virtual datasets synthesized using AI or obtained via micro-CT.

Machine Learning↗

DOE OSTI2023

1-D coupled surface flow and transport equations revisited via the physics-informed neural network approach

The de Saint-Venant equation (SVE) and advection–diffusion equation (ADE) are commonly employed to solve solute transport problems in surface water. In this work, we propose a mesh-free method based on the physics-informed neural network (PINN) to solve the one dimensional (1-D) SVE, ADE, and the coupled SVE and ADE (SVE-ADE) under various initial and boundary conditions. The PINN model extends the architecture of deep neural networks (DNNs) with implementation of loss function, which are additionally subject to constraints imposed by the physical laws of SVE and ADE, along with their initial and boundary conditions. In such a manner, PINNs can be quickly steered to the true solution while obeying the physical laws. The results of PINN model are compared with the analytical and/or numerical solutions under various conditions to investigate its accuracy and efficiency in solving the SVE, ADE, and SVE-ADE. Our results indicate PINN can accurately simulate the shock wave morphology and avoid numerical dissipation in unsteady flow condition. The PINN method outweighed traditional numerical methods in several aspects, including its ability to function with small amounts of data, no grid discretization, and random selection of sampling points, etc. Additionally, the PINN method is also suitable for solving inverse problems with sparse and noisy data. With 1% noise and 2000 initial and boundary condition points (N u ), the errors of the estimated flow rate (v) and diffusion coefficient (D) are 0.003% and 0.105%, respectively, which indicate the accuracy and robustness of the proposed method. Finally, our results indicate the capability and robustness of the proposed PINN methodology for solving multi-physics problems, irrespective of the presence of sparse and noisy data in the training dataset.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Asymptotic consistency of the WSINDy algorithm in the limit of continuum data

In this work we study the asymptotic consistency of the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy) in the identification of differential equations from noisy samples of solutions. We prove that the WSINDy estimator is unconditionally asymptotically consistent for a wide class of models that includes the Navier–Stokes, Kuramoto–Sivashinsky and Sine–Gordon equations. We thus provide a mathematically rigorous explanation for the observed robustness to noise of weak-form equation learning. Conversely, we also show that, in general, the WSINDy estimator is only conditionally asymptotically consistent, yielding discovery of spurious terms with probability one if the noise level exceeds a critical threshold σ c . We provide explicit bounds on σ c in the case of Gaussian white noise and we explicitly characterize the spurious terms that arise in the case of trigonometric and/or polynomial libraries. Furthermore, we show that, if the data is suitably denoised (a simple moving average filter is sufficient), then asymptotic consistency is recovered for models with locally-Lipschitz, polynomial-growth nonlinearities. Our results reveal important aspects of weak-form equation learning, which may be used to improve future algorithms. We demonstrate our findings numerically using the Lorenz system, the cubic oscillator, a viscous Burgers-growth model and a Kuramoto–Sivashinsky-type high-order PDE.

asymptotic consistency↗

DOE OSTI2021

Granick revisited: Synthesizing evolutionary and ecological evidence for the late origin of bacteriochlorophyll via ghost lineages and horizontal gene transfer

Photosynthesis—both oxygenic and more ancient anoxygenic forms—has fueled the bulk of primary productivity on Earth since it first evolved more than 3.4 billion years ago. However, the early evolutionary history of photosynthesis has been challenging to interpret due to the sparse, scattered distribution of metabolic pathways associated with photosynthesis, long timescales of evolution, and poor sampling of the true environmental diversity of photosynthetic bacteria. Here, we reconsider longstanding hypotheses for the evolutionary history of phototrophy by leveraging recent advances in metagenomic sequencing and phylogenetics to analyze relationships among phototrophic organisms and components of their photosynthesis pathways, including reaction centers and individual proteins and complexes involved in the multi-step synthesis of (bacterio)-chlorophyll pigments. We demonstrate that components of the photosynthetic apparatus have undergone extensive, independent histories of horizontal gene transfer. This suggests an evolutionary mode by which modular components of phototrophy are exchanged between diverse taxa in a piecemeal process that has led to biochemical innovation. We hypothesize that the evolution of extant anoxygenic photosynthetic bacteria has been spurred by ecological competition and restricted niches following the evolution of oxygenic Cyanobacteria and the accumulation of O 2 in the atmosphere, leading to the relatively late evolution of bacteriochlorophyll pigments and the radiation of diverse crown group anoxygenic phototrophs. This hypothesis expands on the classic “Granick hypothesis” for the stepwise evolution of biochemical pathways, synthesizing recent expansion in our understanding of the diversity of phototrophic organisms as well as their evolving ecological context through Earth history.

58 GEOSCIENCES↗

DOE OSTI2025

Seafloor Seismic Noise Patterns Across the Pacific Basin

Seismic hazard monitoring and global tomography efforts are improved by recording signals at a variety of distances and azimuths to maximize subsurface sampling. Although seismic networks provide good to excellent coverage on land, seafloor stations are still sparse. Inclusion of ocean-based data would greatly improve the global coverage of seismic networks, but the use of seafloor seismic data to complement land-based detection and characterization of events is complicated by the generally much higher ambient noise level in the ocean compared to that observed on land. This noise is driven primarily by sea surface waves and tides, but how seismic noise levels vary with location in the oceans is not well described. Here, in this work, we analyze the relationship between ocean surface wave height and seismic noise in the 0.4–4 Hz frequency band at ocean-bottom seismometer deployments across the Pacific basin. We find that a noise-to-responsiveness ratio (NRR)—the median noise level at a station divided by its sea surface wave height responsiveness—correlates negatively with detection success for large teleseismic earthquakes. Stations that are close to land, with relatively shallow ocean and low wind speed, often have lower NRR than open-ocean stations, but the connection between geographic location and earthquake detection success is imperfect.

58 GEOSCIENCES↗