Search NASA⌕ Search

SEARCH · Search NASA

Results for “sparse sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Efficient Learning of Accurate Surrogates for Simulations of Complex Systems

Machine learning methods are increasingly deployed to construct surrogate models for complex physical systems at a reduced computational cost. However, the predictive capability of these surrogates degrades in the presence of noisy, sparse, or dynamic data. We introduce an online learning method empowered by optimizer-driven sampling that has two advantages over current approaches: it ensures that all local extrema (including endpoints) of the model response surface are included in the training data and it employs a continuous validation and update process in which surrogates undergo retraining when their performance falls below a validity threshold. We find, using benchmark functions, that optimizer-directed sampling generally outperforms traditional sampling methods in terms of accuracy around local extrema even when the scoring metric is biased towards assessing overall accuracy. Finally, the application to dense nuclear matter demonstrates that highly accurate surrogates for a nuclear equation of state model can be reliably auto-generated from expensive calculations using few model evaluations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Automatic Calibration and Health Monitoring of Infrastructure Sensors

Smart transportation infrastructure relies on networks of heterogeneous sensors - cameras, radars, and lidars - continuously monitoring traffic conditions. However, executing the initial spatial calibration of multiple sensors and the subsequent health monitoring presents significant operational challenges. Environmental factors, mechanical vibrations, and gradual drift cause spatial misalignment, degrading fusion performance and tracking accuracy. Traditional calibration approaches require manual intervention with specialized targets or survey equipment, resulting in service interruptions and high maintenance costs. This work presents an automated framework for initial calibration and continuous health monitoring without human intervention or service disruption. Our approach addresses two critical problems: (1) detecting when sensors become miscalibrated during operation, and (2) automatically re-establishing spatial alignment using only operational traffic data. The health monitoring component analyzes measurement innovations - differences between sensor observations and predicted object states - to detect systematic biases indicative of calibration drift. By computing bias magnitude, directional consistency, and rejection rates, the system identifies miscalibrations as small as 0.5 meters. Unlike traditional methods requiring known calibration targets, our diagnostic operates continuously on live traffic observations, enabling early detection before fusion quality degrades. The automatic recalibration algorithm leverages overlapping sensor fields-of-view and temporal correlation of vehicle observations. Using graph-based optimization, the system automatically discovers which sensor pairs observe common regions, estimates pairwise spatial transformations using RANSAC-based robust estimation, and jointly optimizes all sensor poses through bundle adjustment. The framework handles practical deployment challenges, including different sensor sampling rates (1-10 Hz), varying installation positions, unknown orientations, and limited overlap regions (>10%). When approximate sensor positions are available from installation surveys (+/-1m accuracy), the algorithm additionally estimates sensor orientations, refining both position and rotation to sub-meter and sub-degree accuracy. We validate the framework on multi-hour traffic datasets from six heterogeneous sensors with sampling rates ranging from 1 Hz to 10 Hz. Results demonstrate successful calibration even with sparse overlap (<20%) and automatic detection of miscalibrations exceeding 0.8 meters. This work enables a "deploy-and-forget" sensor infrastructure that maintains calibration autonomously, reducing maintenance costs while improving tracking accuracy. The techniques generalize beyond transportation to any multi-sensor monitoring application requiring robust spatial alignment, including smart cities, industrial monitoring, and surveillance systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2017

Coastal California's Fog as a Unique Habitable Niche: Design for Autonomous Sampling and Preliminary Aerobiological Characterization

Just as on the land or in the ocean, atmospheric regions may be more or less hospitable to life. The aerobiosphere, or collection of living things in Earth's atmosphere, is poorly understood due to the small number and ad hoc nature of samples studied. However, we know viable airborne microbes play important roles, such as providing cloud condensation nuclei. Knowing the distribution of such microorganisms and how their activity can alter water, carbon, and other geochemical cycles is key to developing criteria for planetary habitability, particularly for potential habitats with wet atmospheres but little stable surface water. Coastal California has regular, dense fog known to play a major transport role in the local ecosystem. In addition to the significant local (1 km) geographical variation in typical fog, previous studies have found that changes in height above surface of as little as a few meters can yield significant differences in typical concentrations, populations and residence times. No single current sampling platform (ground-based impactors, towers, balloons, aircraft) is capable of accessing all of these regions of interest.A novel passive fog and cloud water sampler, consisting of a lightweight passive impactor suspended from autonomous aerial vehicles (UAVs), is being developed to allow 4D point sampling within a single fog bank, allowing closer study of small-scale (100 m) system dynamics. Fog and cloud droplet water samples from low-altitude aircraft flights in nearby coastal waters were collected and assayed to estimate the required sample volumes, flight times, and sensitivity thresholds of the system under design.125 cloud water samples were collected from 16 flights of the Center for Interdisciplinary Remotely Piloted Aircraft Studies (CIRPAS) instrumented Twin Otter, equipped with a sampling tube collector, occurring between 18 July and 12 August 2016 below 1 km altitude off the central coast. The collector was flushed first with 70 ethanol, then with sterile DI water, between sampling regions. Collected volumes ranged from 100 L to 12 mL. All samples were diluted serially and plated on two different types of agar, nutrient-dense (PCA) and sparse (R-2A). Plates were incubated at room temperature and counted when colonies first appeared and again at 2 weeks.Preliminary results from seven flights are consistent with generally reported colony-forming unit (CFU) values for terrestrial fog water (e.g., [4]). The PCA assay ranged from 400 to 125,000 CFU/mL, R-2A from 700 to 130,000 CFU/mL. PCA and R-2A counts were not significantly different from each other at I^ plus or minus +/- 0.05, although observationally, the R2A plates had more pigmented colonies. CFU counts from the majority of flights were not different from each other in mean at the same level of significance, but about half differed in median, indicating differences in underlying distribution. These results validate the presence of viable microorganisms in coastal California fog at levels that should be easily detectable by our sampling system. The indicated distribution differences underscore the need for small-scale, long-term sampling surveys. Future planned work includes ion chromatography for limiting nutrients, ATP quantification, and qPCR for several microbial classes of interest.

Coastal↗
DOE OSTI2023

An Edge Alignment-Based Orientation Selection Method for Neutron Tomography

Neutron computed tomography (nCT) is a 3D char-acterization technique used to image the internal morphology or chemical composition of samples in biology and materials sciences. A typical workflow involves placing the sample in the path of a neutron beam, acquiring projection data at a predefined set of orientations, and processing the resulting data using an analytic reconstruction algorithm. Typical nCT scans require hours to days to complete and are then processed using conventional filtered back-projection (FBP), which performs poorly with sparse views or noisy data. Hence, the main methods in order to reduce overall acquisition time are the use of an improved sampling strategy combined with the use of advanced reconstruction methods such as model-based iterative reconstruction (MBIR). In this paper, we propose an adaptive orientation selection method in which an MBIR reconstruction on previously-acquired measurements is used to define an objective function on orientations that balances a data-fitting term promoting edge alignment and a regularization term promoting orientation diversity. Using simulated and experimental data, we demonstrate that our method produces high-quality reconstructions using significantly fewer total measurements than the conventional approach.

Yang, Diyu↗
DOE OSTI2020

Methodology for the development of empirical models relating 13C NMR spectral features to fuel properties

Effective formulation of new gasoline or diesel fuels for internal combustion engines would benefit from the development of reliable models for predicting key fuel properties based on a set of molecular descriptors obtained from a single measurement. This is particularly relevant in the case of renewable fuels, where the available fuel sample quantity may be limited. In this work, we present a statistically-based methodology for building empirical models to predict multiple properties from one-dimensional 13C nuclear magnetic resonance (NMR) spectra measured on around 200 microliters of a liquid fuel. NMR spectra contain information about the molecular composition of a sample and the carbon types and molecular substructures therein. Our approach uses this information to build sparse, interpretable models, where the predicted properties are linked to specific molecular features. The approach takes into consideration the constrained nature of the features making up the one-dimensional NMR spectrum, which, after standardization, represent a relative fuel composition. We point to the limitations in interpretability that arise when building this type of empirical predictive model and suggest how these limitations may be diminished. Among the many properties important for maximizing engine performance and minimizing emissions, we build models that predict derived cetane number and distillation temperatures as these are of particular interest because of their links to fuel economy, drivability, and engine-out emissions. Results suggest that the properties of interest may be impacted by only a few of the 27 13C NMR regions represented in the data, pointing to new directions for further testing in the development of improved fuels.

predictive models, biofuels., NMR Analysis↗
DOE OSTI2021

On-chip spectrometers using stratified waveguide filters

We present an ultra-compact single-shot spectrometer on silicon platform for sparse spectrum reconstruction. It consists of 32 stratified waveguide filters (SWFs) with diverse transmission spectra for sampling the unknown spectrum of the input signal and a specially designed ultra-compact structure for splitting the incident signal into those 32 filters with low power imbalance. Each SWF has a footprint less than 1 µm × 30,µm, while the 1 × 32 splitter and 32 filters in total occupy an area of about 35 µm × 260 µm, which to the best of our knowledge, is the smallest footprint spectrometer realized on silicon photonic platform. Experimental characteristics of the fabricated spectrometer demonstrate a broad operating bandwidth of 180 nm centered at 1550 nm and narrowband peaks with 0.45 nm Full-Width-Half-Maximum (FWHM) can be clearly resolved. This concept can also be implemented using other material platforms for operation in optical spectral bands of interest for various applications.

42 ENGINEERING↗
DOE OSTI2023

MetaFlux: Meta-learning global carbon fluxes from sparse spatiotemporal observations

We provide a global, long-term carbon flux dataset of gross primary production and ecosystem respiration generated using meta-learning, called MetaFlux. The idea behind meta-learning stems from the need to learn efficiently given sparse data by learning how to learn broad features across tasks to better infer other poorly sampled ones. Using meta-trained ensemble of deep models, we generate global carbon products on daily and monthly timescales at a 0.25-degree spatial resolution from 2001 to 2021, through a combination of reanalysis and remote-sensing products. Site-level validation finds that MetaFlux ensembles have lower validation error by 5–7% compared to their non-meta-trained counterparts. In addition, they are more robust to extreme observations, with 4–24% lower errors. We also checked for seasonality, interannual variability, and correlation to solar-induced fluorescence of the upscaled product and found that MetaFlux outperformed other machine-learning based carbon product, especially in the tropics and semi-arids by 10–40%. Overall, MetaFlux can be used to study a wide range of biogeochemical processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Efficient learning of accurate surrogates for simulations of complex systems

Machine learning methods are increasingly deployed to construct surrogate models for complex physical systems at a reduced computational cost. However, the predictive capability of these surrogates degrades in the presence of noisy, sparse or dynamic data. Here, we introduce an online learning method empowered by optimizer-driven sampling that has two advantages over current approaches: it ensures that all local extrema (including endpoints) of the model response surface are included in the training data, and it employs a continuous validation and update process in which surrogates undergo retraining when their performance falls below a validity threshold. We find, using benchmark functions, that optimizer-directed sampling generally outperforms traditional sampling methods in terms of accuracy around local extrema even when the scoring metric is biased towards assessing overall accuracy. Finally, the application to dense nuclear matter demonstrates that highly accurate surrogates for a nuclear equation-of-state model can be reliably autogenerated from expensive calculations using few model evaluations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2012

An Adaptive Sparse-Grid High-Order Stochastic Collocation Method for Bayesian Inference in Groundwater Reactive Transport Modeling

Although Bayesian analysis has become vital to the quantification of prediction uncertainty in groundwater modeling, its application has been hindered due to the computational cost associated with numerous model executions needed for exploring the posterior probability density function (PPDF) of model parameters. This is particularly the case when the PPDF is estimated using Markov Chain Monte Carlo (MCMC) sampling. In this study, we develop a new approach that improves computational efficiency of Bayesian inference by constructing a surrogate system based on an adaptive sparse-grid high-order stochastic collocation (aSG-hSC) method. Unlike previous works using first-order hierarchical basis, we utilize a compactly supported higher-order hierar- chical basis to construct the surrogate system, resulting in a significant reduction in the number of computational simulations required. In addition, we use hierarchical surplus as an error indi- cator to determine adaptive sparse grids. This allows local refinement in the uncertain domain and/or anisotropic detection with respect to the random model parameters, which further improves computational efficiency. Finally, we incorporate a global optimization technique and propose an iterative algorithm for building the surrogate system for the PPDF with multiple significant modes. Once the surrogate system is determined, the PPDF can be evaluated by sampling the surrogate system directly with very little computational cost. The developed method is evaluated first using a simple analytical density function with multiple modes and then using two synthetic groundwater reactive transport models. The groundwater models represent different levels of complexity; the first example involves coupled linear reactions and the second example simulates nonlinear ura- nium surface complexation. The results show that the aSG-hSC is an effective and efficient tool for Bayesian inference in groundwater modeling in comparison with conventional MCMC sim- ulations. The computational efficiency is expected to be more beneficial to more computational expensive groundwater problems.

Zhang, Guannan↗
DOE OSTI2010

Multicanonical sampling of rare events in random matrices

A method based on multicanonical Monte Carlo is applied to the calculation of large deviations in the largest eigenvalue of random matrices. The method is successfully tested with the Gaussian orthogonal ensemble, sparse random matrices, and matrices whose components are subject to uniform density. Specifically, the probability that all eigenvalues of a matrix are negative is estimated in these cases down to the values of {approx}10{sup -200}, a region where simple random sampling is ineffective. The method can be applied to any ensemble of matrices and used for sampling rare events characterized by any statistics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2014

A weighted ℓ{sub 1}-minimization approach for sparse polynomial chaos expansions

This work proposes a method for sparse polynomial chaos (PC) approximation of high-dimensional stochastic functions based on non-adapted random sampling. We modify the standard ℓ{sub 1}-minimization algorithm, originally proposed in the context of compressive sampling, using a priori information about the decay of the PC coefficients, when available, and refer to the resulting algorithm as weightedℓ{sub 1}-minimization. We provide conditions under which we may guarantee recovery using this weighted scheme. Numerical tests are used to compare the weighted and non-weighted methods for the recovery of solutions to two differential equations with high-dimensional random inputs: a boundary value problem with a random elliptic operator and a 2-D thermally driven cavity flow with random boundary condition.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
NASA NTRS2017

Identifying the Effects of X-Ray Computed Tomography on Mars 2020 Tier I Organic Compounds

Mars sample return presents unique challenges for the clean collection, containment, curation and processing of samples. The related issues of life detection and Planetary Protection are of particular importance when developing successful strategies for the acquisition and handling of Mars returned samples. In order to achieve the Mars Sample Return (MSR) science goals, reliable analyses will depend on overcoming some challenging signal/noise-related issues, such that sparse Martian organic compounds will need to be reliably analyzed against the contamination background arising from the complicated MSR campaign. Reliable analyses will depend on clean acquisition, as well as robust documentation of all aspects of both the development and management of the cache.

Weizenbach, L. C.↗
DOE OSTI2023

Modeling Intercalation Chemistry with Multiredox Reactions by Sparse Lattice Models in Disordered Rocksalt Cathodes

Modern battery materials can contain many elements with substantial site disorder, and their configurational state has been shown to be critical for their performance. The intercalation voltage profile is a critical parameter to evaluate the performance of energy storage. The application of commonly used cluster expansion techniques to model the intercalation thermodynamics of such systems ab initio is challenged by the combinatorial increase in configurational degrees of freedom as the number of species grows. Such challenges necessitate the efficient generation of lattice models without overfitting and proper sampling of the configurational space under the requirement of charge balance in ionic systems. In this work, we introduce a combined approach that addresses these challenges by (1) constructing a robust cluster expansion Hamiltonian using the sparse regression technique, including -norm regularization and structural hierarchy; and (2) implementing semigrand-canonical Monte Carlo to sample charge-balanced ionic configurations using the table-exchange method and an ensemble average approach. These techniques are applied to a disordered rocksalt oxyfluoride (LMNOF) that is part of a family of promising earth-abundant cathode materials. The simulated voltage profile is found to be in good agreement with experimental data and particularly provides a clear demonstration of the and oxygen contributions to the redox potential as a function of content.

25 ENERGY STORAGE↗
DOE OSTI2017

Reconstructing three-dimensional protein crystal intensities from sparse unoriented two-axis X-ray diffraction patterns

Recently, there has been a growing interest in adapting serial microcrystallography (SMX) experiments to existing storage ring (SR) sources. For very small crystals, however, radiation damage occurs before sufficient numbers of photons are diffracted to determine the orientation of the crystal. The challenge is to merge data from a large number of such `sparse' frames in order to measure the full reciprocal space intensity. To simulate sparse frames, a dataset was collected from a large lysozyme crystal illuminated by a dim X-ray source. The crystal was continuously rotated about two orthogonal axes to sample a subset of the rotation space. With the EMC algorithm [expand–maximize–compress; Loh & Elser (2009). Phys. Rev. E , 80 , 026705], it is shown that the diffracted intensity of the crystal can still be reconstructed even without knowledge of the orientation of the crystal in any sparse frame. Moreover, parallel computation implementations were designed to considerably improve the time and memory scaling of the algorithm. The results show that EMC-based SMX experiments should be feasible at SR sources.

Chemistry↗
DOE OSTI2022

Di- and Tetrameric Molybdenum Sulfide Clusters Activate and Stabilize Dihydrogen as Hydrides

NaY zeolite-encapsulated dimeric (Mo 2 S 4 ) and tetrameric (Mo 4 S 4 ) molybdenum sulfide clusters stabilize hydrogen as hydride binding to Mo atoms. Density functional theory (DFT) calculations and adsorption measurements suggest that stabilization of hydrogen as sulfhydryl (SH) groups, as typical for layered MoS 2 , is thermodynamically disfavored. Competitive adsorption of H 2 and ethene on Mo was probed by quantifying adsorbed CO on partly hydrogen and/or ethene covered samples with IR spectroscopy. During hydrogenation, experiment and theory suggest that Mo is covered predominately with ethene and sparsely with hydride. DFT calculations further predict that under reaction conditions, each Mo x S y cluster can activate only one H 2 , suggesting that the entire cluster (irrespective of its nuclearity) acts as one active site for hydrogenation. The nearly identical turnover frequencies (24.7 ± 3.3 mol ethane ·h -1 ·mol cluster -1 ), apparent activation energies (31-32 kJ·mol -1 ), and reaction orders (~0.5 in ethene and ~1.0 in H 2 ) show that the active sites in both clusters are catalytically indistinguishable.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Demonstration of an AI-driven workflow for autonomous high-resolution scanning microscopy

Abstract Modern scanning microscopes can image materials with up to sub-atomic spatial and sub-picosecond time resolutions, but these capabilities come with large volumes of data, which can be difficult to store and analyze. We report the Fast Autonomous Scanning Toolkit (FAST) that addresses this challenge by combining a neural network, route optimization, and efficient hardware controls to enable a self-driving experiment that actively identifies and measures a sparse but representative data subset in lieu of the full dataset. FAST requires no prior information about the sample, is computationally efficient, and uses generic hardware controls with minimal experiment-specific wrapping. We test FAST in simulations and a dark-field X-ray microscopy experiment of a WSe 2 film. Our studies show that a FAST scan of <25% is sufficient to accurately image and analyze the sample. FAST is easy to adapt for any scanning microscope; its broad adoption will empower general multi-level studies of materials evolution with respect to time, temperature, or other parameters.

47 OTHER INSTRUMENTATION↗
NASA NTRSDate not supplied

Lessons from Earth Aerobiology for Venus Astrobiology

Venus’s clouds have often suggested as a possible habitat. The constraints governing putative airborne life in such a habitat in turn inform priorities and strategies for remote and in situ exploration, methods by which resulting biosignatures might be detected, exoplanet habitability assessment, and planetary protection concerns. Lessons drawn from studying Earth’s aerobiosphere can help improve this understanding. There are altitude ranges within Venus’s clouds in which temperature, pressure, particle size, and radiation appear to be within the limits of microbial life on Earth, and life cycles involving S- and Fe-based redox metabolism have been proposed. However, given the lack of a habitable surface reservoir, a long-term stable Venus aerobiosphere would require that the reproduction rate of the airborne microbes be faster than the settling rate of airborne microbes due to gravity, or eventually the population would be depleted; put another way, the mean generation time would need to exceed the mean residence time. This creates a joint constraint of aerosol dynamics, potential nutrient availability and energy influx, and bioenergetic costs such as desiccation and radiation damage. Even at an optimistic estimate of 75% H2SO4, Venus aerosol water activity (aw) is still ~0.02, far below the observed microbial growth limit of ~0.6. Long-term desiccation with brief spurts of repair and growth in response to transient water influx, such as from volcanism, is the most likely model for Earth-like life on Venus – a ‘desert bloom’ scenario. Several high-priority science goals – cloud aerosol composition, internal radiative flux, and aerosol residence time and circulation models – thus will also improve our understanding of Venus in an astrobiology context. In Earth’s troposphere, warm water clouds can carry 103 – 105 cells/mL, some metabolically active. However, Earth’s stratospheric sulfate aerosol layer may be a better analogue: supercooled sulfuric acidaerosols (acid weight fraction 0.6 – 0.85, 0.1 – 1 μm diameter, 0.1 – 1 cm-3) with little water activity, long residence times, high UV radiation, and only sporadic influx from surface particle sources. Though ‘hot spots’ can occur associated with tropospheric mixing, viable cells in stratospheric samples are rare (~102 cells/m3), and primarily inactive forms such as spores. It is not yet clear whether such bioaerosols are associated with sulfate aerosols or simply co-located, and reproduction in situ has not yet been observed. In this model of a sparse, largely dormant Venus ecosystem, a single transect on descent is likely to pass through a low-water, inactive region, missing potential signs of habitability or biosignatures. A targeted strategy would sample through an aerial region with some upwelling from surface sources, andtake multiple transects separated in time and space. This is compatible with other in situ science goals seeking to understand the dynamics and heterogeneities of Venus’s clouds.

Lower atmosphere↗
DOE OSTI2015

Low-rank matrix decomposition and spatio-temporal sparse recovery for STAP radar

We develop space-time adaptive processing (STAP) methods by leveraging the advantages of sparse signal processing techniques in order to detect a slowly-moving target. We observe that the inherent sparse characteristics of a STAP problem can be formulated as the low-rankness of clutter covariance matrix when compared to the total adaptive degrees-of-freedom, and also as the sparse interference spectrum on the spatio-temporal domain. By exploiting these sparse properties, we propose two approaches for estimating the interference covariance matrix. In the first approach, we consider a constrained matrix rank minimization problem (RMP) to decompose the sample covariance matrix into a low-rank positive semidefinite and a diagonal matrix. The solution of RMP is obtained by applying the trace minimization technique and the singular value decomposition with matrix shrinkage operator. Our second approach deals with the atomic norm minimization problem to recover the clutter response-vector that has a sparse support on the spatio-temporal plane. We use convex relaxation based standard sparse-recovery techniques to find the solutions. With extensive numerical examples, we demonstrate the performances of proposed STAP approaches with respect to both the ideal and practical scenarios, involving Doppler-ambiguous clutter ridges, spatial and temporal decorrelation effects. As a result, the low-rank matrix decomposition based solution requires secondary measurements as many as twice the clutter rank to attain a near-ideal STAP performance; whereas the spatio-temporal sparsity based approach needs a considerably small number of secondary data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗