Search NASA⌕ Search

SEARCH · Search NASA

Results for “sparse”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,279 records · Page 71

Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do not provide uncertainty estimates, which are crucial for establishing the trustworthiness of these techniques in downstream decision making tasks and scenarios. In recent years, ensemble-based methods have achieved significant success for the uncertainty quantification in DNNs on a number of benchmark problems. However, their performance on real-world applications remains under-explored. In this work, we present an automated approach to DNN discovery and demonstrate how this may also be utilized for ensemble-based uncertainty quantification. Specifically, we propose the use of a scalable neural and hyperparameter architecture search for discovering an ensemble of DNN models for complex dynamical systems. We highlight how the proposed method not only discovers high-performing neural network ensembles for our tasks, but also quantifies uncertainty seamlessly. This is achieved by using genetic algorithms and Bayesian optimization for sampling the search space of neural network architectures and hyperparameters. Subsequently, a model selection approach is used to identify candidate models for an ensemble set construction. Afterwards, a variance decomposition approach is used to estimate the uncertainty of the predictions from the ensemble. We demonstrate the feasibility of this framework for two tasks — forecasting from historical data and flow reconstruction from sparse sensors for the sea-surface temperature. In conclusion, we demonstrate superior performance from the ensemble in contrast with individual high-performing models and other benchmarks.

Deep ensembles↗

Machine learning and shallow groundwater chemistry to identify geothermal prospects in the Great Basin, USA

This study discovers various geothermal prospects in the Great Basin, USA based on shallow groundwater chemical (geochemical) data. The geochemical data are expected to include hidden (latent) information that is a proxy for geothermal prospectivity. We processed the sparse geochemical data in the Great Basin at 14,341 locations including 18 attributes. Next, a non-negative matrix factorization with customized k-means clustering is applied to the geochemical data matrix that automatically finds three hidden geothermal signatures representing modestly, moderately, and highly confident geothermal prospects. The algorithm also evaluated the probability of occurrence of these types of resources through the studied region. There is a consistency between regional geothermal prospectivity as estimated by our ML methodology and the traditional play fairway analysis conducted over a portion of the study area. We also identify the dominant data attributes associated with each signature. Finally, our ML analyses allow us to reconstruct attributes from sparse into continuous over the study domain. The predicted continuous attributes can be used for future detailed geothermal explorations in the Great Basin.

15 GEOTHERMAL ENERGY↗

A Bayesian model for multivariate discrete data using spatial and expert information with application to inferring building attributes

When modeling sparsely observed multivariate data, strong prior information elicited from experts can be used to bolster predictive accuracy and counteract sampling bias. Similarly, modeling autocorrelation in space can help make use of co-occurrence patterns present in many types of spatial data. To make use of both expert prior information and spatial structure, we propose a novel graphical model for a spatial Bayesian network developed specifically to address challenges in inferring the attributes of buildings from geographically sparse observational data. This model is implemented as the sum of a spatial multivariate Gaussian random field and a tabular conditional probability function in real-valued space prior to projection onto the probability simplex. This modeling form is especially suitable for the usage of prior information in the form of sets of atomic rules obtained from experts. To perform inference with missing data, we implement a Markov chain Monte Carlo scheme composed of alternating steps of Gibbs sampling of missing entries and Hamiltonian Monte Carlo for model parameters. A case study in building attribution is presented to highlight the advantages and limitations of this approach.

97 MATHEMATICS AND COMPUTING↗

Recovering fine details from under-resolved electron tomography data using higher order total variation ℓ 1 regularization

Over the last decade or so, reconstruction methods using ℓ 1 regularization, often categorized as compressed sensing (CS) algorithms, have significantly improved the capabilities of high fidelity imaging in electron tomography. The most popular ℓ 1 regularization approach within electron tomography has been total variation (TV) regularization. In addition to reducing unwanted noise, TV regularization encourages a piecewise constant solution with sparse boundary regions. In this paper we propose an alternative ℓ 1 regularization approach for electron tomography based on higher order total variation (HOTV). Like TV, the HOTV approach promotes solutions with sparse boundary regions. In smooth regions however, the solution is not limited to piecewise constant behavior. We demonstrate that this allows for more accurate reconstruction of a broader class of images – even those for which TV was designed for – particularly when dealing with pragmatic tomographic sampling patterns and very fine image features. In conclusion, we develop results for an electron tomography data set as well as a phantom example, and we also make comparisons with discrete tomography approaches.

47 OTHER INSTRUMENTATION↗

MCL1 inhibition enhances the efficacy of docetaxel against airway-derived squamous cell carcinoma cells

Highlights: • Authentic squamous cell carcinoma (SqCC) cell lines of the lung are sparse. • HARA lung SqCC cells depend highly on MCL1 for survival in vitro and in vivo. • MCL1-silenced HARA cells decline in number upon docetaxel (DTX) exposure. • High MCL1 mRNA expression is linked with shorter survival in lung SqCC patients. • MCL1 depletion + DTX is highly effective against Detroit 562 pharyngeal SqCC cells. MCL1 is an anti-apoptotic BCL2 family member that is often overexpressed in various malignant tumors. However, few reports have described the role of MCL1 in squamous cell carcinoma (SqCC) derived from airways including the lung. In this study, we examined whether MCL1 could be a novel druggable target for airway-derived SqCC, for which effective molecular targeted drugs are unavailable. We searched the Kaplan–Meier Plotter database and found that high MCL1 mRNA expression was significantly associated with shorter survival in patients with lower airway (lung) or upper airway (head and neck) derived SqCC. We also explored the Expression Atlas database and learned that authentic lung SqCC cell lines expressing both TP63 and KRT5 mRNA were extremely sparse among the publicly available “lung SqCC cell lines”, with an exception being HARA cells. HARA cells were highly dependent on MCL1 for survival, and MCL1-depleted cells were not able to grow, and even declined in number, upon docetaxel (DTX) exposure in vitro and in vivo. Similar in vitro experimental findings, including those in a 3D culture model, were also obtained using Detroit 562 pharyngeal SqCC cells. These findings suggested that combined treatment with MCL1 silencing plus DTX appears highly effective against airway-derived SqCC.

60 APPLIED LIFE SCIENCES↗

Acquisition of STEM Images by Adaptive Compressive Sensing

Compressive Sensing (CS) allows a signal to be sparsely measured first and accurately recovered later in software [1]. In scanning transmission electron microscopy (STEM), it is possible to compress an image spatially by reducing the number of measured pixels, which decreases electron dose and increases sensing speed [2,3,4]. The two requirements for CS to work are: (1) sparsity of basis coefficients and (2) incoherence of the sensing system and the representation system. However, when pixels are missing from the image, it is difficult to have an incoherent sensing matrix. Nevertheless, dictionary learning techniques such as Beta-Process Factor Analysis (BPFA) [5] are able to simultaneously discover a basis and the sparse coefficients in the case of missing pixels. On top of CS, we would like to apply active learning [6,7] to further reduce the proportion of pixels being measured, while maintaining image reconstruction quality. Suppose we initially sample 10% of random pixels. We wish to select the next 1% of pixels that are most useful in recovering the image. Now, we have 11% of pixels, and we want to decide the next 1% of “most informative” pixels. Active learning methods are online and sequential in nature. Our goal is to adaptively discover the best sensing mask during acquisition using feedback about the structures in the image. In the end, we hope to recover a high quality reconstruction with a dose reduction relative to the non-adaptive (random) sensing scheme. In doing this, we try three metrics applied to the partial reconstructions for selecting the new set of pixels: (1) variance, (2) Kullback-Leibler (KL) divergence using a Radial Basis Function (RBF) kernel, and (3) entropy. Figs. 1 and 2 display the comparison of Peak Signal-to-Noise (PSNR) using these three different active learning methods at different percentages of sampled pixels. At 20% level, all the three active learning methods underperform the original CS without active learning. However, they all beat the original CS as more of the “most informative” pixels are sampled. One can also argue that CS equipped with active learning requires less sampled pixels to achieve the same value of PSNR than CS with pixels randomly sampled, since all the three PSNR curves with active learning grow at a faster pace than that without active learning. For this particular STEM image, by observing the reconstructed images and the sensing masks, we find that while the method based on RBF kernel acquires samples more uniformly, the one on entropy samples more areas of significant change, thus less uniformly. The KL-divergence method performs the best in terms of reconstruction error (PSNR) for this example [8].

Xie, Weiyi↗

Compressed Sensing of Scanning Transmission Electron Microscopy (STEM) With Nonrectangular Scans

Scanning transmission electron microscopy (STEM) has become the main stay for materials characterization on atomic level, with applications ranging from visualization of localized and extended defects to mapping order parameter fields. In recent years, attention has focused on the potential of STEM to explore beam induced chemical processes and especially manipulating atomic motion, enabling atom-by-atom fabrication. These applications, as well as traditional imaging of beam sensitive materials, necessitate increasing the dynamic range of STEM in imaging and manipulation modes, and increasing the absolute scanning speed which can be achieved by combining sparse sensing methods with nonrectangular scanning trajectories. We have developed a general method for real-time reconstruction of sparsely sampled images from high-speed, noninvasive and diverse scanning pathways, including spiral scan and Lissajous scan. This approach is demonstrated on both the synthetic data and experimental STEM data on the beam sensitive material graphene. This work opens the door for comprehensive investigation and optimal design of dose efficient scanning strategies and real-time adaptive inference and control of e-beam induced atomic fabrication.

47 OTHER INSTRUMENTATION↗

Recursive Factorization of the Inverse Overlap Matrix in Linear Scaling Quantum Molecular Dynamics Simulations

We present a reduced complexity algorithm to compute the inverse overlap factors required to solve the generalized eigenvalue problem in a quantum-based molecular dynamics (MD) simulation. Our method is based on the recursive iterative re nement of an initial guess Z of the inverse overlap matrix S. The initial guess of Z is obtained beforehand either by using an approximate divide and conquer technique or dynamically, propagated within an extended Lagrangian dynamics from previous MD time steps. With this formulation, we achieve long-term stability and energy conservation even under incomplete approximate iterative re nement of Z. Linear scaling performance is obtained using numerically thresholded sparse matrix algebra based on the ELLPACK-R sparse matrix data format, which also enables e cient shared memory parallelization. As we show in this article using selfconsistent density functional based tight-binding MD, our approach is faster than conventional methods based on the direct diagonalization of the overlap matrix S for systems as small as a few hundred atoms, substantially accelerating quantum-based simulations even for molecular structures of intermediate size. For a 4,158 atom water-solvated polyalanine system we nd an average speedup factor of 122 for the computation of Z in each MD step.

36 MATERIALS SCIENCE↗

Combined Force-Frequency Sampling for Simulation of Systems Having Rugged Free Energy Landscapes.

An adaptive, machine learning-based sampling method is presented for simulation of systems having rugged, multidimensional free energy landscapes. The method's main strength resides in its ability to learn both from the frequency of visits to distinct states and the generalized force estimates that arise in a system as it evolves in phase space. This is accomplished by introducing a self-integrating artificial neural network, which generates an estimate of the free energy directly from its derivatives. The usefulness of the proposed combined approach is examined in the context of two concrete examples, namely, an alanine dipeptide molecule in water and a polymer diffusing through a narrow pore. This new method is found to be robust, faster, and more accurate than approaches that rely only on frequency-based or generalized force-based estimations. After combining the proposed approach with overfill protection and support for sparse data storage and training, the method is shown to be more effective than comparable, previously available techniques and capable of scaling efficiently to larger numbers of collective variables.

Sevgen, Emre↗

What is the best method to fit time-resolved data? A comparison of the residual minimization and the maximum likelihood techniques as applied to experimental time-correlated, single-photon counting data

The need for measuring fluorescence lifetimes of species in subdiffraction-limited volumes in, for example, stimulated emission depletion (STED) microscopy, entails the dual challenge of probing a small number of fluorophores and fitting the concomitant sparse data set to the appropriate excited-state decay function. This need has stimulated a further investigation into the relative merits of two fitting techniques commonly referred to as “residual minimization” (RM) and “maximum likelihood” (ML). Fluorescence decays of the well-characterized standard, rose bengal in methanol at room temperature (530 ± 10 ps), were acquired in a set of five experiments in which the total number of “photon counts” was approximately 20, 200, 1000, 3000, and 6000 and there were about 2–200 counts at the maxima of the respective decays. Each set of experiments was repeated 50 times to generate the appropriate statistics. Each of the 250 data sets was analyzed by ML and two different RM methods (differing in the weighting of residuals) using in-house routines and compared with a frequently used commercial RM routine. Convolution with a real instrument response function was always included in the fitting. While RM using Pearson’s weighting of residuals can recover the correct mean result with a total number of counts of 1000 or more, ML distinguishes itself by yielding, in all cases, the same mean lifetime within 2% of the accepted value. For 200 total counts and greater, ML always provides a standard deviation of <10% of the mean lifetime, and even at 20 total counts there is only 20% error in the mean lifetime. Here, the robustness of ML advocates its use for sparse data sets such as those acquired in some subdiffraction-limited microscopies, such as STED, and, more importantly, provides greater motivation for exploiting the time-resolved capacities of this technique to acquire and analyze fluorescence lifetime data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Upstream and Downstream Boundary Conditions Control the Physical and Biological Development of River Deltas

Relative sea level rise is depleting coastal land. Success in coastal restoration depends on understanding interactions between physical and biological processes that influence landscape change. We present results from flume experiments examining the coevolution of vegetation and delta channel networks. We show that channel mobility—controlled by upstream and downstream boundary conditions and delta size—controls vegetation colonization. The spatial patterns of plants in turn control the stability and spatial distribution of channels. Experiments with low–channel mobility develop large, dense plant patches that become denser over time and stabilize channels. Experiments with more mobile channels have sparse vegetation patterns that limit vegetation growth within existing patches, maintaining sparse, patchy vegetation. Thus, the ecogeomorphic development of deltas depends on the rate of channel lateral migration and avulsion, suggesting that upstream and downstream boundary conditions control both the physical and biological evolution of coastal landscapes.

54 ENVIRONMENTAL SCIENCES↗

Soil Respiration Variability and Correlation Across a Wide Range of Temporal Scales

Abstract The high temporal variability of the soil‐to‐atmosphere CO 2 flux (soil respiration, R S ) has been studied at hourly to multiannual time scales but remains less well understood than R S spatial variability. How R S fluxes vary and are autocorrelated at various time lags has practical implications for sampling and more fundamentally for our understanding of its abiotic and biotic underlying mechanisms. We examined the variability, correlation, and sampling requirements of R S over a wide range of temporal scales in a temperate deciduous forest in eastern Maryland, USA, using both automated (temporally continuous, N = 30,036 over 10 months) and survey (spatially diverse, temporally sparse, N = 1,912 over 17 months) data. Data from a global R S database were also used to examine interannual variability in comparable forests. The coefficient of variability of successive measurements generally varied from the minute (median coefficient of variation 16%) to hourly and daily (11–12%) time scales. Successive R S values measured at a given collar exhibited a strong hour‐to‐hour correlation ( r = 0.931) and a moderate correlation at a 2‐hr lag (0.289); day‐to‐day (i.e., 24 hr lag) hourly observations were uncorrelated. Daily R S means were well correlated at a 1‐day lag ( r = 0.856) but not at any further time lag. In a linear mixed‐effects model predicting R S , soil temperature and moisture exerted consistently strong effects regardless of time scale, and model coefficient of variability was generally high (>80%). These results provide new opportunities to explore the drivers and variability of R S fluxes, quantify sampling requirements, and improve error propagation.

Bond‐Lamberty, Ben↗

Regional Moment Tensor Inversion Using Rotational Observations

There are benefits from the addition of rotational motions to translational displacements for moment tensor (MT) inversions. The rotational radiation pattern is orthogonal to the shear radiation pattern, thus incorporating rotations is equivalent to gaining another observation point on the focal sphere. We demonstrated this by simulating curl and displacement wavefields for a regional distance station. Thus, one 6-C station (3-Component translational + 3-Component rotational) gathers the same information on radiation pattern as two 3-C stations at 90° azimuth from one another along the focal plane axis, which is sometimes difficult to obtain when restricted to surface sensors. We added rotational Green's functions to a regional MT inversion scheme (long-period, time-domain, and linear inversion) by computing spatial gradients from f-κ reflectivity synthetics. For rotational data, we used Array Derived Rotations (ADR) from Piñon Flats Observatory Array and Golay array deployed during IRIS Community Wavefield Demonstration Experiment. The hope is to ultimately use compact and field deployable broadband rotational seismometers instead of ADRs. Rotational motions were predicted from well-constrained deviatoric MT solutions of nine earthquakes recorded by the arrays and other seismic networks. Additionally, we formed three station sparse datasets with (3-C and 6-C) and without rotational ground motions (3-C only) for eight earthquakes testing the benefits of including rotational waveforms in MT inversions when they are equally weighted with translational waveforms. Adding rotational motions improved the double-couple components and reduced compensated-linear-vector-dipole and isotropic components in full-MT solutions using sparse datasets with poor coverage.

58 GEOSCIENCES↗

Diversity of visual inputs to Kenyon cells of the Drosophila mushroom body

The arthropod mushroom body is well-studied as an expansion layer representing olfactory stimuli and linking them to contingent events. However, 8% of mushroom body Kenyon cells in Drosophila melanogaster receive predominantly visual input, and their function remains unclear. Here, we identify inputs to visual Kenyon cells using the FlyWire adult whole-brain connectome. Input repertoires are similar across hemispheres and connectomes with certain inputs highly overrepresented. Many visual neurons presynaptic to Kenyon cells have large receptive fields, while interneuron inputs receive spatially restricted signals that may be tuned to specific visual features. Individual visual Kenyon cells randomly sample sparse inputs from combinations of visual channels, including multiple optic lobe neuropils. These connectivity patterns suggest that visual coding in the mushroom body, like olfactory coding, is sparse, distributed, and combinatorial. However, the specific input repertoire to the smaller population of visual Kenyon cells suggests a constrained encoding of visual stimuli.

59 BASIC BIOLOGICAL SCIENCES↗

A Bayesian framework for adsorption energy prediction on bimetallic alloy catalysts

Abstract For high-throughput screening of materials for heterogeneous catalysis, scaling relations provides an efficient scheme to estimate the chemisorption energies of hydrogenated species. However, conditioning on a single descriptor ignores the model uncertainty and leads to suboptimal prediction of the chemisorption energy. In this article, we extend the single descriptor linear scaling relation to a multi-descriptor linear regression models to leverage the correlation between adsorption energy of any two pair of adsorbates. With a large dataset, we use Bayesian Information Criteria (BIC) as the model evidence to select the best linear regression model. Furthermore, Gaussian Process Regression (GPR) based on the meaningful convolution of physical properties of the metal-adsorbate complex can be used to predict the baseline residual of the selected model. This integrated Bayesian model selection and Gaussian process regression, dubbed as residual learning, can achieve performance comparable to standard DFT error (0.1 eV) for most adsorbate system. For sparse and small datasets, we propose an ad hoc Bayesian Model Averaging (BMA) approach to make a robust prediction. With this Bayesian framework, we significantly reduce the model uncertainty and improve the prediction accuracy. The possibilities of the framework for high-throughput catalytic materials exploration in a realistic setting is illustrated using large and small sets of both dense and sparse simulated dataset generated from a public database of bimetallic alloys available in Catalysis-Hub.org.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncertainty-aware molecular dynamics from Bayesian active learning for phase transformations and thermal transport in SiC

Abstract Machine learning interatomic force fields are promising for combining high computational efficiency and accuracy in modeling quantum interactions and simulating atomistic dynamics. Active learning methods have been recently developed to train force fields efficiently and automatically. Among them, Bayesian active learning utilizes principled uncertainty quantification to make data acquisition decisions. In this work, we present a general Bayesian active learning workflow, where the force field is constructed from a sparse Gaussian process regression model based on atomic cluster expansion descriptors. To circumvent the high computational cost of the sparse Gaussian process uncertainty calculation, we formulate a high-performance approximate mapping of the uncertainty and demonstrate a speedup of several orders of magnitude. We demonstrate the autonomous active learning workflow by training a Bayesian force field model for silicon carbide (SiC) polymorphs in only a few days of computer time and show that pressure-induced phase transformations are accurately captured. The resulting model exhibits close agreement with both ab initio calculations and experimental measurements, and outperforms existing empirical models on vibrational and thermal properties. The active learning workflow readily generalizes to a wide range of material systems and accelerates their computational understanding.

36 MATERIALS SCIENCE↗

Dynamic nanodomains dictate macroscopic properties in lead halide perovskites

Lead halide perovskites have emerged as promising materials for solar energy conversion and X-ray detection owing to their remarkable optoelectronic properties. However, the microscopic origins of their superior performance remain unclear. Here we show that low-symmetry dynamic nanodomains present in the high-symmetry average cubic phases, whose characteristics are dictated by the A-site cation, govern the macroscopic behaviour. We combine X-ray diffuse scattering, inelastic neutron spectroscopy, hyperspectral photoluminescence microscopy and machine-learning-assisted molecular dynamics simulations to directly correlate local nanoscale dynamics with macroscopic optoelectronic response. Our approach reveals that methylammonium-based perovskites form densely packed, anisotropic dynamic nanodomains with out-of-phase octahedral tilting, whereas formamidinium-based systems develop sparse, isotropic, spherical nanodomains with in-phase tilting, even when crystallography reveals cubic symmetry on average. We demonstrate that these sparsely distributed isotropic nanodomains present in formamidinium-based systems reduce electronic dynamic disorder, resulting in a beneficial optoelectronic response, thereby enhancing the performance of formamidinium-based lead halide perovskite devices. By elucidating the influence of the A-site cation on local dynamic nanodomains, and consequently, on the macroscopic properties, we propose leveraging this relationship to engineer the optoelectronic response of these materials, propelling further advancements in perovskite-based photovoltaics, optoelectronics and X-ray imaging.

Materials Science↗