Search NASA⌕ Search

SEARCH · Search NASA

Results for “Sparsity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A Differentiable Hydrology Approach for Modeling With Time-Varying Parameters

In the analysis of observational data with mathematical models, it is often desirable to let one or more model parameters vary with time to account for changing environmental conditions or to offer more flexibility. A standard approach for dynamic models is to allow for the number of parameters to grow as a function of time, leading to a high-dimensional inference problem for long data records. We propose using Hamiltonian Monte Carlo, a gradient-based Markov chain Monte Carlo (MCMC) method, to perform Bayesian inference for time-varying parameters (TVP) in hydrology models. As derivatives of model error functions with regard to parameters are not available in closed form, we implemented the GR4J rainfall-runoff models in Theano/PyMC3, and Jax/NumPyro, allowing for the application of automatic differentiation techniques. A simulation experiment assessing the viability of these methods for recovering underlying temporal variation in parameters indicates that a discrete Gaussian random walk-based prior appears to be best suited across a range of scenarios while the continuous-time Gaussian process compares relatively poorly. In an analysis of 20 years of daily real-world streamflow records from the Model Parameter Estimation Experiment (MOPEX) hydrology data set with increasing data sparsity and at multiple temporal resolutions, we find that TVP inference with gradient-based MCMC is a flexible and reliable approach for analyzing hydrology models with dynamic parameter sets.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Dissipative ground state preparation in ab initio electronic structure theory

Dissipative engineering is a powerful tool for quantum state preparation, and has drawn significant attention in quantum algorithms and quantum many-body physics in recent years. In this work, we introduce a novel approach using the Lindblad dynamics to efficiently prepare the ground state for general ab initio electronic structure problems on quantum computers, without variational parameters. These problems often involve Hamiltonians that lack geometric locality or sparsity structures, which we address by proposing two generic types of jump operators for the Lindblad dynamics. Type-I jump operators break the particle number symmetry and should be simulated in the Fock space. Type-II jump operators preserves the particle number symmetry and can be simulated more efficiently in the full configuration interaction space. For both types of jump operators, we prove that in a simplified Hartree-Fock framework, the spectral gap of our Lindbladian is lower bounded by a universal constant. For physical observables such as energy and reduced density matrices, the convergence rate of our Lindblad dynamics with Type-I jump operators remains universal, while the convergence rate with Type-II jump operators only depends on coarse grained information such as the number of orbitals and the number of electrons. To validate our approach, we employ a Monte Carlo trajectory-based algorithm for simulating the Lindblad dynamics for full ab initio Hamiltonians, demonstrating its effectiveness on molecular systems amenable to exact wavefunction treatment.

Quantum chemistry↗
DOE OSTI2020

Expectation-propagation for weak radionuclide identification at radiation portal monitors

We propose a sparsity-promoting Bayesian algorithm capable of identifying radionuclide signatures from weak sources in the presence of a high radiation background. The proposed method is relevant to radiation identification for security applications. In such scenarios, the background typically consists of terrestrial, cosmic, and cosmogenic radiation that may cause false positive responses. We evaluate the new Bayesian approach using gamma-ray data and are able to identify weapons-grade plutonium, masked by naturally-occurring radioactive material (NORM), in a measurement time of a few seconds. We demonstrate this identification capability using organic scintillators (stilbene crystals and EJ-309 liquid scintillators), which do not provide direct, high-resolution, source spectroscopic information. Compared to the EJ-309 detector, the stilbene-based detector exhibits a lower identification error, on average, owing to its better energy resolution. Organic scintillators are used within radiation portal monitors to detect gamma rays emitted from conveyances crossing ports of entry. The described method is therefore applicable to radiation portal monitors deployed in the field and could improve their threat discrimination capability by minimizing “nuisance” alarms produced either by NORM-bearing materials found in shipped cargoes, such as ceramics and fertilizers, or radionuclides in recently treated nuclear medicine patients.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2021

Utilizing distributed acoustic sensing and ocean bottom fiber optic cables for submarine structural characterization

The sparsity of permanent seismic instrumentation in marine environments often limits the availability of subsea information on geohazards, including active fault systems, in both time and space. One sensing resource that provides observational access to the seafloor environment are existing networks of ocean bottom fiber optic cables; these cables, coupled to modern distributed acoustic sensing (DAS) systems, can provide dense arrays of broadband seismic observations capable of recording both seismic events and the ambient noise wavefield. Here, we report a marine DAS application which demonstrates the strength and limitation of this new technique on submarine structural characterization. Based on ambient noise DAS records on a 20 km section of a fiber optic cable offshore of Moss Landing, CA, in Monterey Bay, we extract Scholte waves from DAS ambient noise records using interferometry techniques and invert the resulting multimodal dispersion curves to recover a high resolution 2D shear-wave velocity image of the near seafloor sediments. We show for the first time that the migration of coherently scattered Scholte waves observed on DAS records can provide an approach for resolving sharp lateral contrasts in subsurface properties, particularly shallow faults and depositional features near the seafloor. Our results provide improved constraints on shallow submarine features in Monterey Bay, including fault zones and paleo-channel deposits, thus highlighting one of many possible geophysical uses of the marine cable network.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Comparing quantum annealing and spiking neuromorphic computing for sampling binary sparse coding QUBO problems

We consider the problem of computing a sparse binary representation of an image. Given an image and an overcomplete, non-orthonormal basis, we aim to find a sparse binary vector indicating the minimal set of basis vectors that when added together best reconstruct the given input. We formulate this problem with an L 2 loss on the reconstruction error, and an L 0 loss on the binary vector enforcing sparsity. First, we solve the sparse representation QUBOs by solving them both on a D-Wave quantum annealer with Pegasus chip connectivity, as well as on the Intel Loihi 2 spiking neuromorphic processor using a stochastic Non-equilibrium Boltzmann Machine (NEBM). Second, using Quantum Evolution Monte Carlo with Reverse Annealing and iterated warm starting on Loihi 2 to evolve the solution quality from the respective machines. We demonstrate that both quantum annealing and neuromorphic computing are suitable for solving binary sparse coding QUBOs.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Filling data analysis gaps in time-resolved crystallography by machine learning

There is a growing understanding of the structural dynamics of biological molecules fueled by x-ray crystallography experiments. Time-resolved serial femtosecond crystallography (TR-SFX) with x-ray Free Electron Lasers allows the measurement of ultrafast structural changes in proteins. Nevertheless, this technique comes with some limitations. One major challenge is the quality of data from TR-SFX measurements, which often faces issues like data sparsity, partial recording of Bragg reflections, timing errors, and pixel noise. To overcome these difficulties, conventionally, large volumes of data are collected and grouped into a few temporal bins. The data in each bin are then averaged and paired with the mean of their corresponding jittered timestamps. This procedure provides one structure per bin, resulting in a limited number of averaged structures for the entire time interval spanned by the experiment. Therefore, the information on ultrafast structural dynamics at high temporal resolution is lost. This has initiated research for advanced methods of analyzing experimental TR-SFX data beyond the standard binning and averaging method. To address this problem, we use a machine learning algorithm called Nonlinear Laplacian Spectral Analysis (NLSA), which has emerged as a promising technique for studying the dynamics of complex systems. In this work, we demonstrate the power of this algorithm using synthetic x-ray diffraction snapshots from a protein with significant data incompleteness, timing uncertainties, and noise. Our study confirms that NLSA is a suitable approach that effectively mitigates the effects of these artifacts in TR-SFX data and recovers accurate structural dynamics information hidden in such data.

Trujillo, Justin (ORCID:0000000285505360)↗
DOE OSTI2023

Sparse regression for plasma physics

Many scientific problems can be formulated as sparse regression, i.e., regression onto a set of parameters when there is a desire or expectation that some of the parameters are exactly zero or do not substantially contribute. This includes many problems in signal and image processing, system identification, optimization, and parameter estimation methods such as Gaussian process regression. Sparsity facilitates exploring high-dimensional spaces while finding parsimonious and interpretable solutions. In the present work, we illustrate some of the important ways in which sparse regression appears in plasma physics and point out recent contributions and remaining challenges to solving these problems in this field. Further, a brief review is provided for the optimization problem and the state-of-the-art solvers, especially for constrained and high-dimensional sparse regression.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Modified Fermi’s golden rule rate expressions

Fermi’s golden rule (FGR) serves as the basis for many expressions of spectroscopic observables and quantum transition rates. The utility of FGR has been demonstrated through decades of experimental confirmation. However, there still remain important cases where the evaluation of a FGR rate is ambiguous or ill-defined. Examples are cases where the rate has divergent terms due to the sparsity in the density of final states or time dependent fluctuations of system Hamiltonians. Strictly speaking, assumptions of FGR are no longer valid for such cases. However, it is still possible to define modified FGR rate expressions that are useful as effective rates. The resulting modified FGR rate expressions resolve a long standing ambiguity often encountered in using FGR and offer more reliable ways to model general rate processes. Finally, simple model calculations illustrate the utility and implications of new rate expressions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Use of FLOSIC for understanding anion-solvent interactions

An Achille’s heel of lower-rung density-functional approximations is that the highest-occupied-molecular-orbital energy levels of anions, known to be stable or metastable in nature, are often found to be positive in the worst case or above the lowest-unoccupied-molecular-orbital levels on neighboring complexes that are not expected to accept charge. A trianionic example, [Cr(C2O4)3]3−, is of interest for constraining models linking Cr isotope ratios in rock samples to oxygen levels in Earth’s atmosphere over geological timescales. Here we describe how crowd sourcing can be used to carry out self-consistent Fermi–Löwdin–Orbital-Self-Interaction corrected calculations (FLOSIC) on this trianion in solution. The calculations give a physically correct description of the electronic structure of the trianion and water. In contrast, uncorrected local density approximation (LDA) calculations result in approximately half of the anion charge being transferred to the water bath due to the effects of self-interaction error. Use of group-theory and the intrinsic sparsity of the theory enables calculations roughly 125 times faster than our initial implementation in the large N limit reached here. By integrating charge density densities and Coulomb potentials over regions of space and analyzing core-level shifts of the Cr and O atoms as a function of position and functional, we unambiguously show that FLOSIC, relative to LDA, reverses incorrect solute-solvent charge transfer in the trianion-water complex. In comparison to other functionals investigated herein, including Hartree–Fock and the local density approximation, the FLOSIC Cr 1s eigenvalues provide the best agreement with experimental core ionization energies.

Chemistry↗
DOE OSTI2024

Data-driven prediction of scaling and ignition of inertial confinement fusion experiments

Recent advances in inertial confinement fusion (ICF) at the National Ignition Facility (NIF), including ignition and energy gain, are enabled by a close coupling between experiments and high-fidelity simulations. Neither simulations nor experiments can fully constrain the behavior of ICF implosions on their own, meaning pre- and postshot simulation studies must incorporate experimental data to be reliable. Linking past data with simulations to make predictions for upcoming designs and quantifying the uncertainty in those predictions has been an ongoing challenge in ICF research. We have developed a data-driven approach to prediction and uncertainty quantification that combines large ensembles of simulations with Bayesian inference and deep learning. The approach builds a predictive model for the statistical distribution of key performance parameters, which is jointly informed by past experiments and physics simulations. The prediction distribution captures the impact of experimental uncertainty, expert priors, design changes, and shot-to-shot variations. We have used this new capability to predict a 10× increase in ignition probability between Hybrid-E shots driven with 2.05 MJ compared to 1.9 MJ, and validated our predictions against subsequent experiments. We describe our new Bayesian postshot and prediction capabilities, discuss their application to NIF ignition and validate the results, and finally investigate the impact of data sparsity on our prediction results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Polariton spectra under the collective coupling regime. I. Efficient simulation of linear spectra and quantum dynamics

We outline two general theoretical techniques to simulate polariton quantum dynamics and optical spectra under the collective coupling regimes described by a Holstein–Tavis–Cummings (HTC) model Hamiltonian. The first one takes advantage of sparsity of the HTC Hamiltonian, which allows one to reduce the cost of acting polariton Hamiltonian onto a state vector to the linear order of the number of states, instead of the quadratic order. The second one is applying the well-known Chebyshev series expansion approach for quantum dynamics propagation and to simulate the polariton dynamics in the HTC system; this approach allows us to use a much larger time step for propagation and only requires a few recursive operations of the polariton Hamiltonian acting on state vectors. These two theoretical approaches are general and can be applied to any trajectory-based non-adiabatic quantum dynamics methods. We apply these two techniques with our previously developed Lindblad-partially linearized density matrix approach to simulate the linear absorption spectra of the HTC model system, with both inhomogeneous site energy disorders and dipolar orientational disorders. Our numerical results agree well with the previous analytic and numerical work.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dots

Most problems within and beyond the scientific domain can be framed into one of the following three levels of complexity of function approximation. Type 1: Approximate an unknown function given input/output data. Type 2: Consider a collection of variables and functions, some of which are unknown, indexed by the nodes and hyperedges of a hypergraph (a generalized graph where edges can connect more than two vertices). Given partial observations of the variables of the hypergraph (satisfying the functional dependencies imposed by its structure), approximate all the unobserved variables and unknown functions. Type 3: Expanding on Type 2, if the hypergraph structure itself is unknown, use partial observations of the variables of the hypergraph to discover its structure and approximate its unknown functions. These hypergraphs offer a natural platform for organizing, communicating, and processing computational knowledge. While most scientific problems can be framed as the data-driven discovery of unknown functions in a computational hypergraph whose structure is known (Type 2), many require the data-driven discovery of the structure (connectivity) of the hypergraph itself (Type 3). We introduce an interpretable Gaussian Process (GP) framework for such (Type 3) problems that does not require randomization of the data, access to or control over its sampling, or sparsity of the unknown functions in a known or learned basis. Its polynomial complexity, which contrasts sharply with the super-exponential complexity of causal inference methods, is enabled by the nonlinear ANOVA capabilities of GPs used as a sensing mechanism.

Science & Technology - Other Topics↗
DOE OSTI2022

The cosine-sine decomposition with different-orbitals-for-different-spins determinants

We report the spin decomposition of a spin-contaminated different-orbitals-for-different-spins (DODS) wave function is formulated in terms of the Krylov space of the $\hat{S}^2$ ||operator. The number of determinants that contribute to the various projected spin eigenfunctions vertical | $\psi ; S, M \rangle$ depends on the sparsity of the orbital overlap matrix X between the α and β spatial orbitals. The cosine-sine decomposition (CSD) procedure may be applied to this overlap matrix, and the resulting redundant orbital transformations may be applied to the α and β spatial orbitals. This produces a sparse X' matrix in the transformed basis in which each row or column has either one or two nonzero elements. This sparse X' matrix simplifies the spin-decomposition procedure in three ways:1) it reduces the number of contributing determinants within the Krylov basis functions and within the projected spin functions, 2) it reduces the effective orbital dimension through elimination of the frozen core and frozen virtual orbitals, and 3) it simplifies the spin-decomposition procedure in both the original and transformed bases by limiting the Krylov space dimension. These simplifications all reduce the computational effort for the spin-decomposition process. This procedure is implemented within a string-based DODS determinant formulation and applied to spin projection of unrestricted Hartree-Fock determinants.

unrestricted Hartree-Fock↗
DOE OSTI2026

Selection of a Pair of Experiments to Optimally Reduce Uncertainty in Targeted Nuclear Data

We propose a novel process to select a pair of differential and integral experiments that best reduce uncertainties in targeted 239 ⁢Pu nuclear data while compressing the current nuclear data pipeline from 20 to 3 years. 239⁢ Pu nuclear data are poorly understood for neutrons in the intermediate energy range due to sparsity and uncertainty in historical experiments. New experiments targeting this range will enable better understanding of these nuclear data, but choosing the ideal experiments to conduct is challenging. Beginning with a prior distribution represented by samples of nuclear data generated from theory, generalized least squares adjustments are made to incorporate data from historical experiments. To quantify potential uncertainty reduction obtainable from a pair of candidate experiments, we compute the D-optimality criterion of the posterior covariance of intermediate energy range nuclear data compared to the equivalent covariance after additional adjustment to the pair of candidate experiments. Repeating the process for each of many candidate pairs facilitates the final selection. Results support 63⁢ Cu total cross section measurements for differential experiments and alumina and alumina/graphite configurations for integral experiments. This analysis enables choosing differential and integral experiments to be executed concurrently while shortening decision times relative to the current nuclear data pipeline.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Many-isocenter optimization for robotic radiotherapy

Despite significant dosimetric gains, clinical implementation of the 4π non-coplanar radiotherapy on the widely available C-arm gantry system is hindered by limited clearance, and the need to perform complex coordinated gantry and couch motion. A robotic radiotherapy platform would be conducive to such treatment but a new conflict between field size and MLC modulation resolution needs to be managed for versatile applications. This study investigates the dosimetry and delivery efficiency of purposefully creating many isocenters to achieve simultaneously high MLC modulation resolution and large tumor coverage. An integrated optimization framework was proposed for simultaneous beam orientation optimization (BOO), isocenter selection, and fluence map optimization (FMO). The framework includes a least-square dose fidelity objective, a total variation term for regularizing the fluence smoothness, and a group sparsity term for beam selection. A minimal number of isocenters were identified for efficient target coverage. Colliding beams excluded, high-resolution small-field 4π intensity-modulated radiotherapy (IMRT) treatment plans with 50 cm source-to-isocenter distance (SID-50) on 10 Head and Neck (H&N) cancer patients were compared with low-resolution large-field plans with 100 cm SID (SID-100). With the same or better target coverage, the average reduction of [Dmean, Dmax] of 20-beam SID-50 plans from 20-beam SID-100 plans were [2.09 Gy, 1.19 Gy] for organs at risk (OARs) overall, [3.05 Gy, 0.04 Gy] for parotid gland, [3.62 Gy, 5.19 Gy] for larynx, and [3.27 Gy, 1.10 Gy] for mandible. R50 and integral dose were reduced by 5.3% and 9.6%, respectively. Wilcoxon signed-rank test showed significant difference (p < 0.05) in planning target volume (PTV) homogeneity, PTV Dmax, R50, Integral dose, and OAR Dmean and Dmax. The estimated delivery time of 20-beam [SID-50, SID-100] plans were [19, 18] min and [14, 9] min, assuming 5 fractions and 30 fractions, respectively. Finally, with clinically acceptable delivery efficiency, many-isocenter optimization is dosimetrically desirable for treating large targets with high modulation resolution on the robotic platform.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2021

Astrophysics & cosmology from line intensity mapping vs galaxy surveys

Line intensity mapping (LIM) proposes to efficiently observe distant faint galaxies and map the matter density field at high redshift. Building upon the formalism in a companion paper, we first highlight the degeneracies between cosmology and astrophysics in LIM. We discuss what can be constrained from measurements of the mean intensity and redshift-space power spectra. With a sufficient spectral resolution, the large-scale redshift-space distortions of the 2-halo term can be measured, helping to break the degeneracy between bias and mean intensity. With a higher spectral resolution, measuring the small-scale redshift-space distortions disentangles the 1-halo and shot noise terms. Additionally, cross-correlations with external galaxy catalogs or lensing surveys further break degeneracies. We derive requirements for experiments similar to SPHEREx, HETDEX, CDIM, COMAP and CONCERTO. We then revisit the question of the optimality of the LIM observables, compared to galaxy detection, for astrophysics and cosmology. We use a matched filter to compute the luminosity detection threshold for individual sources. We show that LIM contains information about galaxies too faint to detect, in the high-noise or high-confusion regimes. We quantify the sparsity and clustering bias of the detected sources and compare them to LIM, showing in which cases LIM is a better tracer of the matter density. We extend previous work by answering these questions as a function of Fourier scale, including for the first time the effect of cosmic variance, pixel-to-pixel correlations, luminosity-dependent clustering bias and redshift-space distortions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

MONKES: a fast neoclassical code for the evaluation of monoenergetic transport coefficients in stellarator plasmas

Abstract MONKES is a new neoclassical code for the evaluation of monoenergetic transport coefficients in stellarators. By means of a convergence study and benchmarks with other codes, it is shown that MONKES is accurate and efficient. The combination of spectral discretization in spatial and velocity coordinates with block sparsity allows MONKES to compute monoenergetic coefficients at low collisionality, in a single core, in approximately one minute. MONKES is sufficiently fast to be integrated into stellarator optimization codes for direct optimization of the bootstrap current and to be included in predictive transport suites. The code and data from this paper are available at https://github.com/JavierEscoto/MONKES/ .

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Global stellarator coil optimization with quadratic constraints and objectives

Most present stellarator designs are produced by costly two-stage optimization: the first for an optimized equilibrium, and the second for a coil design reproducing its magnetic configuration. Few proxies for coil complexity and forces exist at the equilibrium stage. Rapid initial state finding for both stages is a topic of active research. Most present convex coil optimization codes use the least square winding surface method by Merkel (NESCOIL), with recent improvements in conditioning, regularization, sparsity, and physics objectives. While elegant, the method is limited to modeling the norms of linear functions in coil current. We present QUADCOIL, a global coil optimization method that targets combinations of linear and quadratic functions of the current. It can directly constrain and/or minimize a wide range of physics objectives unavailable in NESCOIL and REGCOIL, including the Lorentz force, magnetic energy, curvature, field-current alignment, and the maximum density of a dipole array. QUADCOIL requires no initial guess and runs nearly $10$ 2 x faster than filament optimization. Integrating it in the equilibrium optimization stage can potentially exclude equilibria with difficult-to-design coils, without significantly increasing the computation time per iteration. QUADCOIL finds the exact, global minimum in a large parameter space when possible, and otherwise finds a well-performing approximate global minimum. It supports most regularization techniques developed for NESCOIL and REGCOIL. We demonstrate QUADCOIL’s effectiveness in coil topology control, minimizing non-convex penalties, and predicting filament coil complexity with three numerical examples.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗