Search NASA⌕ Search

SEARCH · Search NASA

Results for “dimensional reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

Maximizing efficiency of dataset compression for machine learning potentials with information theory

Machine learning interatomic potentials (MLIPs) balance high accuracy and lower costs compared to density functional theory calculations, but their performance often depends on the size and diversity of training datasets. Large datasets improve model accuracy and generalization but are computationally expensive to produce and train on, while smaller datasets risk discarding rare but important atomic environments and compromising MLIP accuracy/reliability. Here, we develop an information-theoretical framework to quantify the efficiency of dataset compression methods and propose an algorithm that maximizes this efficiency. By framing atomistic dataset compression as an instance of the minimum set cover (MSC) problem over atom-centered environments, our method identifies the smallest subset of structures that contains as much information as possible from the original dataset while pruning redundant information. The approach is extensively demonstrated on the GAP-20 and TM23 datasets and validated on 64 varied datasets from the ColabFit repository. Across all cases, MSC consistently retains outliers, preserves dataset diversity, and reproduces the long-tail distributions of forces even at high compression rates, outperforming other subsampling methods. Furthermore, MLIPs trained on MSC-compressed datasets exhibit reduced error for out-of-distribution data even in low-data regimes. We explain these results using an outlier analysis and show that such quantitative conclusions could not be achieved with conventional dimensionality reduction methods. The algorithm is implemented in the open-source QUESTS package and can be used for several tasks in atomistic modeling, from data subsampling, outlier detection, and training improved MLIPs at a lower cost.

36 MATERIALS SCIENCE↗

Multiscale Flow for robust and optimal cosmological analysis

We propose Multiscale Flow, a generative Normalizing Flow that creates samples and models the field-level likelihood of two-dimensional cosmological data such as weak lensing. Multiscale Flow uses hierarchical decomposition of cosmological fields via a wavelet basis and then models different wavelet components separately as Normalizing Flows. The log-likelihood of the original cosmological field can be recovered by summing over the log-likelihood of each wavelet term. This decomposition allows us to separate the information from different scales and identify distribution shifts in the data such as unknown scale-dependent systematics. The resulting likelihood analysis can not only identify these types of systematics, but can also be made optimal, in the sense that the Multiscale Flow can learn the full likelihood at the field without any dimensionality reduction. We apply Multiscale Flow to weak lensing mock datasets for cosmological inference and show that it significantly outperforms traditional summary statistics such as power spectrum and peak counts, as well as machine learning–based summary statistics such as scattering transform and convolutional neural networks. We further show that Multiscale Flow is able to identify distribution shifts not in the training data such as baryonic effects. Finally, we demonstrate that Multiscale Flow can be used to generate realistic samples of weak lensing data.

79 ASTRONOMY AND ASTROPHYSICS↗

Tracking the topology of neural manifolds across populations

Neural manifolds summarize the intrinsic structure of the information encoded by a population of neurons. Advances in experimental techniques have made simultaneous recordings from multiple brain regions increasingly commonplace, raising the possibility of studying how these manifolds relate across populations. However, when the manifolds are nonlinear and possibly code for multiple unknown variables, it is challenging to extract robust and falsifiable information about their relationships. We introduce a framework, called the method of analogous cycles, for matching topological features of neural manifolds using only observed dissimilarity matrices within and between neural populations. We demonstrate via analysis of simulations and in vivo experimental data that this method can be used to correctly identify multiple shared circular coordinate systems across both stimuli and inferred neural manifolds. Conversely, the method rejects matching features that are not intrinsic to one of the systems. Further, as this method is deterministic and does not rely on dimensionality reduction or optimization methods, it is amenable to direct mathematical investigation and interpretation in terms of the underlying neural activity. We thus propose the method of analogous cycles as a suitable foundation for a theory of cross-population analysis via neural manifolds.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Quantification for Multiphase Computational Fluid Dynamics Closure Relations with a Physics-Informed Bayesian Approach

Multiphase Computational Fluid Dynamics (MCFD) based on the two-fluid model is considered a promising tool to model complex two-phase flow systems. MCFD simulation can predict local flow features without resolving interfacial information. As a result, the MCFD solver relies on closure relations to describe the interaction between the two phases. Those empirical or semi-mechanistic closure relations constitute a major source of uncertainty for MCFD predictions. In this paper, we leverage a physics-informed uncertainty quantification (UQ) approach to inversely quantify the closure relations’ model form uncertainty in a physically consistent manner. This proposed approach considers the model form uncertainty terms as stochastic fields that are additive to the closure relation outputs. Combining dimensionality reduction and Gaussian processes, the posterior distribution of the stochastic fields can be effectively quantified within the Bayesian framework with the support of experimental measurements. As this UQ approach is fully integrated into the MCFD solving process, the physical constraints of the system can be naturally preserved in the UQ results. Here, in a case study of adiabatic bubbly flow, we demonstrate that this UQ approach can quantify the model form uncertainty of the MCFD interfacial force closure relations, thus effectively improving the simulation results with relatively sparse data support.

42 ENGINEERING↗

A SYSTEMATIC SEARCH FOR MASSIVE BLACK HOLE BINARIES IN THE SLOAN DIGITAL SKY SURVEY SPECTROSCOPIC SAMPLE

We present the results of a systematic search for massive black hole binaries in the Sloan Digital Sky Survey (SDSS) spectroscopic database. We focus on bound binaries, under the assumption that one of the black holes is active. In this framework, the broad lines associated with the accreting black hole are expected to show systematic velocity shifts with respect to the narrow lines, which trace the rest frame of the galaxy. For a sample of 54,586 quasars and 3929 galaxies at redshifts 0.1 < z < 1.5, we brute-force model each spectrum as a mixture of two quasars at two different redshifts. The spectral model is a data-driven dimensionality reduction of the SDSS quasar spectra based on a matrix factorization. We identified 32 objects with peculiar spectra. Nine of them can be interpreted as black hole binaries. This doubles the number of known black hole binary candidates. We also report on the discovery of a new class of extreme double-peaked emitters with exceptionally broad and faint Balmer lines. For all the interesting sources, we present detailed analysis of the spectra and discuss possible interpretations.

79 ASTRONOMY AND ASTROPHYSICS↗

THE JHU-SDSS METAL ABSORPTION LINE CATALOG: REDSHIFT EVOLUTION AND PROPERTIES OF Mg II ABSORBERS

We present a generic and fully automatic method aimed at detecting absorption lines in the spectra of astronomical objects. The algorithm estimates the source continuum flux using a dimensionality reduction technique and nonnegative matrix factorization, and then detects and identifies metal absorption lines. We apply it to a sample of {approx}10{sup 5} quasar spectra from the Sloan Digital Sky Survey and compile a sample of {approx}40,000 Mg II- and Fe II-absorber systems, spanning the redshift range 0.4 < z < 2.3. The corresponding catalog is publicly available. We study the statistical properties of these absorber systems and find that the rest equivalent width distribution of strong Mg II absorbers follows an exponential distribution at all redshifts, confirming previous studies. Combining our results with recent near-infrared observations of Mg II absorbers, we introduce a new parameterization that fully describes the incidence rate of these systems up to z {approx} 5. We find the redshift evolution of strong Mg II absorbers to be remarkably similar to the cosmic star formation history over 0.4 < z < 5.5 (the entire redshift range covered by observations), suggesting a physical link between these two quantities.

79 ASTRONOMY AND ASTROPHYSICS↗

DBI Lifshitz inflation

A new model of DBI inflation is introduced where the mobile brane, the inflaton field, is moving relativistically inside a Lifshitz throat with an arbitrary anisotropic scaling exponent z. After dimensional reduction to four dimension the general covariance is broken explicitly both in the matter and the gravitational sectors. The general action for the metric and matter field perturbations are obtained and it is shown to be similar to the classifications made in the effective field theory of inflation literature.

79 ASTRONOMY AND ASTROPHYSICS↗

On the vacuum Einstein equations along curves with a discrete local rotation and reflection symmetry

We discuss the possibility of a dimensional reduction of the Einstein equations in S{sup 3} black-hole lattices. It was reported in previous literature that the evolution of spaces containing curves of local, discrete rotation and reflection symmetry (LDRRS) can be carried out via a system of ODEs along these curves. However, 3+1 Numerical Relativity computations demonstrate that this is not the case, and we show analytically that this is due to the presence of a tensorial quantity which is not suppressed by the symmetry. We calculate the term analytically, and verify numerically for an 8-black-hole lattice that it fully accounts for the anomalous results, and thus quantify its magnitude in this specific case. The presence of this term prevents the exact evolution of these spaces via previously-reported methods which do not involve a full 3+1 integration of Einstein's equation.

79 ASTRONOMY AND ASTROPHYSICS↗

Chiral primordial blue tensor spectra from the axion-gauge couplings

We suggest the new feature of primordial gravitational waves sourced by the axion-gauge couplings, whose forms are motivated by the dimensional reduction of the form field in the string theory. In our inflationary model, as an inflaton we adopt two types of axion, dubbed the model-independent axion and the model-dependent axion, which couple with two gauge groups with different sign combination each other. Due to these forms both polarization modes of gauge fields are amplified and enhance both helicies of tensor modes during inflation. We point out the possibility that a primordial blue-tilted tensor power spectra with small chirality are provided by the combination of these axion-gauge couplings, intriguingly both amplitudes and chirality are potentially testable by future space-based gravitational wave interferometers such as DECIGO and BBO project.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Unimodular gravity and the lepton anomalous magnetic moment at one-loop

We work out the one-loop contribution to the lepton anomalous magnetic moment coming from Unimodular Gravity. We use Dimensional Regularization and Dimensional Reduction to carry out the computations. In either case, we find that Unimodular Gravity gives rise to the same one-loop correction as that of General Relativity.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Drift kinetic theory of the NTM magnetic islands in a finite beta general geometry tokamak plasma

In (Imada et al 2019 Nucl. Fusion 59 046016 and references therein) a new 4D drift kinetic nonlinear theory, valid in the limit of a low beta, small inverse aspect ratio, circular cross section, toroidal geometry, to describe the plasma response to the neoclassical tearing mode (NTM) magnetic perturbation is derived. In (Dudkovskaia et al 2021 Plasma Phys. Control. Fusion 63 054001) this theory is reduced in a low collisionality limit, which allows a dimensionality reduction to a 3D problem to efficiently resolve the collisional dissipation layer in the vicinity of the trapped-passing boundary. (Dudkovskaia et al 2021 Plasma Phys. Control. Fusion 63 054001) adopts an improved model for the magnetic drift frequency, which reduces the threshold magnetic island half-width from $8.73\rho_{b i}$, where $\rho_{b i}$ is the trapped ion banana orbit width, to $1.46 \rho_{b i}$, making it in closer agreement with experimental observations for the large aspect ratio tokamak equilibrium. In the present paper, the theory is extended to a high beta, arbitrary tokamak geometry to capture the plasma shaping effects on the NTM threshold physics with the focus on the non-zero triangularity discharges that are known to have a strong impact on the plasma MHD stability. First, it is found that the higher triangularity plasma is more prone to NTMs which is in agreement with the 2/1 tearing mode onset relative frequency measurements in DIII-D. Second, the NTM threshold dependence on the tokamak inverse aspect ratio obtained in (Dudkovskaia et al 2021 Plasma Phys. Control. Fusion 63 054001) is refined and extended to a finite aspect ratio limit. Third, the NTM threshold dependence on poloidal beta is obtained and benchmarked against the EAST threshold island width measurements.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Decoding the shift-invariant data: applications for band-excitation scanning probe microscopy *

A shift-invariant variational autoencoder (shift-VAE) is developed as an unsupervised method for the analysis of spectral data in the presence of shifts along the parameter axis, disentangling the physically-relevant shifts from other latent variables. Using synthetic data sets, we show that the shift-VAE latent variables closely match the ground truth parameters. The shift VAE is extended towards the analysis of band-excitation piezoresponse force microscopy data, disentangling the resonance frequency shifts from the peak shape parameters in a model-free unsupervised manner. The extensions of this approach towards denoising of data and model-free dimensionality reduction in imaging and spectroscopic data are further demonstrated. This approach is universal and can also be extended to analysis of x-ray diffraction, photoluminescence, Raman spectra, and other data sets.

36 MATERIALS SCIENCE↗

Distance preserving machine learning for uncertainty aware accelerator capacitance predictions

Abstract Accurate uncertainty estimations are essential for producing reliable machine learning models, especially in safety-critical applications such as accelerator systems. Gaussian process models are generally regarded as the gold standard for this task; however, they can struggle with large, high-dimensional datasets. Combining deep neural networks with Gaussian process approximation techniques has shown promising results, but dimensionality reduction through standard deep neural network layers is not guaranteed to maintain the distance information necessary for Gaussian process models. We build on previous work by comparing the use of the singular value decomposition against a spectral-normalized dense layer as a feature extractor for a deep neural Gaussian process approximation model and apply it to a capacitance prediction problem for the High Voltage Converter Modulators in the Oak Ridge Spallation Neutron Source. Our model shows improved distance preservation and predicts in-distribution capacitance values with less than 1% error.

43 PARTICLE ACCELERATORS↗

QAARM: quasi-anharmonic autoregressive model reveals molecular recognition pathways in ubiquitin

Motivation: Molecular dynamics (MD) simulations have dramatically improved the atomistic understanding of protein motions, energetics and function. These growing datasets have necessitated a corresponding emphasis on trajectory analysis methods for characterizing simulation data, particularly since functional protein motions and transitions are often rare and/or intricate events. Observing that such events give rise to long-tailed spatial distributions, we recently developed a higher-order statistics based dimensionality reduction method, called quasi-anharmonic analysis (QAA), for identifying biophysically-relevant reaction coordinates and substates within MD simulations. Further characterization of conformation space should consider the temporal dynamics specific to each identified substate. Results: Our model uses hierarchical clustering to learn energetically coherent substates and dynamic modes of motion from a 0.5µs ubiqutin simulation. Autoregressive (AR) modeling within and between states enables a compact and generative description of the conformational landscape as it relates to functional transitions between binding poses. Lacking a predictive component, QAA is extended here within a general AR model appreciative of the trajectory’s temporal dependencies and the specific, local dynamics accessible to a protein within identified energy wells. These metastable states and their transition rates are extracted within a QAA-derived subspace using hierarchical Markov clustering to provide parameter sets for the second-order AR model. We show the learned model can be extrapolated to synthesize trajectories of arbitrary length.

59 BASIC BIOLOGICAL SCIENCES↗

Human-in-the-Loop: The Future of Machine Learning in Automated Electron Microscopy

Machine learning (ML) methods are progressively gaining acceptance in the electron microscopy community for de-noising, semantic segmentation, and dimensionality reduction of data post-acquisition. The introduction of the application programming interfaces (APIs) by major instrument manufacturers now allows the deployment of ML workflows in microscopes, not only for data analytics but also for real-time decision-making and feedback for microscope operation. However, the number of use cases for real-time ML remains remarkably small. Furthermore, we discuss some considerations in designing ML-based active experiments and pose that the likely strategy for the next several years will be human-in-the-loop automated experiments (hAE). In this paradigm, the ML learning agent directly controls beam position and image and spectroscopy acquisition functions, and a human operator monitors experiment progression in real and feature space of the system and tunes the policies of the ML agent to steer the experiment toward specific objectives.

47 OTHER INSTRUMENTATION↗

Improving galaxy clustering measurements with deep learning: analysis of the DECaLS DR7 data

ABSTRACT Robust measurements of cosmological parameters from galaxy surveys rely on our understanding of systematic effects that impact the observed galaxy density field. In this paper, we present, validate, and implement the idea of adopting the systematics mitigation method of artificial neural networks for modelling the relationship between the target galaxy density field and various observational realities including but not limited to Galactic extinction, seeing, and stellar density. Our method by construction allows a wide class of models and alleviates overtraining by performing k-fold cross-validation and dimensionality reduction via backward feature elimination. By permuting the choice of the training, validation, and test sets, we construct a selection mask for the entire footprint. We apply our method on the extended Baryon Oscillation Spectroscopic Survey (eBOSS) Emission Line Galaxies (ELGs) selection from the Dark Energy Camera Legacy Survey (DECaLS) Data Release 7 and show that the spurious large-scale contamination due to imaging systematics can be significantly reduced by up-weighting the observed galaxy density using the selection mask from the neural network and that our method is more effective than the conventional linear and quadratic polynomial functions. We perform extensive analyses on simulated mock data sets with and without systematic effects. Our analyses indicate that our methodology is more robust to overfitting compared to the conventional methods. This method can be utilized in the catalogue generation of future spectroscopic galaxy surveys such as eBOSS and Dark Energy Spectroscopic Instrument (DESI) to better mitigate observational systematics.

79 ASTRONOMY AND ASTROPHYSICS↗

Image feature extraction and galaxy classification: a novel and efficient approach with automated machine learning

ABSTRACT In this work, we explore the possibility of applying machine learning methods designed for 1D problems to the task of galaxy image classification. The algorithms used for image classification typically rely on multiple costly steps, such as the point spread function deconvolution and the training and application of complex Convolutional Neural Networks of thousands or even millions of parameters. In our approach, we extract features from the galaxy images by analysing the elliptical isophotes in their light distribution and collect the information in a sequence. The sequences obtained with this method present definite features allowing a direct distinction between galaxy types. Then, we train and classify the sequences with machine learning algorithms, designed through the platform Modulos AutoML. As a demonstration of this method, we use the second public release of the Dark Energy Survey (DES DR2). We show that we are able to successfully distinguish between early-type and late-type galaxies, for images with signal-to-noise ratio greater than 300. This yields an accuracy of $86{{\ \rm per\ cent}}$ for the early-type galaxies and $93{{\ \rm per\ cent}}$ for the late-type galaxies, which is on par with most contemporary automated image classification approaches. The data dimensionality reduction of our novel method implies a significant lowering in computational cost of classification. In the perspective of future data sets obtained with e.g. Euclid and the Vera Rubin Observatory, this work represents a path towards using a well-tested and widely used platform from industry in efficiently tackling galaxy classification problems at the peta-byte scale.

79 ASTRONOMY AND ASTROPHYSICS↗

Emission line predictions for mock galaxy catalogues: a new differentiable and empirical mapping from DESI

ABSTRACT We present a simple, differentiable method for predicting emission line strengths from rest-frame optical continua using an empirically determined mapping. Extensive work has been done to develop mock galaxy catalogues that include robust predictions for galaxy photometry, but reliably predicting the strengths of emission lines has remained challenging. Our new mapping is a simple neural network implemented using the JAX Python automatic differentiation library. It is trained on Dark Energy Spectroscopic Instrument Early Release data to predict the equivalent widths (EWs) of the eight brightest optical emission lines (including H α, H β, [O ii], and [O iii]) from a galaxy’s rest-frame optical continuum. The predicted EW distributions are consistent with the observed ones when noise is accounted for, and we find Spearman’s rank correlation coefficient ρs > 0.87 between predictions and observations for most lines. Using a non-linear dimensionality reduction technique, we show that this is true for galaxies across the full range of observed spectral energy distributions. In addition, we find that adding measurement uncertainties to the predicted line strengths is essential for reproducing the distribution of observed line-ratios in the BPT diagram. Our trained network can easily be incorporated into a differentiable stellar population synthesis pipeline without hindering differentiability or scalability with GPUs. A synthetic catalogue generated with such a pipeline can be used to characterize and account for biases in the spectroscopic training sets used for training and calibration of photo-z’s, improving the modelling of systematic incompleteness for the Rubin Observatory LSST and other surveys.

79 ASTRONOMY AND ASTROPHYSICS↗