Search NASA⌕ Search

SEARCH · Search NASA

Results for “Optimization algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Comprehensive Detection of Single Amino Acid Variants and Evaluation of Their Deleterious Potential in a PANC-1 Cell Line

Identifying single amino acid variants (SAAVs) in cancer is critical for precision oncology. Several advanced algorithms are now available to identify SAAVs but attempts to combine different algorithms and optimize them on large datasets to achieve a more comprehensive coverage of SAAVs have not been implemented. Herein we report an expanded detection of SAAVs in the PANC-1 cell line using three different strategies, which results in identification of 540 SAAVs in the mass spectrometry data, the most comprehensive coverage yet reported. Among the set of 540 SAAVs, 79 are evaluated as deleterious SAAVs based on analysis using novel AssVar software in which one of the driver mutations found in each protein of KRAS, TP53 and SLC37A4 is further validated using independent selected reaction monitoring (SRM) analysis. Our study represents the most comprehensive discovery of SAAVs to date and the first large-scale detection of deleterious SAAVs in the PANC-1 cell line. This work may serve as the basis for future research in pancreatic cancer and personal immunotherapy and treatment.

59 BASIC BIOLOGICAL SCIENCES↗

Southern Ocean Cloud Properties Derived From CAPRICORN and MARCUS Data

The properties of Southern Ocean (SO) liquid phase non precipitating clouds (hereafter clouds) are examined using shipborne data collected during the Measurements of Aerosols, Radiation and Clouds over the Southern Ocean and the Clouds Aerosols Precipitation Radiation and atmospheric Composition Over the SoutheRN ocean I and II campaigns that took place south of Australia during Autumn 2016 and Summer 2017–2018. Cloud properties are derived using data from W-band radars, lidars, and microwave radiometers using an optimal estimation algorithm. The SO clouds tended to have larger liquid water paths (LWP, 115 ± 117 g m -2 ), smaller effective radii (re, 8.7 ± 3 μm), and higher number concentrations (N d , 90 ± 107 cm-3) than typical values of eastern ocean basin stratocumulus. The clouds demonstrated a tendency for the LWP to increase with Nd presumably due to precipitation suppression up to Nd of approximately 100 cm -3 when mean LWP decreased with increasing Nd. Due to higher optical depth, cloud albedos were less susceptible to changes in Nd compared to subtropical stratocumulus. The highest latitude clouds of the datasets, observed along and near the Antarctic coast, presented a distinctly bimodal character. One mode had the properties of marine clouds further north. Additionally, the other mode occurred in an aerosol environment characterized by high cloud condensation nuclei concentrations and elevated sulfate aerosol without obvious continental aerosol markers. These regions of higher cloud condensation nuclei tended to have higher Nd, smaller re and higher LWP suggesting sensitivity of cloud properties to seasonal biogenic aerosol production in the high latitude SO.

54 ENVIRONMENTAL SCIENCES↗

Cost function dependent barren plateaus in shallow parametrized quantum circuits

Variational quantum algorithms (VQAs) optimize the parameters θ of a parametrized quantum circuit V(θ) to minimize a cost function C. While VQAs may enable practical applications of noisy quantum computers, they are nevertheless heuristic methods with unproven scaling. Here, we rigorously prove two results, assuming V(θ) is an alternating layered ansatz composed of blocks forming local 2-designs. Our first result states that defining C in terms of global observables leads to exponentially vanishing gradients (i.e., barren plateaus) even when V(θ) is shallow. Hence, several VQAs in the literature must revise their proposed costs. On the other hand, our second result states that defining C with local observables leads to at worst a polynomially vanishing gradient, so long as the depth of V(θ) is Ο(logn). Our results establish a connection between locality and trainability. We illustrate these ideas with large-scale simulations, up to 100 qubits, of a quantum autoencoder implementation.

97 MATHEMATICS AND COMPUTING↗

Rapid data acquisition and machine learning-assisted composition design of functionally graded alloys via wire arc additive manufacturing

Abstract The lack of high-quality datasets in materials science hinders artificial intelligence (AI)-driven alloy design. To address this challenge, wire arc additive manufacturing (WAAM) was employed to fabricate graded alloys, generating extensive data for machine learning (ML)-assisted property prediction. ML models were developed using high-throughput experiments, computational models, and genetic algorithm to optimize feature selection, successfully predicting hardness and porosity. The ML model demonstrated its efficacy by designing a gradient alloy with enhanced properties. However, scaling up revealed uncertainties in tensile property and porosity due to differences in size and thermal conditions between the designed alloy build and the gradient print used to construct the ML model. This underscores the need for uncertainty quantification and process optimization in WAAM-driven alloy design. Our work advances AI-integrated additive manufacturing, offering a rapid approach to exploring process–structure–property relationships and accelerating materials development.

Wang, Xin↗

Extracting the turbulent flow-field from beam emission spectroscopy images using velocimetry

The 2D turbulent E × B flow-field is inferred from density fluctuation images obtained with the beam emission spectroscopy diagnostic on DIII-D using the orthogonal dynamic programming velocimetry algorithm. A synthetic turbulence model is used to test the algorithm and optimize it for measuring zonal flows. Zonal flow measurements are found to require a signal-to-noise ratio above ~10 and a zonal flow wavelength longer than ~2 cm. Comparison between the velocimetry-estimated flow-field and the E × B flow-field using a nonlinear gyrokinetic GENE simulation finds that the flow-fields have identical spatial structure and differ only by the mean turbulence phase velocity, which is spatially uniform in this flux tube simulation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Deep convolutional neural networks for multi-scale time-series classification and application to tokamak disruption prediction using raw, high temporal resolution diagnostic data

In this paper we discuss recent advances in deep convolutional neural networks (CNN) for sequence learning, which allow identifying long-range, multi-scale phenomena in long sequences, such as those found in fusion plasmas. We point out several benefits of these deep CNN architectures, such as not requiring experts such as physicists to hand-craft input data features, the ability to capture longer range dependencies compared to the more common sequence neural networks (recurrent neural networks like long short-term memory (LSTM) networks), and the comparative computational efficiency. We apply this neural network architecture to the popular problem of disruption prediction in fusion energy tokamaks, utilizing raw data from a single diagnostic, the Electron Cyclotron Emission imaging (ECEi) diagnostic from the DIII-D tokamak. Initial results trained on a large ECEi dataset show promise, achieving an F 1 -score of ~91% on individual time-slices using only the ECEi data. This indicates the ECEi diagnostic by itself can be sensitive to a number of pre-disruption markers useful for predicting disruptions on timescales not only for mitigation but also avoidance. Future opportunities for utilizing these deep CNN architectures with fusion data are outlined, including impact of recent upgrades to the ECEi diagnostic.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A light weight regularization for wave function parameter gradients in quantum Monte Carlo

The parameter derivative of the expectation value of the energy, ∂E/∂p, is a key ingredient in variational Monte Carlo (VMC) wave function optimization methods. In some cases, a naïve estimate of this derivative suffers from an infinite variance, which inhibits the efficiency of optimization methods that rely on a stable estimate of the derivative. In this work, we derive a simple regularization of the naïve estimator, which is trivial to implement in existing VMC codes, has finite variance, and a negligible bias, which can be extrapolated to zero bias with no extra cost. We use this estimator to construct an unbiased, finite variance estimation of ∂E/∂p for a multi-Slater–Jastrow trial wave function on the LiH molecule and in the optimization of a multi-Slater–Jastrow trial wave function on the CuO molecule. This regularized estimator is a simple and efficient estimator of ∂E/∂p for VMC optimization techniques.

36 MATERIALS SCIENCE↗

Adaptive 3D convolutional neural network-based reconstruction method for 3D coherent diffraction imaging

We present a novel adaptive machine-learning based approach for reconstructing three-dimensional (3D) crystals from coherent diffraction imaging. We represent the crystals using spherical harmonics (SH) and generate the corresponding synthetic diffraction patterns. We utilize 3D convolutional neural networks (CNNs) to learn a mapping between 3D diffraction volumes and the SH, which describe the boundary of the physical volumes from which they were generated. We use the 3D CNN-predicted SH coefficients as the initial guesses, which are then fine-tuned using adaptive model-independent feedback for improved accuracy. We also adaptively tune the locations, intensities, and decay rates of collections of radial basis functions in order to reproduce the non-uniform internal structure of 3D objects and demonstrate the method for a synthetic volume that has an internal void and a density ramp.

36 MATERIALS SCIENCE↗

A hybrid approach to excited-state-specific variational Monte Carlo and doubly excited states

We extend our hybrid linear-method/accelerated-descent variational Monte Carlo optimization approach to excited states and investigate its efficacy in double excitations. In addition to showing a superior statistical efficiency when compared to the linear method, our tests on small molecules show good energetic agreement with benchmark methods. We also demonstrate the ability to treat double excitations in systems that are too large for a full treatment by using selected configuration interaction methods via an application to 4-aminobenzonitrile. Finally, we investigate the stability of state-specific variance optimization against collapse to other states’ variance minima and find that symmetry, Ansatz quality, and sample size all have roles to play in achieving stability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning with bond information for local structure optimizations in surface science

Local optimization of adsorption systems inherently involves different scales: within the substrate, within the molecule, and between the molecule and the substrate. In this work, we show how the explicit modeling of different characteristics of the bonds in these systems improves the performance of machine learning methods for optimization. Furthermore, we introduce an anisotropic kernel in the Gaussian process regression framework that guides the search for the local minimum, and we show its overall good performance across different types of atomic systems. The method shows a speed-up of up to a factor of two compared with the fastest standard optimization methods on adsorption systems. Additionally, we show that a limited memory approach is not only beneficial in terms of overall computational resources but can also result in a further reduction of energy and force calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Inverse design of equilibrium cluster fluids applied to a physically informed model

Inverse design strategies have proven highly useful for the discovery of interaction potentials that prompt self-assembly of a variety of interesting structures. However, often the optimized particle interactions do not have a direct relationship to experimental systems. In this work, we show that Relative Entropy minimization is able to discover physically meaningful parameter sets for a model interaction built from depletion attraction and electrostatic repulsion that yield self-assembly of size-specific clusters. Here, we then explore the sensitivity of the optimized interaction potentials with respect to deviations in the underlying physical quantities, showing that clustering behavior is largely preserved even as the optimized parameters are perturbed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Constrained non-negative matrix factorization enabling real-time insights of in situ and high-throughput experiments

Non-negative matrix factorization (NMF) is an appealing class of methods for performing unsupervised learning on streaming spectral data, particularly in time-sensitive applications such as in situ characterization of materials. These methods seek to decompose a dataset into a small number of components and weights that can compactly represent the underlying signal while effectively reconstructing the observations with minimal error. However, canonical NMF methods have no underlying requirement that the reconstruction uses components or weights that are representative of the true physical processes. In this work, we demonstrate how constraining a subset of the NMF weights or components as rigid priors, provided as known or assumed values, can provide significant improvement in revealing true underlying phenomena. We present a PyTorch-based method for efficiently applying constrained NMF and demonstrate its application to several synthetic examples. Our implementation allows an expert researcher-in-the-loop to provide and dynamically adjust the constraints during a live experiment involving streaming spectral data. Such interactive priors allow researchers to specify known or identified independent components, as well as functional expectations about the mixing or transitions between the components. We further demonstrate the application of this method to measured synchrotron x-ray total scattering data from in situ beamline experiments. In such a context, constrained NMF can result in a more interpretive and scientifically relevant decomposition than canonical NMF or other decomposition techniques. As a result, the details of the method are provided, along with general guidance for employing constrained NMF in the extraction of critical information and insights during time-sensitive experimental applications.

36 MATERIALS SCIENCE↗

Geometry optimization speedup through a geodesic approach to internal coordinates

We present a new geodesic-based method for geometry optimization in a basis set of redundant internal coordinates. Overall, our method updates the molecular geometry by following the geodesic generated by a displacement vector on the internal coordinate manifold, which dramatically reduces the number of steps required to converge to a minimum. Our method can be implemented in any existing optimization code, requiring only implementation of derivatives of the Wilson B-matrix and the ability to numerically solve an ordinary differential equation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Stiff neural ordinary differential equations

Neural Ordinary Differential Equations (ODEs) are a promising approach to learn dynamical models from time-series data in science and engineering applications. This work aims at learning neural ODEs for stiff systems, which are usually raised from chemical kinetic modeling in chemical and biological systems. We first show the challenges of learning neural ODEs in the classical stiff ODE systems of Robertson’s problem and propose techniques to mitigate the challenges associated with scale separations in stiff systems. We then present successful demonstrations in stiff systems of Robertson’s problem and an air pollution problem. The demonstrations show that the usage of deep networks with rectified activations, proper scaling of the network outputs as well as loss functions, and stabilized gradient calculations are the key techniques enabling the learning of stiff neural ODEs. The success of learning stiff neural ODEs opens up possibilities of using neural ODEs in applications with widely varying time-scales, such as chemical dynamics in energy conversion, environmental engineering, and life sciences.

97 MATHEMATICS AND COMPUTING↗

Transfer learning driven design optimization for inertial confinement fusion

Transfer learning is a promising approach to create predictive models that incorporate simulation and experimental data into a common framework. In this technique, a neural network is first trained on a large database of simulations and then partially retrained on sparse sets of experimental data to adjust predictions to be more consistent with reality. Previously, this technique has been used to create predictive models of Omega [Humbird et al., IEEE Trans. Plasma Sci. 48, 61–70 (2019)] and NIF [Humbird et al., Phys. Plasmas 28, 042709 (2021); Kustowski et al., Mach. Learn. 3, 015035 (2022)] inertial confinement fusion (ICF) experiments that are more accurate than simulations alone. Here, in this work, we conduct a transfer learning driven hypothetical ICF campaign in which the goal is to maximize experimental neutron yield via Bayesian optimization. The transfer learning model achieves yields within 5% of the maximum achievable yield in a modest-sized design space in fewer than 20 experiments. Furthermore, we demonstrate that this method is more efficient at optimizing designs than traditional model calibration techniques commonly employed in ICF design. Such an approach to ICF design could enable robust optimization of experimental performance under uncertainty.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Grad–Shafranov equilibria via data-free physics informed neural networks

A large number of magnetohydrodynamic (MHD) equilibrium calculations are often required for uncertainty quantification, optimization, and real-time diagnostic information, making MHD equilibrium codes vital to the field of plasma physics. In this paper, we explore a method for solving the Grad–Shafranov equation by using physics-informed neural networks (PINNs). For PINNs, we optimize neural networks by directly minimizing the residual of the partial differential equation as a loss function. We show that PINNs can accurately and effectively solve the Grad–Shafranov equation with several different boundary conditions, making it more flexible than traditional solvers. This method is flexible as it does not require any mesh and basis choice, thereby streamlining the computational process. We also explore the parameter space by varying the size of the model, the learning rate, and boundary conditions to map various tradeoffs such as between reconstruction error and computational speed. Additionally, we introduce a parameterized PINN framework, expanding the input space to include variables such as pressure, aspect ratio, elongation, and triangularity in order to handle a broader range of plasma scenarios within a single network. Parameterized PINNs could be used in future work to solve inverse problems such as shape optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A Gaussian process based surrogate approach for the optimization of cylindrical targets

Simulating direct-drive inertial confinement experiments presents significant computational challenges, both due to the complexity of the codes required for such simulations and the substantial computational expense associated with target design studies. Machine learning models, and in particular, surrogate models, offer a solution by replacing simulation results with a simplified approximation. In this study, we apply surrogate modeling and optimization techniques that are well established in the existing literature to one-dimensional simulation data of a new cylindrical target design containing deuterium–tritium fuel. These models predict yields without the need for expensive simulations. We find that Bayesian optimization with Gaussian process surrogates enhances sampling efficiency in low-dimensional design spaces but becomes less efficient as dimensionality increases. Nonetheless, optimization routines within two-dimensional and five-dimensional design spaces can identify designs that maximize yield, while also aligning with established physical intuition. Optimization routines, which ignore constraints on hydrodynamic instability growth, are shown to lead to unstable designs in 2D, resulting in yield loss. However, routines that utilize 1D simulations and impose constraints on the in-flight aspect ratio converge on novel cylindrical target designs that are stable against hydrodynamic instability growth in 2D and achieve high yield.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Achieving designed texture and flows in bulk active nematics using optimal control theory

Being intrinsically nonequilibrium, active materials can potentially perform functions that would be thermodynamically forbidden in passive materials. However, active systems have diverse local attractors that correspond to distinct dynamical states, many of which exhibit chaotic turbulent-like dynamics and thus cannot perform work or useful functions. Designing such a system to choose a specific dynamical state is a formidable challenge. Motivated by recent advances enabling optogenetic control of experimental active materials, we describe an optimal control theory framework that identifies a spatiotemporal sequence of light-generated activity that drives an active nematic system toward a prescribed dynamical steady state. Active nematics are unstable to spontaneous defect proliferation and chaotic streaming dynamics in the absence of control. We demonstrate that optimal control theory can compute activity fields that redirect the dynamics into a variety of alternative dynamical programs and functions. This includes dynamically reconfiguring between states, selecting and stabilizing emergent behaviors that do not correspond to attractors, and are hence unstable in the uncontrolled system. Furthermore, our results provide a roadmap to leverage optical control methods to rationally design structure, dynamics, and function in a wide variety of active materials.

Complex systems theory↗