Search NASA⌕ Search

SEARCH · Search NASA

Results for “stochastic gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Structure optimization with stochastic density functional theory

Linear-scaling techniques for Kohn–Sham density functional theory are essential to describe the ground state properties of extended systems. Still, these techniques often rely on the localization of the density matrix or accurate embedding approaches, limiting their applicability. In contrast, stochastic density functional theory (sDFT) achieves linear- and sub-linear scaling by statistically sampling the ground state density without relying on embedding or imposing localization. In return, ground state observables, such as the forces on the nuclei, fluctuate in sDFT, making optimizing the nuclear structure a highly non-trivial problem. In this work, we combine the most recent noise-reduction schemes for sDFT with stochastic optimization algorithms to perform structure optimization within sDFT. We compare the performance of the stochastic gradient descent approach and its variations (stochastic gradient descent with momentum) with stochastic optimization techniques that rely on the Hessian, such as the stochastic Broyden–Fletcher–Goldfarb–Shanno algorithm. In conclusion, we further provide a detailed assessment of the computational efficiency and its dependence on the optimization parameters of each method for determining the ground state structure of bulk silicon with varying supercell dimensions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Educating local radial basis functions using the highest gradient of interest in three dimensional geometries: EDUCATING LOCALIZED RBF-SCHEMES

We present a novel methodology to effectively localize radial basis function approximation methods in three dimensions. The local scheme requires shape parameter-dependent functions that can be used to approximate gradients of scattered data and to solve partial differential operators. The optimum shape parameter is obtained from the highest gradient of interest, where a known analytical function, when boundary conditions are not present, or a shape parameter-free global approximation are used to educate the localized scheme. The later option is applicable to problems where the operator needs to be solved multiple times, like in time evolution or stochastic integration. Past shape parameter's optimizations, for two-dimensional domains, based on the condition number of the interpolant matrix, were unable to provide satisfactory approximations. The applicability of our method is illustrated in the context of an analytical expression interpolation and during a Ginzburg-Landau relaxation of a free energy functional. In general, the optimum shape parameter depends on geometry, node distribution, and density, whereas the approximation errors decrease as the node density and the local stencil size increase. The effective localization of radial basis functions motivates its use in moving boundary problems and accelerates solutions through sparse matrix solvers.

free energy functional↗

Machine learning unifies flexibility and efficiency of spinodal structure generation for stochastic biomaterial design

Abstract Porous biomaterials design for bone repair is still largely limited to regular structures (e.g. rod-based lattices), due to their easy parameterization and high controllability. The capability of designing stochastic structure can redefine the boundary of our explorable structure–property space for synthesizing next-generation biomaterials. We hereby propose a convolutional neural network (CNN) approach for efficient generation and design of spinodal structure—an intriguing structure with stochastic yet interconnected, smooth, and constant pore channel conducive to bio-transport. Our CNN-based approach simultaneously possesses the tremendous flexibility of physics-based model in generating various spinodal structures (e.g. periodic, anisotropic, gradient, and arbitrarily large ones) and comparable computational efficiency to mathematical approximation model. We thus successfully design spinodal bone structures with target anisotropic elasticity via high-throughput screening, and directly generate large spinodal orthopedic implants with desired gradient porosity. This work significantly advances stochastic biomaterials development by offering an optimal solution to spinodal structure generation and design.

59 BASIC BIOLOGICAL SCIENCES↗

Volumetric Modulated Arc Therapy: Planning and Evaluation for Prostate Cancer Cases

Purpose: To develop an optimization method using volumetric modulated arc therapy (VMAT) and evaluate VMAT plans relative to the standard intensity-modulated radiotherapy (IMRT) approach in prostate cancer. Methods and Materials: A single gantry rotation was modeled using 177 equispaced beams. Multileaf collimator apertures and dose rates were optimized with respect to gantry angle subject to dose-volume-based objectives. Our VMAT implementation used conjugate gradient descent to optimize dose rate, and stochastic sampling to find optimal multileaf collimator leaf positions. A treatment planning study of 11 prostate cancer patients with a prescription dose of 86.4 Gy was performed to compare VMAT with a standard five-field IMRT approach. Plan evaluation statistics included the percentage of planning target volume (PTV) receiving 95% of prescribed dose (V95), dose to 95% of PTV (D95), mean PTV dose, tumor control probability, and dosimetric endpoints of normal organs, whereas monitor unit (MU) and delivery time were used to assess delivery efficiency. Results: Patient-averaged PTV V95, D95, mean dose, and tumor control probability in VMAT plans were 96%, 82.6 Gy, 88.5 Gy, and 0.920, respectively, vs. 97%, 84.0 Gy, 88.9 Gy, and 0.929 in IMRT plans. All critical structure dose requirements were met. The VMAT plans presented better rectal wall sparing, with a reduction of 1.5% in normal tissue complication probability. An advantage of VMAT plans was that the average number of MUs (290 MU) was less than for IMRT plans (642 MU). Conclusion: The VMAT technique can reduce beam on time by up to 55% while maintaining dosimetric quality comparable to that of the standard IMRT approach.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A generalized multi-resolution expansion for uncertainty propagation with application to cardiovascular modeling

Computational models are used in a variety of fields to improve our understanding of complex physical phenomena. Recently, the realism of model predictions has been greatly enhanced by transitioning from deterministic to stochastic frameworks, where the effects of the intrinsic variability in parameters, loads, constitutive properties, model geometry and other quantities can be more naturally included. A general stochastic system may be characterized by a large number of arbitrarily distributed and correlated random inputs, and a limited support response with sharp gradients or event discontinuities. This motivates continued research into novel adaptive algorithms for uncertainty propagation, particularly those handling high dimensional, arbitrarily distributed random inputs and non-smooth stochastic responses. Here, we generalize a previously proposed multi-resolution approach to uncertainty propagation to develop a method that improves computational efficiency, can handle arbitrarily distributed random inputs and non-smooth stochastic responses, and naturally facilitates adaptivity, i.e., the expansion coefficients encode information on solution refinement. Our approach relies on partitioning the stochastic space into elements that are subdivided along a single dimension, or, in other words, progressive refinements exhibiting a binary tree representation. We also show how these binary refinements are particularly effective in avoiding the exponential increase in the multi-resolution basis cardinality and significantly reduce the regression complexity for moderate to high dimensional random inputs. The performance of the approach is demonstrated through previously proposed uncertainty propagation benchmarks and stochastic multi-scale finite element simulations in cardiovascular flow.

59 BASIC BIOLOGICAL SCIENCES↗

Deep mixing in stellar variability: improved method, statistics, and applications

The preliminary results on deep-mixing manifestations in stellar variability are tested using our improved method and extended data set. We measure the timescales τ {sub m} of the stochastic change in the spectral power of rotational harmonics with numbers m ≤ 3 in the light curves of 1361 main-sequence stars from the Kepler mission archive. We find that the gradient [log(τ{sub 2})−log(τ{sub 1})]/[log(2)−log(1)] has a histogram maximum at −2/3, demonstrating agreement with Kolmogorov’s theory of turbulence and therefore confirming the manifestation of deep mixing. The squared amplitudes of the first and second rotational harmonics, corrected for integral photometry distortion, also show a quasi-Kolmogorov character with spectral index ≈−5/3. Moreover, the reduction of τ {sub 1} and τ {sub 2} to the timescales τ {sub lam1} and τ {sub lam2} of laminar convection in the deep stellar layers reveals the proximity of both τ {sub lam1} and τ {sub lam2} to the turnover time τ {sub MLT} of standard mixing length theory. Considering this result, we use the obtained stellar variability timescales instead of τ {sub MLT} in our analysis of the relation between stellar activity and the Rossby number P/τ {sub MLT}. Comparison of our diagrams with previous results and theoretical expectations shows that best-fit correspondence is achieved for τ {sub lam1}, which can therefore be used as an analog of τ {sub MLT}. This means that the laminar component (giant cells) of stellar turbulent convection indeed plays an important role in the physics of stars. Additionally, we estimate the diffusivity of magnetic elements in stellar photospheres.

79 ASTRONOMY AND ASTROPHYSICS↗

Shape optimization under uncertainty for rotor blades of horizontal axis wind turbines

We present a computational framework for the shape optimization of a Horizontal-Axis Wind Turbine (HAWT) rotor blade under uncertainty. Our framework integrates aerodynamic simulations based on the blade element method which utilizes reduced order models of the blade structure and wind load with design sensitivity analysis and nonlinear programming. The wind velocity is modeled as a stochastic process to account for variations in time and space. An additional stochastic process accounts for uncertainties in the structural material properties. The uncertainty propagation is based on a non-intrusive polynomial chaos expansion that allows accurate estimation of stochastic performance metrics such as generated power and structural compliance. Sensitivities of cost and constraint functions with respect to shape parameters namely twist angles are computed with an efficient scheme to enable gradient based optimization. To demonstrate the effect of uncertainty, designs obtained from optimization under uncertainty are compared to those obtained from deterministic optimization.

42 ENGINEERING↗

cDPD: A new dissipative particle dynamics method for modeling electrokinetic phenomena at the mesoscale

In this work, we develop a “charged” dissipative particle dynamics (cDPD) model for simulating mesoscopic electrokinetic phenomena governed by the stochastic Poisson-Nernst-Planck and the Navier-Stokes equations. In particular, the transport equations of ionic species are incorporated into the DPD framework by introducing extra degrees of freedom and corresponding evolution equations associated with each DPD particle. Diffusion of ionic species driven by the ionic concentration gradient, electrostatic potential gradient, and thermal fluctuations is captured accurately via pairwise fluxes between DPD particles. The electrostatic potential is obtained by solving the Poisson equation on the moving DPD particles iteratively at each time step. For charged surfaces in bounded systems, an effective boundary treatment methodology is developed for imposing both the correct hydrodynamic and electrokinetics boundary conditions in cDPD simulations. To validate the proposed cDPD model and the corresponding boundary conditions, we first study the electrostatic structure in the vicinity of a charged solid surface, i.e., we perform cDPD simulations of the electrostatic double layer and show that our results are in good agreement with the well-known mean-field theoretical solutions. Furthermore, we simulate the electrostatic structure and capacity densities between charged parallel plates in salt solutions with different salt concentrations. Moreover, we employ the proposed methodology to study the electro-osmotic and electro-osmotic/pressure-driven flows in a micro-channel. In the latter case, we simulate the dilute poly-electrolyte solution drifting by electro-osmotic flow in a micro-channel, hence demonstrating the flexibility and capability of this method in studying complex fluids with electrostatic interactions at the micro- and nano-scales.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Multiscale simulation of spatially correlated microstructure via a latent space representation

When deformation gradients act on the scale of the microstructure of a part due to geometry and loading, spatial correlations and finite-size effects in simulation cells cannot be neglected. We propose a multiscale method that accounts for these effects using a variational autoencoder to encode the structure–property map of the stochastic volume elements making up the statistical description of the part. In this paradigm the autoencoder can be used to directly encode the microstructure or, alternatively, its latent space can be sampled to provide likely realizations. Furthermore, we demonstrate the method on three examples using the common additively manufactured material AlSi10Mg in: (a) a comparison with direct numerical simulation of the part microstructure, (b) a push forward of microstructural uncertainty to performance quantities of interest, and (c) a simulation of functional gradation of a part with stochastic microstructure.

Elastoplasticity↗

Barriers in the transition to global chaos in collisionless magnetic reconnection. I. Ridges of the finite time Lyapunov exponent field

The transitional phase from local to global chaos in the magnetic field of a reconnecting current layer is investigated. Regions where the magnetic field is stochastic exist next to regions where the field is more regular. In regions between stochastic layers and between a stochastic layer and an island structure, the field of the finite time Lyapunov exponent (FTLE) shows a structure with ridges. These ridges, which are special gradient lines that are transverse to the direction of minimum curvature of this field, are approximate Lagrangian coherent structures (LCS) that act as barriers for the transport of field lines.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Modeling error PDF optimization based wavelet neural network modeling of dynamic system and its application in blast furnace ironmaking

In general, the modeling errors of dynamic system model are a set of random variables. The traditional performance index of modeling such as means square error (MSE) and root means square error (RMSE) can not fully express the connotation of modeling errors with stochastic characteristics both in the dimension of time domain and space domain. Therefore, the probability density function (PDF) is introduced to completely describe the modeling errors in both time scales and space scales. Based on it, a novel wavelet neural network (WNN) modeling method is proposed by minimizing the two-dimensional (2D) PDF shaping of modeling errors. First, the modeling error PDF by the tradional WNN is estimated using data-driven kernel density estimation (KDE) technique. Then, the quadratic sum of 2D deviation between the modeling error PDF and the target PDF is utilized as performance index to optimize the WNN model parameters by gradient descent method. Since the WNN has strong nonlinear approximation and adaptive capability, and all the parameters are well optimized by the proposed method, the developed WNN model can make the modeling error PDF track the target PDF, eventually. Simulation example and application in a blast furnace ironmaking process show that the proposed method has a higher modeling precision and better generalization ability compared with the conventional WNN modeling based on MSE criteria. Furthermore, the proposed method has more desirable estimation for modeling error PDF that approximates to a Gaussian distribution whose shape is high and narrow.

Modelling↗

On the Sampling-Based Computation of Nash Equilibria Under Uncertainty via the Nikaido–Isoda Function

We consider the computation of an equilibrium of a stochastic Nash equilibrium problem, where the player objectives are assumed to be L 0 -Lipschitz continuous and convex, given rival decisions with convex and closed player-specific feasibility sets. To address this problem, we consider minimizing a suitably defined value function defined using the Nikaido–Isoda function. Such an avenue does not necessitate either monotonicity properties of the concatenated gradient map or potentiality requirements on the game but does require a suitable regularity requirement under which a stationary point is a Nash equilibrium. We design and analyze a sampling-enabled projected-gradient-response method, reliant on inexact resolution of a player-level best-response subproblem. Here, by deriving suitable Lipschitzian guarantees on the value function, we derive both asymptotic guarantees for the sequence of generated iterates as well as rate and complexity guarantees for computing a stationary point by appropriate choices of the sampling rate and inexactness sequence.

Nikaido-Isoda function↗

Learning Stochastic Parametric Differentiable Predictive Control Policies

We present a scalable unsupervised learning-based method for obtaining explicit control policies for model predictive control problems for stochastic linear systems with additive uncertainties subject to nonlinear chance constraints. We call the proposed method stochastic parametric differentiable predictive control (SP-DPC), which extends the recently proposed deterministic DPC policy optimization algorithm. We formulate the SP-DPC as a deterministic approximation to the stochastic parametric constrained optimal control problem via independent sampling of the problem's parameters and uncertainties. This formulation allows us to directly compute the policy gradients via automatic differentiation of the problem's value function, evaluated over sampled parameters and uncertainties. In particular, the computed expectation of the problem's value function is backpropagated through the finite-time closed-loop system rollouts parametrized by a known nominal system dynamics model and neural control policy. We also provide theoretical probabilistic guarantees on closed-loop stability and chance constraints satisfaction for systems controlled by learned neural policies. We demonstrate the computational efficiency and scalability of the proposed policy optimization algorithm in three numerical examples, including systems with a large number of states or subject to nonlinear constraints.

Drgona, Jan↗

Modulated heat pulse propagation and partial transport barriers in chaotic magnetic fields

Direct numerical simulations of the time dependent parallel heat transport equation modeling heat pulses driven by power modulation in three-dimensional chaotic magnetic fields are presented. The numerical method is based on the Fourier formulation of a Lagrangian-Green's function method that provides an accurate and efficient technique for the solution of the parallel heat transport equation in the presence of harmonic power modulation. The numerical results presented provide conclusive evidence that even in the absence of magnetic flux surfaces, chaotic magnetic field configurations with intermediate levels of stochasticity exhibit transport barriers to modulated heat pulse propagation. In particular, high-order islands and remnants of destroyed flux surfaces (Cantori) act as partial barriers that slow down or even stop the propagation of heat waves at places where the magnetic field connection length exhibits a strong gradient. Results on modulated heat pulse propagation in fully stochastic fields and across magnetic islands are also presented. In qualitative agreement with recent experiments in large helical device and DIII-D, it is shown that the elliptic (O) and hyperbolic (X) points of magnetic islands have a direct impact on the spatio-temporal dependence of the amplitude of modulated heat pulses.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NONLINEAR EFFECTS IN PARTICLE TRANSPORT IN STOCHASTIC MAGNETIC FIELDS

Collisional particle transport in stochastic magnetic fields is studied using a semi-analytical method. The aim is to determine the influence of the nonlinear effects that occur in the magnetic field line random walk on particle transport. We show that particle transport coefficients can be strongly influenced by the magnetic line trapping. The conditions that correspond to these nonlinear regimes are determined. We also analyze the effects produced by the space variation of the large-scale magnetic field. We show that an average drift is generated by the gradient of the magnetic field, which strongly increases and reverses its orientation in the nonlinear regime.

79 ASTRONOMY AND ASTROPHYSICS↗

Extended geometric scaling from generalized traveling waves

We define a mapping of the QCD Balitsky-Kovchegov equation in the diffusive approximation with noise and a generalized coupling allowing a common treatment of the fixed and running QCD couplings. It corresponds to the extension of the stochastic Fisher and Kolmogorov-Petrovskii-Piscounov equation to the radial wave propagation in a medium with negative-gradient absorption responsible for anomalous diffusion, noninteger dimension, and damped noise fluctuations. We obtain its analytic traveling-wave solutions with a new scaling curve and for running coupling a new scaling variable allowing to extend the range and validity of the geometric-scaling QCD prediction beyond the previously known domain.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Output Feedback Stabilization for a Class of Multi-Variable Bilinear Stochastic Systems with Stochastic Coupling Attenuation

In this paper, stochastic coupling attenuation is investigated for a class of multi-variable bilinear stochastic systems and a novel output feedback m-block backstepping controller with linear estimator is designed, where gradient descent optimization is used to tune the design parameters of the controller. It has been shown that the trajectories of the closed-loop stochastic systems are bounded in probability sense and the stochastic coupling of the system outputs can be effectively attenuated by the proposed control algorithm. Moreover, the stability of the stochastic systems is analyzed and the effectiveness of the proposed method has been demonstrated using a simulated example.

47 OTHER INSTRUMENTATION↗