SEARCH · Search NASA
Results for “zeroth-order methods”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Stochastic Trust-Region Algorithm in Random Subspaces with Convergence and Expected Complexity Analyses
Here, this work proposes a framework for large-scale stochastic derivative-free optimization (DFO) by introducing STARS, a trust-region method based on iterative minimization in random subspaces. This framework is both an algorithmic and theoretical extension of a random subspace derivative-free optimization (RSDFO) framework, and an algorithm for stochastic optimization with random models (STORM). Moreover, like RSDFO, STARS achieves scalability by minimizing interpolation models that approximate the objective in low-dimensional affine subspaces, thus significantly reducing per-iteration costs in terms of function evaluations and yielding strong performance on largescale stochastic DFO problems. The user-determined dimension of these subspaces, when the latter are defined, for example, by the columns of so-called Johnson-Lindenstrauss transforms, turns out to be independent of the dimension of the problem. For convergence purposes, inspired by the analyses of RSDFO and STORM, both a particular quality of the subspace and the accuracies of random function estimates and models are required to hold with sufficiently high, but fixed, probabilities. Using martingale theory under the latter assumptions, an almost sure global convergence of STARS to a first-order stationary point is shown, and the expected number of iterations required to reach a desired first-order accuracy is proved to be similar to that of STORM and other stochastic DFO algorithms, up to constants.
Randomized Federated Learning Methods for Nonsmooth, Nonconvex, and Hierarchical Optimization (Final Technical Report)
This final technical report summarizes the outcomes of a DOE-funded project on federated scientific machine learning (FL) under nonsmooth, nonconvex, and hierarchical optimization settings. The project develops new mathematical models, algorithms, and theoretical guarantees for decentralized stochastic, bilevel, and minimax optimization problems arising in DOE mission-relevant applications. A unified framework of randomized and zeroth-order federated optimization methods is introduced, providing provable convergence, communication efficiency, and sample-complexity guarantees. The report documents algorithmic design, theoretical analysis, and empirical validation of the proposed federated learning methods. The project also contributes to workforce development through graduate training and dissemination of results via publications and seminars.
Perfectly Matched Layers and Characteristic Boundaries in Lattice Boltzmann: Accuracy vs Cost
Artificial boundary conditions (BCs) play a ubiquitous role in numerical simulations of transport phenomena in several diverse fields, such as fluid dynamics, electromagnetism, acoustics, geophysics, and many more. They are essential for accurately capturing the behavior of physical systems whenever the simulation domain is truncated for computational efficiency purposes. Ideally, an artificial BC would allow relevant information to enter or leave the computational domain without introducing artifacts or unphysical effects. Boundary conditions designed to control spurious wave reflections are referred to as nonreflective boundary conditions (NRBCs). Another approach is given by the perfectly matched layers (PMLs), in which the computational domain is extended with multiple dampening layers, where outgoing waves are absorbed exponentially in time. Here, in this work, the definition of PML is revised in the context of the lattice Boltzmann method. The impact of adopting different types of BCs at the edge of the dampening zone is evaluated and compared, in terms of both accuracy and computational costs. It is shown that for sufficiently large buffer zones, PMLs allow stable and accurate simulations even when using a simple zeroth-order extrapolation BC. Moreover, employing PMLs in combination with NRBCs potentially offers significant gains in accuracy at a modest computational overhead, provided the parameters of the BC are properly tuned to match the properties of the underlying fluid flow.
Derivative-free stochastic optimization via adaptive sampling strategies
In this paper, we present a novel derivative-free framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning to quantum computing involve settings where only stochastic function values are obtained via a zeroth-order oracle, which has no available gradient information and necessitates the usage of derivative-free optimization methodologies. Our approach includes estimating gradients using stochastic function evaluations and integrating adaptive sampling techniques to control the accuracy in these stochastic approximations. Our framework encapsulates several gradient estimation techniques, including standard finite-difference, Gaussian smoothing, sphere smoothing, randomized coordinate finite-difference, and randomized subspace finite-difference methods. We provide theoretical convergence guarantees for our framework and analyze the worst-case iteration and sample complexities associated with each gradient estimation method. Finally, we demonstrate the empirical performance of the methods on logistic regression and nonlinear least squares problems.
Multiscale astrobiology with the Vera C. Rubin Observatory Legacy Survey of Space and Time
The Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST) presents an unprecedented opportunity to advance the search for astrobiologically relevant data across diverse astronomical environments. Through its extensive imaging capabilities, LSST will enhance our inventory of Solar System objects and assess their potential astrobiological conditions. Beyond the Solar System, LSST will survey billions of stars, contributing to the detection of exoplanets, characterizing planetary atmospheres at a zeroth-order level, identifying transient phenomena, and exploring conditions within habitable zones. In this paper, we highlight LSST’s unique contribution to astrobiology, complementing other missions and expanding the search for life beyond Earth in the coming decades.
Second harmonic Bessel-Gauss beam shaping with elliptic axicon aberrations
The second harmonic (SH) of an axicon generated Bessel-Gauss beam is created through the nonlinear interaction of photons with a crystal, resulting in the energy doubling of the output photons. In this work, we show experimentally that in addition to frequency doubling, the SH of Bessel-Gauss beams under asymmetric aberrations from an elliptic axicon exhibit intriguing beam formation. Particularly, the central region of the SH beam profile is composed of two central spots of various geometries surrounded by nested ellipses; one of which is the configuration of two central gamma dots with similar radius knotted by nested ellipses for a zeroth-order Bessel-Gauss pump. These SH beams consistently maintain their spatial profile throughout propagation, reminiscing the behavior of screw dislocations in wave patterns. Our numerical simulations produce beam dynamics consistent with that of experiments and further implicate the remarkable interweaving of bright spots with dark vortices. This is especially noticeable when the beams dynamically oscillate along the optical axis, resulting in the genesis of spatially polarized beams with a knotted framework. The insights gained from our study establish a novel paradigm for exploring interactions of Bessel-like beams with vortex dynamics. This, in turn, has the potential to spark innovations in optical applications, fostering new methodologies to harness and manipulate complex light structures. Our experimental findings could spur new methods of generating logical states of light and new opportunities for material processing control. Published by the American Physical Society 2025