Search NASA⌕ Search

SEARCH · Search NASA

Results for “Gradient estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A Dynamic Amplitude-Correcting Gradient Estimation Technique to Align X-ray Focusing Optics

High-brightness X-rays, as produced at synchrotrons and X-ray free electron laser (XFEL) facilities, are used to characterize materials in a variety of scientific experiments. In most cases, effective use of the high-energy light requires precisely-aligned focusing optics; one example being a compound refractive lens (CRL). To align a CRL, the position and rotation must be optimized along four axes. In practice, this is a labor-intensive, time-consuming manual process that can monopolize scarce experimental time at the necessary X-ray facilities. Models of the expected Xray transmission function suggest that this task can be automated; however, the temporally-varying intensity at X-ray free electron laser facilities preclude the direct use of standard implementations of optimization solvers such as steepest descent algorithms. In this paper, we propose a novel technique to estimate the gradient of noisy functions with temporally-varying amplitudes. We construct this dynamicamplitude correction by systematically sampling a fixed central location within the standard finite difference stencil, accounting for the observed changes in time, and normalizing the difference quotients against those fluctuations. In addition to a rigorous error analysis of the sampling technique, we demonstrate its efficacy in stochastic descent optimization methods. Further, we demonstrate how this approach may be implemented to optimize X-ray focusing optics at synchrotrons or XFEL facilities

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

An Online Dynamic Amplitude-Correcting Gradient Estimation Technique to Align X-ray Focusing Optics

High-brightness X-ray pulses, as generated at synchrotrons and X-ray free electron lasers (XFELs), are used in a variety of scientific experiments. At these facilities, measurements often require optical equipment, e.g Compound Refractive Lenses (CRLs) to be precisely aligned and focused. The lateral alignment of CRLs to a beamline requires precise positioning along four axes: two translational, and the two rotational. At a synchrotron, alignment is often accomplished manually. However, XFEL beamlines present a beam brightness that fluctuates stochastically, making manual alignment a time-consuming endeavor. Automation using simplex or classic stochastic descent often fails, given the errant gradient estimates. Herein we present a dynamic-amplitude correction to the usual gradient based on the combination of a generalized finite difference stencil and a time-dependent sampling pattern. Intensity is recorded periodically, then used to normalize numerical derivatives against fluctuations. Error expectation is analyzed, and efficacy is demonstrated on classic benchmarks. We provide a proof of concept by laterally aligning optics on a simulated XFEL beamline using data recorded at both synchrotron and XFEL facilities.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1990

A new class of gradient estimators for queueing systems with real-time constraints

Queuing systems are considered where the waiting or sojourn times of customers are constrained by specified deadlines. A performance measure of interest in these systems is the probability that a customer exceeds its assigned deadline. A new class of gradient estimators is presented for such performance measures with respect to various system parameters. The approach is applicable to a general class of problems and is based on efficiently capturing sensitivity information for probabilities of event occurrences from observed sample paths.

Gong, Wei-Bo↗
NASA NTRS2023

Sea Surface Temperature Gradients Estimation Using Top-of-Atmosphere Observations from the ESA Earth Explorer 10 Harmony Mission: Preliminary Studies

The Harmony satellite mission was recently approved as the next European Space Agency (ESA) Earth Explorer 10. The mission science objectives cover several applications related to solid earth, the cryosphere, upper-ocean dynamics and air–sea interactions. The mission consists of a constellation of two satellites, flying with the Copernicus Sentinel 1 (C or D) spacecraft, each hosting a C-band receive-only radar and a thermal infrared (TIR) payload. From an ocean dynamics/air–sea interaction perspective, the mission will provide the unique opportunity to observe simultaneously the signature of submesoscale upper-ocean processes via synthetic aperture radar and TIR imagery. The TIR imager is based on microbolometer technology and its acquisitions will rely on four channels: three narrow-band channels yielding observations at a ≃1 km spatial sampling distance (SSD) and a panchromatic (PAN, 8–12 μm) channel characterized by a ≃300 m SSD. Our study investigates the potential of Harmony in retrieving spatial features related to sea surface temperature (SST) gradients from the high-resolution PAN channel, relying on top-of-atmosphere (TOA) observations. Compared to a standard SST gradient retrieval, our approach does not require atmospheric correction, thus avoiding uncertainties due to inter-channel co-registration and radiometric consistency, with the possibility of exploiting the higher resolution of the PAN channel. The investigations were carried out simulating the future Harmony TOA radiances (TARs), as well as relying on existing state-of-the-art level 1 satellite products. Our approach enables the correct description of SST features at the sea surface avoiding the generation of spurious features due to atmospheric correction and/or instrumental issues. In addition, analyses based on existing satellite products suggest that the clear-sky TOA observations, in a typical mid-latitude scene, allow the reconstruction of up to 85% of the gradient magnitudes found at the sea-surface level. The methodology is less efficient in tropical areas, suffering from smoothing effects due to the high concentrations of water vapor.

sea surface temperature (SST)↗
NASA NTRS1973

Gradient estimates from stereo measurements for a Martian vehicle

The Martian roving vehicle requires an autonomous obstacle detection and path selection system. A laser range finder will be used to determine the locations of a number of discrete points at distances of 3 to 30 meters from the vehicle. The system might measure angles, ranges or a combination of both types of measurements.

Pfeifer, W. J.↗
DOE OSTI2018

On-board Radiation Sensor and Low-Altitude Contour Mapping of Radiation Fields using UAS Swarm - 18239

This paper addresses the design of light weight radiation sensors for the small-scale unmanned aerial system (UAS), and its implementation for low-altitude radiation source localization and contour mapping. The compact, high-resolution gamma-ray CZT sensors were integrated to UAS platforms as plug-and-play components using Robot Operation System (ROS). In this work, the UAS swarm consists of three platforms positioned in circular formation. The onboard data analysis provides time and position stamped intensities of gamma-ray peaks for each UAS-based sensor that are used as the input data for the swarm flight control algorithm. Each UAS measures radiation simultaneously for estimating gradient of radiation to compute a bulk heading angle of the swarm for contour mapping, which can provide relatively precise boundary of the safe area for potential human exploration. The UAS radiation sensors allow measurements from just few meters up to hundreds of meters thus filling the gap between land- and helicopter- based platforms. The swarm of UAS has advantages over a single agent based approach in detecting radiative sources and effectively mapping the area. The proposed method can locate sources of radiation as well as mapping the contaminated area for enhancing situation awareness capabilities for first responders. Computer simulation is presented for UAS swarm based source localization and contour mapping in the simulated radiation fields created by the MCNP code. Selected key gradient estimation and contour mapping algorithms are validated experimentally with small scale multicopter UAS in the indoor flight test bed. (authors)

42 ENGINEERING↗
NASA NTRS1992

The effect of turbulence on atmospheric gradient parameters estimated from ground-based radiometric and space geodetic measurements

A straightforward expression for the covariance of a general vector of atmospheric parameters is employed to calculate the effects of estimates of spatial gradients for a frozen Kolmogorov turbulence field moving over a site at constant velocities. Numerical calculations are performed to investigate the implications for three techniques: ground-based microwave radiometry, geodesy with the Global Positioning System, and VLBI. It is found that a prevailing wind with no true static gradients may give rise to apparent azimuthal asymmetries when gradient parameters are estimated. The standard deviation of the estimated north gradient parameter as a function of wind direction, for various wind speeds, is illustrated.

Davis, James L.↗
NASA NTRS1973

Stochastic estimates of gradient from laser measurements for an autonomous Martian roving vehicle

The general problem of estimating the state vector x from the state equation h = Ax where h, A, and x are all stochastic, is presented. Specifically, the problem is for an autonomous Martian roving vehicle to utilize laser measurements in estimating the gradient of the terrain. Error exists due to two factors - surface roughness and instrumental measurements. The errors in slope depend on the standard deviations of these noise factors. Numerically, the error in gradient is expressed as a function of instrumental inaccuracies. Certain guidelines for the accuracy of permissable gradient must be set. It is found that present technology can meet these guidelines.

Burger, P. A.↗
NASA NTRS1973

Stochastic estimates of gradient from laser measurements for an autonomous Martian Roving Vehicle

The general problem presented in this paper is one of estimating the state vector x from the state equation h = Ax, where h, A, and x are all stochastic. Specifically, the problem is for an autonomous Martian Roving Vehicle to utilize laser measurements in estimating the gradient of the terrain. Error exists due to two factors - surface roughness and instrumental measurements. The errors in slope depend on the standard deviations of these noise factors. Numerically, the error in gradient is expressed as a function of instrumental inaccuracies. Certain guidelines for the accuracy of permissable gradient must be set. It is found that present technology can meet these guidelines.-

Shen, C. N.↗
DOE OSTI2025

Derivative-free stochastic optimization via adaptive sampling strategies

In this paper, we present a novel derivative-free framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning to quantum computing involve settings where only stochastic function values are obtained via a zeroth-order oracle, which has no available gradient information and necessitates the usage of derivative-free optimization methodologies. Our approach includes estimating gradients using stochastic function evaluations and integrating adaptive sampling techniques to control the accuracy in these stochastic approximations. Our framework encapsulates several gradient estimation techniques, including standard finite-difference, Gaussian smoothing, sphere smoothing, randomized coordinate finite-difference, and randomized subspace finite-difference methods. We provide theoretical convergence guarantees for our framework and analyze the worst-case iteration and sample complexities associated with each gradient estimation method. Finally, we demonstrate the empirical performance of the methods on logistic regression and nonlinear least squares problems.

Adaptive sampling↗
DOE OSTI2021

A persistent adjoint method with dynamic time-scaling and an application to mass action kinetics

In this article, we consider an optimization problem where the objective function is evaluated at the fixed-point of a contraction mapping parameterized by a control variable, and optimization takes place over this control variable. Since the derivative of the fixed-point with respect to the parameter can usually not be evaluated exactly, an adjoint dynamical system can be used to estimate gradients. Using this estimation procedure, the optimization algorithm alternates between derivative estimation and an approximate gradient descent step. We analyze a variant of this approach involving dynamic time-scaling, where after each parameter update the adjoint system is iterated until a convergence threshold is passed. Here, we prove that, under certain conditions, the algorithm can find approximate stationary points of the objective function. We demonstrate the approach in the settings of an inverse problem in chemical kinetics, and learning in attractor networks.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2010

Peak-Seeking Control Using Gradient and Hessian Estimates

A peak-seeking control method is presented which utilizes a linear time-varying Kalman filter. Performance function coordinate and magnitude measurements are used by the Kalman filter to estimate the gradient and Hessian of the performance function. The gradient and Hessian are used to command the system toward a local extremum. The method is naturally applied to multiple-input multiple-output systems. Applications of this technique to a single-input single-output example and a two-input one-output example are presented.

Ryan, John J.↗
NASA NTRS1991

Perturbation analysis of queueing systems with a time-varying arrival rate

The authors consider an M/G/1 queuing with a time-varying arrival rate. The objective is to obtain infinitesimal perturbation analysis (IPA) gradient estimates for various performance measures of interest with respect to certain system parameters. In particular, the authors consider the mean system time over n arrivals and an arrival rate alternating between two values. By choosing a convenient sample path representation of this system, they derive an unbiased IPA gradient estimator which, however, is not consistent, and investigate the nature of this problem.

Cassandras, Christos G.↗
DOE OSTI2018

Accelerated Distributed Energy Management for Microgrids

This paper considers the optimal energy management for a microgrid. The goal of optimal energy management is to minimize the total generation cost while meeting total demand and satisfying individual generator output limits. To achieve this goal, we develop a distributed algorithm based on the consensus theory and gradient estimation technique. Compared to the existing algorithms with diminishing step-sizes, the proposed algorithm enjoys a faster convergence speed due to the fixed step-size, and thus increases the computation speed, and reduces the computation and communication burden. The proposed distributed algorithm is applicable to both fixed and time-varying directed communication networks. We show that the convergence of the proposed distributed algorithm is achieved if the fixed communication network is strongly connected, or if the time-varying communication network is uniformly jointly strongly connected. Numerical simulation results are used to illustrate and demonstrate the effectiveness of the proposed algorithm.

Du, Wen↗
DOE OSTI2024

Optimization using pathwise algorithmic derivatives of electromagnetic shower simulations

Among the well-known methods to approximate derivatives of expectancies computed by Monte-Carlo simulations, averages of pathwise derivatives are often the easiest one to apply. Computing them via algorithmic differentiation typically does not require major manual analysis and rewriting of the code, even for very complex programs like simulations of particle-detector interactions in high-energy physics. However, the pathwise derivative estimator can be biased if there are discontinuities in the program, which may diminish its value for applications. This work integrates algorithmic differentiation into the electromagnetic shower simulation code HepEmShow based on G4HepEm, allowing us to study how well pathwise derivatives approximate derivatives of energy depositions in a sampling calorimeter with respect to parameters of the beam and geometry. We found that when multiple scattering is disabled in the simulation, means of pathwise derivatives converge quickly to their expected values, and these are close to the actual derivatives of the energy deposition. Additionally, we demonstrate the applicability of this novel gradient estimator for stochastic gradient-based optimization in a model example.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

A Drift‐Kinetic Method for Obtaining Gradients in Plasma Properties From Single‐Point Distribution Function Data

Abstract In this paper, we derive a new drift‐kinetic method for estimating gradients in the plasma properties through a velocity space distribution at a single point. The gradients are intrinsically related to agyrotropic features of the distribution function. This method predicts the gradients in the magnetized distribution function and can predict gradients of arbitrary moments of the gyrotropic background distribution function. The method allows for estimates on density and pressure gradients on the scale of a Larmor radius, proving to resolve smaller scales than any method currently available to spacecraft. The model is verified with a set of fully kinetic VPIC particle‐in‐cell simulations.

Wetherton, B. A.↗
DOE OSTI2022

Two-Stage Reinforcement Learning Policy Search for Grid-Interactive Building Control

This paper develops an intelligent grid-interactive building controller, which optimizes building operation during both normal hours and demand response (DR) events. To avoid costly on-demand computation and to adapt to non-linear building models, the controller utilizes reinforcement learning (RL) and makes real-time decisions based on a near-optimal control policy. Learning such a policy typically amounts to solving a hard non-convex optimization problem. We propose to address this problem with a novel global-local policy search method. In the first stage, an RL algorithm based on zero-order gradient estimation is leveraged to search for the optimal policy globally, due to its scalability and the potential to escape some poor performing local optima. The obtained policy is then fine-tuned locally to bring the first-stage solution closer to that of the original unsmoothed problem. Experiments on a simulated five-zone commercial building demonstrate the advantages of the proposed method over existing learning approaches. They also show that the learned control policy outperforms a pragmatic linear model predictive controller (MPC) and approaches the performance of an oracle MPC in testing scenarios. Using a state-of-the-art advanced computing system, we demonstrate that the controller can be learned and deployed within hours of training.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗