Search NASA⌕ Search

SEARCH · Search NASA

Results for “Gradient estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Gradient-based stochastic estimation of the density matrix

Fast estimation of the single-particle density matrix is key to many applications in quantum chemistry and condensed matter physics. The best numerical methods leverage the fact that the density matrix elements f(H) ij decay rapidly with distance rij between orbitals. This decay is usually exponential. However, for the special case of metals at zero temperature, algebraic decay of the density matrix appears and poses a significant numerical challenge. Here, we introduce a gradient-based probing method to estimate all local density matrix elements at a computational cost that scales linearly with system size. For zero-temperature metals, the stochastic error scales like S -(d+2)/2d , where d is the dimension and S is a prefactor to the computational cost. The convergence becomes exponential if the system is at finite temperature or is insulating.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Online Distribution System State Estimation via Stochastic Gradient Algorithm

Distribution network operation is becoming more challenging because of the growing integration of intermittent and volatile distributed energy resources (DERs). This motivates the development of new distribution system state estimation (DSSE) paradigms that can operate at fast timescale based on real-time data stream of asynchronous measurements enabled by modern information and communications technology. To solve the real-time DSSE with asynchronous measurements effectively and accurately, this paper formulates a weighted least squares DSSE problem and proposes an online stochastic gradient algorithm to solve it. The performance of the proposed scheme is analytically guaranteed and is numerically corroborated with realistic data on IEEE 123-bus feeder.

distribution system state estimation↗
DOE OSTI2025

Inverse rendering of fusion plasmas: Inferring plasma composition from imaging systems

In this work, we develop a differentiable rendering pipeline for visualising plasma emission within tokamaks, and estimating the gradients of the emission and estimating other physical quantities. Unlike prior work, we are able to leverage arbitrary representations of plasma quantities and easily incorporate them into a non-linear optimisation framework. The efficiency of our method enables not only estimation of a physically plausible image of plasma, but also recovery of the neutral Deuterium distribution from imaging and midplane measurements alone. We demonstrate our method with three different levels of complexity showing first that a poloidal neutrals density distribution can be recovered from imaging alone, second that the distributions of neutral Deuterium, electron density and electron temperature can be recovered jointly, and finally, that this can be done in the presence of realistic imaging systems that incorporate sensor cropping and quantisation.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Stochastic Gradient-Based Distributed Bayesian Estimation in Cooperative Sensor Networks

Distributed Bayesian inference provides a full quantification of uncertainty offering numerous advantages over point estimates that autonomous sensor networks are able to exploit. However, fully-decentralized Bayesian inference often requires large communication overheads and low network latency, resources that are not typically available in practical applications. In this paper, we propose a decentralized Bayesian inference approach based on stochastic gradient Langevin dynamics, which produces full posterior distributions at each of the nodes with significantly lower communication overhead. We provide analytical results on convergence of the proposed distributed algorithm to the centralized posterior, under typical network constraints. Finally, we also provide extensive simulation results to demonstrate the validity of the proposed approach.

42 ENGINEERING↗
DOE OSTI2023

An Iterative Bidirectional Gradient Boosting Algorithm for CVR Baseline Estimation

This paper presents a novel iterative, bidirectional, gradient boosting (bidirectional-GB) algorithm for estimating the baseline of the Conservation Voltage Reduction (CVR) program. We define the CVR baseline as the load profile during the CVR period if the substation voltage is not lowered. The proposed algorithm consists of two key steps: selection of similar days and iterative bidirectional-GB training. In the first step, preand post-event temperature profiles of the targeted CVR day are used to select similar days from historical non-CVR days. In the second step, the pre-event and post-event similar days are used to train two GBMs iteratively: a forward-GBM and a backwardGBM. After each iteration, the two generated CVR baselines are reconciled and only the first and the last points on the reconciled baseline are kept. The iteration repeats until all CVR baseline points are generated. We tested two gradient boosting methods (i.e., GBM and LighGBM) with two data resolutions (i.e., 15and 30-minute). The results demonstrate that both the accuracy and performance of the algorithm are satisfactory.

Lee, Han Pyo↗
DOE OSTI2024

An iterative bidirectional gradient boosting approach for CVR baseline estimation

Here this paper presents a novel Iterative Bidirectional Gradient Boosting Model (IBi-GBM) for estimating the baseline of Conservation Voltage Reduction (CVR) programs. In contrast to many existing methods, we treat CVR baseline estimation as a missing data retrieval problem. The approach involves dividing the load and its corresponding temperature profiles into three periods: pre-CVR, CVR, and post-CVR. To restore the missing load profile during the CVR period, the method employs a three-step process. First, a forward-pass GBM is executed using data from the pre-CVR period as inputs. Subsequently, a backward-pass GBM is applied using data from the post-CVR period. The two restored load profiles are reconciled, considering pre-calculated weights derived from forecasting accuracy, and only the leftmost and rightmost points are retained. The newly restored points are then included as inputs for the subsequent iteration. This iterative procedure continues until the original load data in the CVR period is fully restored. We develop IBi-GBM using actual smart meter and Supervisory Control and Data Acquisition (SCADA) data. Our results demonstrate that IBi-GBM exhibits robust performance across various data resolutions and in different seasons and outperforms existing methods by achieving a 1-2% reduction in normalized Root Mean Square Error (nRMSE).

42 ENGINEERING↗
DOE OSTI2017

Gradient boosting machine for modeling the energy consumption of commercial buildings

Accurate savings estimations are important to promote energy efficiency projects and demonstrate their cost-effectiveness. The increasing presence of advanced metering infrastructure (AMI) in commercial buildings has resulted in a rising availability of high frequency interval data. These data can be used for a variety of energy efficiency applications such as demand response, fault detection and diagnosis, and heating, ventilation, and air conditioning (HVAC) optimization. This large amount of data has also opened the door to the use of advanced statistical learning models, which hold promise for providing accurate building baseline energy consumption predictions, and thus accurate saving estimations. The gradient boosting machine is a powerful machine learning algorithm that is gaining considerable traction in a wide range of data driven applications, such as ecology, computer vision, and biology. In the present work an energy consumption baseline modeling method based on a gradient boosting machine was proposed. To assess the performance of this method, a recently published testing procedure was used on a large dataset of 410 commercial buildings. The model training periods were varied and several prediction accuracy metrics were used to evaluate the model's performance. The results show that using the gradient boosting machine model improved the R-squared prediction accuracy and the CV(RMSE) in more than 80 percent of the cases, when compared to an industry best practice model that is based on piecewise linear regression, and to a random forest algorithm.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Gradient-Informed Design Optimization of Select Nuclear Systems

In this work, we present a gradient-informed design optimization of nuclear reactor core components based on neutronics objectives with both continuous and discrete materials. The main argument in favor of using gradient-informed design optimization is that it scales well with increasing dimensionality of the design space. First, a challenge problem with 121 free parameters is solved with a gradient-informed method and then with a genetic algorithm. Then, a challenge problem to optimize the flux profile of a simplified assembly with eight axial zones is solved. Both challenge problems are solved using directly calculated derivatives from Tools for Sensitivity and Uncertainty Analysis Methodology Implementation (TSUNAMI) in the SCALE package. Furthermore, we demonstrate how a discrete optimization problem—selection of materials for 121 voxels—can be lifted into a continuous problem with mixed materials. In the continuous space, adjoint-based gradients are well-defined, and gradient descent is applicable. Then, a forcing function is introduced that with the selection of an appropriately sized hyperparameter can be used to guide the optimized continuous solution back into a discrete solution. This paper presents an account of the challenges that were faced when applying a gradient-informed optimization algorithm using a Monte Carlo calculation to estimate the gradient information and compares a gradient descent optimization method to a genetic algorithm optimization of the same geometry. Overall, this work demonstrates the potential use of adjoint-based gradient calculations in design optimization of nuclear systems.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2018

Secondary Ion Mass Spectrometry Methodology for Isotopic Ratio Measurement of Micro‐Grains in Thin Sections: True Grain Size Estimation and Deconvolution of Inter‐Grain Size Gradients and Intra‐Grain Radial Gradients

In a thin section, grains that were approximately spherical in situ appear circular in cross section, and the distribution of apparent diameters frequently assumed to be their size distribution. Scanning ion imaging by secondary ion mass spectrometry (SIMS) is capable of providing precise (< 1‰) stable isotope ratio measurements of such grains, but, importantly, also registers their rate of evolution in apparent size as they are ablated by the primary beam. By assessing rates of radius change with depth, the described methodology enables the ‘true’ size of grains to be estimated, as well as the distance of the sectioned surface from the original grain centre. Transects in three dimensions are made possible, and this capability enables better identification (and thus separation) of both inter‐grain chemical signatures as a function of grain size, and intra‐grain radial trends. In this example, we highlight the specific application to pyrite (FeS 2 ) minerals, which are frequently analysed by SIMS to determine their inter‐grain and intra‐grain geochemical variations, particularly in their sulfur stable isotopic ratios (δ 34 S). Benefits of the new methodology over the Faraday cup ‘spot mode’ are described. Data correction algorithms and precision considerations are discussed.

Jones, Clive↗
DOE OSTI2023

Adaptive sampling quasi-Newton methods for zeroth-order stochastic optimization

Here, we consider unconstrained stochastic optimization problems with no available gradient information. Such problems arise in settings from derivative-free simulation optimization to reinforcement learning. We propose an adaptive sampling quasi-Newton method where we estimate the gradients using finite differences of stochastic function evaluations within a common random number framework. We develop modified versions of a norm test and an inner product quasi-Newton test to control the sample sizes used in the stochastic approximations and provide global convergence results to the neighborhood of a locally optimal solution. We present numerical experiments on simulation optimization problems to illustrate the performance of the proposed algorithm. When compared with classical zeroth-order stochastic gradient methods, we observe that our strategies of adapting the sample sizes significantly improve performance in terms of the number of stochastic function evaluations required.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

An Overview of the Gradient-Based Local DIC Formulation for Motion Estimation in DICe

This document outlines the gradient-based digital image correlation (DIC) formulation used in DICe, the Digital Image Correlation Engine (Sandia’s open source DIC code). The gradient-based algorithm implemented in DICe directly reflects the formulation presented here. Every effort is made to point out any simplifications or assumptions involved in the implementation. The focus of this document is on determination of the motion parameters. Computing strain is not discussed herein.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Locally adaptive artificial viscosity strategies for Lagrangian hydrodynamics

To accurately model inviscid flow with shock waves using staggered-grid Lagrangian hydrodynamics, artificial viscosity is introduced to convert kinetic energy into internal energy, thereby providing a mechanism to generate the required entropy increase across shocks. In this paper, we propose a new method for constructing an adaptive, artificial viscosity in the context of one-dimensional, staggered-grid Lagrangian hydrodynamics. Our adaptive, artificial viscosity is defined in terms of two parameters that depend on density locally in a neighborhood around a shock, and hence, vary cell-by-cell. Our methodology is based on building a reference set of pre-computed optimal, globally constant artificial viscosity coefficients for a family of isolated shock test problems. For arbitrary flows, the evaluation of the unknown coefficients is automated by first estimating shock intensity locally, and second computing the corresponding adaptive parameter value via interpolation over the data from the pre-computed reference set of optimal, globally constant coefficient values. To illustrate the performance of our new approach, we compare our results against two existing methods. The first method is a limiter-based approach, which relies on estimating velocity gradients of the flow, and the second method is utilized in several commercial codes. Finally, we demonstrate that our new adaptive methodology produces more accurate results for a variety of tests with propagating shock waves, as well as for the aforementioned family of isolated shock problems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Energy Transport and Conversion Above a Bright Discrete Auroral Arc

Magnetically connected observations of particle distributions and luminosity from the Reimei spacecraft are used to examine energy transport and conversion occurring above a discrete auroral arc. By combining imaging and in situ measurements it is shown how transverse electromagnetic and kinetic energy fluxes measured along the spacecraft trajectory converge across geomagnetic field-lines into the acceleration region. It is shown how cross-field energy transport is facilitated by the formation of vortices along the length of the arc. From an integration over the vertical extent of the acceleration region it is shown that the transverse and field-aligned flow of energy into the arc locally supports the dissipation needed to power the electron acceleration observed. Estimates of gradients in electromagnetic and kinetic energy flows show how field-aligned electron energization in the acceleration region is supported by the divergence of Poynting flux along and across the background magnetic field.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Damping inter-area oscillation using reinforcement learning controlled TCSC

Appropriate damping control of the inter-area oscillation would ensure the grid stability and maintain the tie-line power transfer capability. In this paper, we proposed a novel reinforcement learning (RL) based power oscillation damping (POD) controller that uses Thyristor Controlled Series Compensators (TCSC) to damp inter-area oscillations. By leveraging the unbiased gradient direction estimation of the natural evolution strategy (NES), we successfully regulated the power flows on the tie-lines and damped inter-area oscillations through dynamically modulating the inserted reactance of the TCSC. The proposed RL-based POD controller has been tested on both two-area four-machine system and North American Minni-WECC system. Extensive studies have demonstrated the excellent performance of the proposed RL-based TCSC POD controller in damping inter-area oscillations.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Geothermal Reservoir Characterization at Wattenberg Area in Denver Basin

The geothermal potential of the Denver-Julesburg (D-J) Basin is largely overlooked. This study focuses on characterizing the geothermal potential in the greater Wattenberg area within the Denver Basin, using available well data and subsurface information and gas wells drilled to above 2500 m deep. The review reveals that the main structures comprise ENE-trending wrench faults, along with NNE, N, and NNW trending normal faults. A thermal anomaly is present bonded by Lafayette and Longmont wrench faults and overlying vitrinite reflectance anomaly. The geometry of thermal anomaly suggests that it is influenced by Longmont wrench fault and Lafayette fault, as well as the basin margin fault. Bottom hole temperatures are of 160 Degrees Celsius, with thermal gradients of and 62 Degrees Celsius/km. Reservoir temperature estimates from thermal gradients suggest a range of >200 Degrees Celsius at depths of 3 km.

Denver basin↗
DOE OSTI2024

Stochastic Approximation for Multi-period Simulation Optimization with Streaming Input Data

We consider a continuous-valued simulation optimization (SO) problem, where a simulator is built to optimize an expected performance measure of a real-world system while parameters of the simulator are estimated from streaming data collected periodically from the system. At each period, a new batch of data is combined with the cumulative data and the parameters are re-estimated with higher precision. The system requires the decision variable to be selected in all periods. Therefore, it is sensible for the decision-maker to update the decision variable at each period by solving a more precise SO problem with the updated parameter estimate to reduce the performance loss with respect to the target system. We define this decision-making process as the multi-period SO problem and introduce a multi-period stochastic approximation (SA) framework that generates a sequence of solutions. Two algorithms are proposed: Re-start SA (ReSA) reinitializes the stepsize sequence in each period, whereas Warm-start SA (WaSA) carefully tunes the stepsizes, taking both fewer and shorter gradient-descent steps in later periods as parameter estimates become increasingly more precise. We show that under suitable strong convexity and regularity conditions, ReSA and WaSA achieve the best possible convergence rate in expected sub-optimality either when an unbiased or a simultaneous perturbation gradient estimator is employed, while WaSA accrues significantly lower computational cost as the number of periods increases. In addition, we present the regularized ReSA, which obviates the need to know the strong convexity constant and achieves the same convergence rate at the expense of additional computation.

Computer Science↗
DOE OSTI2022

Temperature distribution in a laser-heated diamond anvil cell as described by finite element analysis

Finite element analysis (FEA) is a powerful tool for numerically solving partial differential equations over complex geometries and is thus useful for analyzing heat transport in laser-heated diamond anvil cell (LHDAC) experiments. Our models expand on previously published simulations by calculating the volume-averaged temperatures of both the sample and insulation/pressure media under steady-state heating to determine the thermal pressure of the hot sample. Our goal is to produce an accurate relationship between the measured surface temperature of the absorbing sample and the temperature of the transparent insulating media, which is used to determine thermal pressure but susceptible to steep temperature gradients. We find that in doing so, our FEA models of temperature within the pressure/insulation media can differ from simplified estimates of temperature gradients by more than a factor of 2. We also explore temperature-dependent and temperature-independent thermal conductivity models and find that the volume-averaged temperatures differ by up to a factor of 1.3, forcing the predicted thermal pressures determined to also differ by up to a factor of 1.5 at a temperature of 2000 K at 50 GPa for neon. Higher temperatures exacerbate this difference. We also find that unintentional asymmetric sample insertion and sample heating, which are common in LHDAC experiments, do not have a first-order effect on volume-averaged temperatures. The FEA models, available in both Python and FlexPDE, are versatile across different sample geometries, materials, and heat source laser shapes.

Farah, Frederick↗
DOE OSTI2022

Statistical Modeling of Peak Accelerating Gradients in LCLS-II and LCLS-II-HE

In this report, we study the vertical test gradient performance and the gradient degradation between vertical test and cryomodule test for the 1.3 GHz LCLS-II cavities. We develop a model of peak gradient statistics, and use our understanding of the LCLS-II results and the changes implemented for LCLS-II-HE to estimate the expected gradient statistics for the new machine. Finally, we lay out a plan to ensure that the LCLS-II-HE cryomodule gradient specifications are met while minimizing cavity disqualification by introducing a variable acceptance threshold for the accelerating gradient.

43 PARTICLE ACCELERATORS↗