Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

A Differentiable Hydrology Approach for Modeling With Time-Varying Parameters

In the analysis of observational data with mathematical models, it is often desirable to let one or more model parameters vary with time to account for changing environmental conditions or to offer more flexibility. A standard approach for dynamic models is to allow for the number of parameters to grow as a function of time, leading to a high-dimensional inference problem for long data records. We propose using Hamiltonian Monte Carlo, a gradient-based Markov chain Monte Carlo (MCMC) method, to perform Bayesian inference for time-varying parameters (TVP) in hydrology models. As derivatives of model error functions with regard to parameters are not available in closed form, we implemented the GR4J rainfall-runoff models in Theano/PyMC3, and Jax/NumPyro, allowing for the application of automatic differentiation techniques. A simulation experiment assessing the viability of these methods for recovering underlying temporal variation in parameters indicates that a discrete Gaussian random walk-based prior appears to be best suited across a range of scenarios while the continuous-time Gaussian process compares relatively poorly. In an analysis of 20 years of daily real-world streamflow records from the Model Parameter Estimation Experiment (MOPEX) hydrology data set with increasing data sparsity and at multiple temporal resolutions, we find that TVP inference with gradient-based MCMC is a flexible and reliable approach for analyzing hydrology models with dynamic parameter sets.

54 ENVIRONMENTAL SCIENCES↗

Nonequilibrium solvent effects in Born-Oppenheimer molecular dynamics for ground and excited electronic states

The effects of solvent on molecular processes such as excited state relaxation and photochemical reaction often occurs in a nonequilibrium regime. Dynamic processes such as these can be simulated using excited state molecular dynamics. In this work, we describe methods of simulating nonequilibrium solvent effects in excited state molecular dynamics using linear-response time-dependent density functional theory and apparent surface charge methods. These developments include a propagation method for solvent degrees of freedom and analytical energy gradients for the calculation of forces. Molecular dynamics of acetaldehyde in water or acetonitrile are demonstrated where the solute-solvent system is out of equilibrium due to photoexcitation and emission.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Gradient of molecular Hartree–Fock–Bogoliubov energy with a linear combination of atomic orbital quasiparticle wave functions

The analytical gradient for the atomic-orbital-based Hartree–Fock–Bogoliubov (HFB) energy functional, the modified form of which was proposed by Staroverov and Scuseria to account for the static electron correlation [J. Chem. Phys. 117, 11107 (2002)], is derived. Interestingly, the Pulay force for the HFB energy is expressed with the same formula as that for the Hartree–Fock method. The efficiency of the present HFB energy gradient is demonstrated in the geometry optimizations of conjugated and biradical systems. The geometries optimized by using the HFB method with the appropriate factor ζ, which controls the degree of static correlation included, are found to show good agreement with those obtained by using a complete active-space self-consistent field method, although they are significantly dependent on ζ.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Nuclear–Electronic Orbital QM/MM Approach: Geometry Optimizations and Molecular Dynamics

Hybrid quantum mechanical/molecular mechanical (QM/MM) methods allow simulations of chemical reactions in atomistic solvent and heterogeneous environments such as proteins. Herein, the nuclear–electronic orbital (NEO) QM/MM approach is introduced to enable the quantization of specified nuclei, typically protons, in the QM region using a method such as NEO-density functional theory (NEO-DFT). This approach includes proton delocalization, polarization, anharmonicity, and zero-point energy in geometry optimizations and dynamics. Expressions for the energies and analytical gradients associated with the NEO-QM/MM method, as well as the previously developed polarizable continuum model (NEO-PCM), are provided. Geometry optimizations of small organic molecules hydrogen bonded to water in either dielectric continuum solvent or explicit atomistic solvent illustrate that aqueous solvation can strengthen hydrogen-bonding interactions for the systems studied, as indicated by shorter intermolecular distances at the hydrogen-bond interface. We then performed a real-time direct dynamics simulation of a phenol molecule in explicit water using the NEO-QM/MM method. Furthermore, these developments and initial examples provide the foundation for future studies of nuclear–electronic quantum dynamics in complex chemical and biological environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enhanced magnetic flux density mapping using coherent steady state equilibrium signal in MREIT

Measuring the z-component of magnetic flux density B = (B{sub x}, B{sub y}, B{sub z}) induced by transversally injected current, magnetic resonance electrical impedance tomography (MREIT) aims to visualize electrical property (current density and/or conductivity distribution) in a three-dimensional imaging object. For practical implementations of MREIT technique, it is critical to reduce injection of current pulse within safety requirements. With the goal of minimizing the noise level in measured B{sub z} data, we propose a new method to enhance the measure B{sub z} data using steady-state coherent gradient multi-echo (SSC-GME) MR pulse sequence combining with injection current nonlinear encoding (ICNE) method in MREIT, where the ICNE technique injects current during a readout gradient to maximize the signal intensity of phase signal including B{sub z}. The total phase offset in SSC-GME includes additional magnetic flux density due to the injected current, which is different from the phase signal for the conventional spoiled MR pulse sequence. We decompose the magnetization precession phase from the total phase offset including B{sub z} and optimize B{sub z} data using the steady-state equilibrium signal. Results from a real phantom experiment including different kinds of anomalies demonstrated that the proposed method enhanced B{sub z} comparing to a conventional spoiled pulse sequence.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Adjoint approach to calculating shape gradients for three-dimensional magnetic confinement equilibria

The shape gradient quantifies the change in some figure of merit resulting from differential perturbations to a shape. Shape gradients can be applied to gradient-based optimization, sensitivity analysis and tolerance calculation. An efficient technique for computing the shape gradient for toroidal three-dimensional magnetohydrodynamic (MHD) equilibria is introduced. The method is based on the self-adjoint property of the equations for driven perturbations of MHD equilibria and is similar to the Onsager symmetry of transport coefficients. Two versions of the shape gradient are considered. One describes the change in a figure of merit due to an arbitrary displacement of the outer flux surface; the other describes the change in the figure of merit due to the displacement of a coil. The method is implemented for several example figures of merit and compared with direct calculation of the shape gradient. In these examples the adjoint method reduces the number of equilibrium computations by factors of $O(N)$ , where $N$ is the number of parameters used to describe the outer flux surface or coil shapes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

SU-E-T-78: A Study of Dose Falloff Gradient in RapidArc Planning of Lung SBRT

Purpose: Rapid dose falloff beyond PTV is an important criterion for normal tissue sparing in SBRT. RTOG protocols use D2cm and R50% for plan quality evaluation. This study is aimed at analyzing the dose falloff gradient beyond the PTV extending into normal tissue structures and to ascertain the impact of PTV geometry and location on the dose falloff gradient in RapidArc planning of lung SBRT Methods: In this retrospective study, we analyzed 39 clinical RapidArc lung SBRT treatment plans that met RTOG-0915 criteria. Planning was done on Eclipse 8.9 for delivery on either Novalis NTx or TrueBeam STx equipped with HD MLCs. PTV volumes ranged between 5.3 and 113 cc (2.2 to 6 cm sphere equivalent diameter respectively) and their geographic locations were distributed in both lungs. 6X, 6X-FFF, 10X, and 10X-FFF energies were used for planning. All of these SBRT plans were planned using either 2 or 3 full or hemi arcs, with moderate couch kicks. Dose falloff gradients were obtained by generating 7 concentric 5 mm rings beyond PTV surface. Mean dose in each ring is used to evaluate percentage dose falloff gradient as a function of distance from the PTV surface. Results: The mean percentage dose falloff beyond PTV surface in all plans followed an exponential decay and the data was modeled with double exponential decay fit. Photon energy selection in the plan had a minimal impact on the mean percentage dose fall off beyond PTV surface. Conclusion: Dose falloff beyond PTV surface as a function of distance can be ascertained by the use of the double exponential decay fit coefficients in RapidArc planning of lung SBRT. This will help also in plan quality evaluation in addition to D2cm and R50% defined by RTOG.

60 APPLIED LIFE SCIENCES↗

Accelerated fast iterative shrinkage thresholding algorithms for sparsity-regularized cone-beam CT image reconstruction

Purpose: The development of iterative image reconstruction algorithms for cone-beam computed tomography (CBCT) remains an active and important research area. Even with hardware acceleration, the overwhelming majority of the available 3D iterative algorithms that implement nonsmooth regularizers remain computationally burdensome and have not been translated for routine use in time-sensitive applications such as image-guided radiation therapy (IGRT). In this work, two variants of the fast iterative shrinkage thresholding algorithm (FISTA) are proposed and investigated for accelerated iterative image reconstruction in CBCT. Methods: Algorithm acceleration was achieved by replacing the original gradient-descent step in the FISTAs by a subproblem that is solved by use of the ordered subset simultaneous algebraic reconstruction technique (OS-SART). Due to the preconditioning matrix adopted in the OS-SART method, two new weighted proximal problems were introduced and corresponding fast gradient projection-type algorithms were developed for solving them. We also provided efficient numerical implementations of the proposed algorithms that exploit the massive data parallelism of multiple graphics processing units. Results: The improved rates of convergence of the proposed algorithms were quantified in computer-simulation studies and by use of clinical projection data corresponding to an IGRT study. The accelerated FISTAs were shown to possess dramatically improved convergence properties as compared to the standard FISTAs. For example, the number of iterations to achieve a specified reconstruction error could be reduced by an order of magnitude. Volumetric images reconstructed from clinical data were produced in under 4 min. Conclusions: The FISTA achieves a quadratic convergence rate and can therefore potentially reduce the number of iterations required to produce an image of a specified image quality as compared to first-order methods. We have proposed and investigated accelerated FISTAs for use with two nonsmooth penalty functions that will lead to further reductions in image reconstruction times while preserving image quality. Moreover, with the help of a mixed sparsity-regularization, better preservation of soft-tissue structures can be potentially obtained. The algorithms were systematically evaluated by use of computer-simulated and clinical data sets.

60 APPLIED LIFE SCIENCES↗

Approximate Bayesian Model Inversion for PDEs with Heterogeneous and State-Dependent Coefficients

We present two approximate Bayesian inference methods for parameter estimation in partial differential equation (PDE) models with space-dependent and state-dependent parameters. We demonstrate that these methods provide accurate and cost-effective alternatives to Markov Chain Monte Carlo simulation. We assume a parameterized Gaussian prior on the unknown functions, and approximate the posterior density by a parameterized multivariate Gaussian density. The parameters of the prior and posterior are estimated from sparse observations of the PDE model's states and the unknown functions themselves by maximizing the evidence lower bound (ELBO), a lower bound on the log marginal likelihood of the observations. The first method, Laplace-EM, employs the expectation maximization algorithm to maximize the ELBO, with a Laplace approximation of the posterior on the E-step, and minimization of a Kullback-Leibler divergence on the M-step. The second method, DSVI-EB, employs the doubly stochastic variational inference (DSVI) algorithm, in which the ELBO is maximized via gradient-based stochastic optimization, with nosiy gradients computed via simple Monte Carlo sampling and Gaussian backpropagation. We apply these methods to identifying diffusion coefficients in linear and nonlinear diffusion equations, and we find that both methods provide accurate estimates of posterior densities and the hyperparameters of Gaussian priors. While the Laplace-EM method is more accurate, it requires computing Hessians of the physics model. The DSVI-EB method is found to be less accurate but only requires gradients of the physics model.

approximate Bayesian inference, model inversion, v↗

Efficient kinetic thermal inverse modeling for organic material decomposition

The prevalent use of organic materials in manufacturing is a fire safety concern, and motivates the need for predictive thermal decomposition models. A critical component of predictive modeling is numerical inference of kinetic parameters from bench scale data. Currently, an active area of computational pyrolysis research focuses on identifying efficient, robust methods for optimization. This paper demonstrates that kinetic parameter calibration problems can successfully be solved using classical gradient-based optimization. We explore calibration examples that exhibit characteristics of concern: high nonlinearity, high dimensionality, complicated schemes, overlapping reactions, noisy data, and poor initial guesses. The examples demonstrate that a simple, non-invasive change to the problem formulation can simultaneously avoid local minima, avoid computation of derivative matrices, achieve a computational efficiency speedup of 10x, and make optimization robust to perturbations of parameter components. Techniques from the mathematical optimization and inverse problem communities are employed. By re-examining gradient-based algorithms, we highlight opportunities to develop kinetic parameter calibration methods that should outperform current methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An iterative stochastic ensemble method for parameter estimation of subsurface flow models

Parameter estimation for subsurface flow models is an essential step for maximizing the value of numerical simulations for future prediction and the development of effective control strategies. We propose the iterative stochastic ensemble method (ISEM) as a general method for parameter estimation based on stochastic estimation of gradients using an ensemble of directional derivatives. ISEM eliminates the need for adjoint coding and deals with the numerical simulator as a blackbox. The proposed method employs directional derivatives within a Gauss–Newton iteration. The update equation in ISEM resembles the update step in ensemble Kalman filter, however the inverse of the output covariance matrix in ISEM is regularized using standard truncated singular value decomposition or Tikhonov regularization. We also investigate the performance of a set of shrinkage based covariance estimators within ISEM. The proposed method is successfully applied on several nonlinear parameter estimation problems for subsurface flow models. The efficiency of the proposed algorithm is demonstrated by the small size of utilized ensembles and in terms of error convergence rates.

97 MATHEMATICS AND COMPUTING↗

Fluids density functional theory and initializing molecular dynamics simulations of block copolymers

Classical, fluids density functional theory (fDFT), which can predict the equilibrium density profiles of polymeric systems, and coarse-grained molecular dynamics (MD) simulations, which are often used to show both structure and dynamics of soft materials, can be implemented using very similar bead-based polymer models. We aim to use fDFT and MD in tandem to examine the same system from these two points of view and take advantage of the different features of each methodology. Additionally, the density profiles resulting from fDFT calculations can be used to initialize the MD simulations in a close to equilibrated structure, speeding up the simulations. Here in this paper, we show how this method can be applied to study microphase separated states of both typical diblock and tapered diblock copolymers in which there is a region with a gradient in composition placed between the pure blocks. Both methods, applied at constant pressure, predict a decrease in total density as segregation strength or the length of the tapered region is increased. The predictions for the density profiles from fDFT and MD are similar across materials with a wide range of interfacial widths.

36 MATERIALS SCIENCE↗

A New Method for Synthesizing Radiation Dose-Response Data From Multiple Trials Applied to Prostate Cancer

Purpose: A new method is presented for synthesizing dose-response data for biochemical control of prostate cancer according to study design (randomized vs. nonrandomized) and risk group (low vs. intermediate-high). Methods and Materials: Nine published prostate cancer dose escalation studies including 6,539 patients were identified in the MEDLINE and CINAHL databases and reviewed to assess the relationship between dose and biochemical control. A novel method of analysis is presented in which the normalized dose-response gradient, {gamma}{sub 50}, is estimated for each study and subsequently synthesized across studies. Our method does not assume that biochemical control rates are directly comparable between studies. Results: Nonrandomized studies produced a statistically significantly higher {gamma}{sub 50} than randomized studies for intermediate- to high-risk patients ({gamma}{sub 50} = 1.63 vs. {gamma}{sub 50} = 0.93, p = 0.03) and a borderline significantly higher ({gamma}{sub 50} = 1.78 vs. {gamma}{sub 50} = 0.56, p = 0.08) for low-risk patients. No statistically significant difference in {gamma}{sub 50} was found between low- and intermediate- to high-risk patients (p = 0.31). From the pooled data of low and intermediate- to high-risk patients in randomized trials, we obtain the overall best estimate of {gamma}{sub 50} = 0.84 with 95% confidence interval 0.54-1.15. Conclusions: Nonrandomized studies overestimate the steepness of the dose-response curve as compared with randomized trials. This is probably the result of stage migration, improved treatment techniques, and a shorter follow-up in higher dose patients that were typically entered more recently. This overestimation leads to inflated expectations regarding the benefit from dose-escalation and could lead to underpowered clinical trials. There is no evidence of a steeper dose response for intermediate- to high-risk compared with low-risk patients.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Detecting Anomalous Images in Astronomical Datasets

Abstract Environmental and instrumental conditions can cause anomalies in astronomical images, which can potentially bias all kinds of measurements if not excluded. Detection of the anomalous images is usually done by human eyes, which is slow and sometimes not accurate. This is an important issue in weak lensing studies, particularly in the era of large-scale galaxy surveys, in which image qualities are crucial for the success of galaxy shape measurements. In this work we present two automatic methods for detecting anomalous images in astronomical data sets. The anomalous features can be divided into two types: one is associated with the source images, and the other appears on the background. Our first method, called the entropy method, utilizes the randomness of the orientation distribution of the source shapes and the background gradients to quantify the likelihood of an exposure being anomalous. Our second method involves training a neural network (autoencoder) to detect anomalies. We evaluate the effectiveness of the entropy method on the Canada–France–Hawaii Telescope Lensing Survey (CFHTLenS) and Dark Energy Camera Legacy Survey (DECaLS DR3) data. In CFHTLenS, with 1171 exposures, the entropy method outperforms human inspection by detecting 12 of the 13 anomalous exposures found during human inspection and uncovering 10 new ones. In DECaLS DR3, with 17112 exposures, the entropy method detects a significant number of anomalous exposures while keeping a low false-positive rate. We find that although the neural network performs relatively well in detecting source anomalies, its current performance is not as good as the entropy method.

Astronomy & Astrophysics↗

Electronic structure study of TiB{sub 2} and Ti{sub 2}B

In this paper, the electronic properties of TiB{sub 2} and Ti{sub 2}B are computed within the framework of Density Functional Theory (DFT) based on Linear Combination of Atomic Orbitals (LCAO) method. In the present calculations, the generalized gradient approximation (GGA) proposed by Perdew-Burke-Erenzerhof (PBE) and Becke’s scheme are considered to treat the correlation and exchange effects respectively. TiB{sub 2} crystallizes in the hexagonal AlB{sub 2} type structure which is designated as C32 with the space group P6/mmm. While the crystal structure of Ti{sub 2}B described in this paper is isomorphous to the body centered tetragonal (Al{sub 2}Cu - type) structure with space group I4/mcm.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A horizontal vane radiometer: Experiment, theory, and simulation

The existence of two motive forces on a Crookes radiometer has complicated the investigation of either force independently. The thermal creep shear force in particular has been subject to differing interpretations of the direction in which it acts and its order of magnitude. In this article, we provide a horizontal vane radiometer design which isolates the thermal creep shear force. The horizontal vane radiometer is explored through experiment, kinetic theory, and the Direct Simulation Monte Carlo (DSMC) method. The qualitative agreement between the three methods of investigation is good except for a dependence of the force on the width of the vane even when the temperature gradient is narrower than the vane which is present in the DSMC method results but not in the theory. The experimental results qualitatively resemble the theory in this regard. The quantitative agreement between the three methods of investigation is better than an order of magnitude in the cases examined. The theory is closer to the experimental values for narrow vanes and the simulations are closer to the experimental values for the wide vanes. We find that the thermal creep force acts from the hot side to the cold side of the vane. We also find the peak in the radiometer’s angular speed as a function of pressure is explained as much by the behavior of the drag force as by the behavior of the thermal creep force.

42 ENGINEERING↗

SYSTEMATIC AND STOCHASTIC VARIATIONS IN PULSAR DISPERSION MEASURES

We analyze deterministic and random temporal variations in the dispersion measure (DM) from the full three-dimensional velocities of pulsars with respect to the solar system, combined with electron-density variations over a wide range of length scales. Previous treatments have largely ignored pulsars’ changing distances while favoring interpretations involving changes in sky position from transverse motion. Linear trends in pulsar DMs observed over 5–10 year timescales may signify sizable DM gradients in the interstellar medium (ISM) sampled by the changing direction of the line of sight to the pulsar. We show that motions parallel to the line of sight can also account for linear trends, for the apparent excess of DM variance over that extrapolated from scintillation measurements, and for the apparent non-Kolmogorov scalings of DM structure functions inferred in some cases. Pulsar motions through atomic gas may produce bow-shock ionized gas that also contributes to DM variations. We discuss the possible causes of periodic or quasi-periodic changes in DM, including seasonal changes in the ionosphere, annual variations of the solar elongation angle, structure in the heliosphere and ISM boundary, and substructure in the ISM. We assess the solar cycle’s role on the amplitude of ionospheric and solar wind variations. Interstellar refraction can produce cyclic timing variations from the error in transforming arrival times to the solar system barycenter. We apply our methods to DM time series and DM gradient measurements in the literature and assess their consistency with a Kolmogorov medium. Finally, we discuss the implications of DM modeling in precision pulsar timing experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

Toward a better understanding of the gamma index: Investigation of parameters with a surface-based distance method

Purpose: The purpose of this work was to clarify the interactions between the parameters used in the {gamma} index with the surface-based distance method, which itself can be viewed as a generalized version of the {gamma} index. The examined parameters included the distance to agreement (DTA)/dose difference (DD) criteria, the percentage used as a passing criterion, and the passing percentage for given DTA/DD criteria. The specific aims of our work were (1) to understand the relationships between the parameters used in the {gamma} index, (2) to determine the detection limit, or the minimum detectable error, of the {gamma} index with a given set of parameters, and (3) to establish a procedure to determine parameters that are consistent with the capacity of an IMRT QA system. Methods: The surface-based distance technique with dose gradient factor was derived, and then the relationship between surface-based distance and {gamma} index was established. The dose gradient factor for plans and measurements of 10 IMRT patients, 10 spine stereotactic radiosurgery (SRS) patients, and 3 Radiological Physics Center (RPC) head and neck phantom were calculated and evaluated. The detection limits of the surface-based distance and {gamma} index methods were examined by introducing known shifts to the 10 IMRT plans. Results: The means of the dose gradient factors were 0.434 mm/% and 0.956 mm/% for the SRS and IMRT plans, respectively. Key quantities (including the mean and 90th and 99th percentiles of the distance distribution) of the surface-based distance distribution between two dose distributions were linearly proportional to the actual shifts. However, the passing percentage of the {gamma} index for a given set of DTA/DD criteria was not associated with the actual shift. For IMRT, using the standard quality assurance criteria of 3 mm/3% DTA/DD and a 90% passing rate, we found that the detection limit of the {gamma} index in terms of global shift was 4.07 mm/4.07 % without noise. Conclusions: Surface-based distance is a direct measure of the difference between two dose distributions and can be used to evaluate or determine parameters for use in calculating the {gamma} index. The dose gradient factor represents the weighting between spatial and dose shift and should be determined before DTA/DD criteria are set. The authors also present a procedure to determine {gamma} index parameters from measurements.

61 RADIATION PROTECTION AND DOSIMETRY↗