Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient projection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Model-Free Primal-Dual Methods for Network Optimization with Application to Real-Time Optimal Power Flow

This paper examines the problem of real-time optimization of networked systems and develops online algorithms that steer the system towards the optimal trajectory without explicit knowledge of the system model. The problem is modeled as a dynamic optimization problem with time-varying performance objectives and engineering constraints. The design of the algorithms leverages the online zero-order primal-dual projected-gradient method. In particular, the primal step that involves the gradient of the objective function (and hence requires a networked systems model) is replaced by its zero-order approximation with two function evaluations using a deterministic perturbation signal. The evaluations are performed using the measurements of the system output, hence giving rise to a feedback interconnection, with the optimization algorithm serving as a feedback controller. The paper provides some insights on the stability and tracking properties of this interconnection. Finally, the paper applies this methodology to a real-time optimal power flow problem in power systems, and shows its efficacy on the IEEE 37-node distribution test feeder for reference power tracking and voltage regulation.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2023

Assignment of Freight Traffic in a Large-scale Intermodal Network under Uncertainty

This paper presents a methodology for freight traffic assignment in a large-scale road-rail intermodal network under uncertainty. Network uncertainties caused by natural disasters have dramatically increased in recent years. Several of these disasters (e.g., Hurricane Sandy, Mississippi River Flooding, and Hurricane Harvey) severely disrupted the U.S. freight transportation network, and consequently, the supply chain. To account for these network uncertainties, a stochastic freight traffic assignment model is formulated. An algorithmic framework, involving the sample average approximation and gradient projection algorithm, is proposed to solve this challenging problem. The developed methodology is tested on the U.S. intermodal network with freight flow data from the Freight Analysis Framework. The experiments consider three types of natural disasters that have different risks and impacts on transportation networks: earthquakes, hurricanes, and floods. It is found that for all disaster scenarios, freight ton-miles are higher compared to the base case without uncertainty. The increase in freight ton-miles is the highest under the flooding scenario; this is because there are more states in the flood-risk areas, and they are scattered throughout the U.S.

42 ENGINEERING↗
DOE OSTI2020

Model-Free Primal-Dual Methods for Network Optimization with Application to Real-Time Optimal Power Flow: Preprint

This paper examines the problem of real-time optimization of networked systems and develops online algorithms that steer the system towards the optimal trajectory without explicit knowledge of the system model. The problem is modeled as a dynamic optimization problem with time-varying performance objectives and engineering constraints. The design of the algorithms leverages the online zero-order primal-dual projected-gradient method. In particular, the primal step that involves the gradient of the objective function (and hence requires networked systems model) is replaced by its zero-order approximation with two function evaluations using a deterministic perturbation signal. The evaluations are performed using the measurements of the system output, hence giving rise to a feedback interconnection, with the optimization algorithm serving as a feedback controller. The paper provides some insights on the stability and tracking properties of this interconnection. Finally, the paper applies this methodology to a real-time optimal power flow problem in power systems, and shows its efficacy on the IEEE 37-node distribution test feeder for reference power tracking and voltage regulation.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2026

Comparative analysis of plasticity-based GND density estimation methods in crystal plasticity finite element models

In crystal plasticity finite element (CPFE) simulations, accurately quantifying geometrically necessary dislocations (GNDs) is critical for capturing strain gradients in polycrystals. We compare different methods for quantifying GNDs, all of which originate from the Nye tensor, which is computed as the curl of the plastic deformation gradient. The projection technique directly decomposes the Nye tensor onto individual screw and edge dislocation components to compute GNDs. This approach requires converting a nine-component Nye tensor into densities for a larger number of dislocation systems, a fundamentally underdetermined (non-unique) process, which is resolved using L2 minimization. In contrast, when employing CPFE analysis, one could directly compute dislocation densities on each slip system using shear gradients. Projection and slip gradient methods are compared with respect to their prediction of GNDs with changing grain size, strain, and grain neighborhoods, including multigrain junctions. Although these techniques match analytical GND densities for single slip, single crystal deformation, and are consistent with anticipated overall GND trends, we find that the GND densities from projection techniques are significantly lower than those predicted from CPFE-based slip gradients in polycrystals. A suggested improvement of only using the active dislocation systems in the projection technique almost entirely resolved this mismatch.

Crystal plasticity↗
DOE OSTI2022

Linear ion-scale microstability analysis of high and low-collisionality NSTX discharges and NSTX-U projections

Linear gyrokinetic simulations were conducted to investigate ion-gyroradius-scale micro-instability predictions for high-beta NSTX discharges and NSTX-U projections that span over an order of magnitude variation in collisionality. A complex mix of microtearing modes and hybrid trapped electron modes/kinetic ballooning modes (TEM/KBM) is predicted for all experimental or projected conditions. Ion temperature gradient (ITG) instabilities are typically stable in the NSTX discharges investigated, consistent with the observed neoclassical ion thermal transport. ITG thresholds inferred from the simulations are typically much higher than the experimental NSTX gradients, as well as the projected gradients in the NSTX-U scenario, which assumed ion temperatures limited by neoclassical transport only. The analysis suggests ITG instabilities are unlikely to contribute significant anomalous thermal losses in high-beta, lower collisionality NSTX-U scenarios. On the other hand, the NSTX experimental profiles and NSTX-U projections are predicted to be very close to the predicted onset of unstable KBM at most radii investigated. The proximity of the various discharges to the KBM instability threshold implies it may play an important role in setting profile shapes and limiting global energy confinement. Here, it remains to be understood and predicted how KBM contributes to multi-channel transport (thermal and particle transport, for both ions and electrons) in a way that is consistent with experimental inferences.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Uncertainty quantification of graph convolution neural network models of evolving processes

The application of neural network models to scientific machine learning tasks has proliferated in recent years. In particular, neural networks have proved to be adept at modeling processes with spatial–temporal complexity. Nevertheless, these highly parameterized models have garnered skepticism in their ability to produce outputs with quantified error bounds over the regimes of interest. Hence there is a need to find uncertainty quantification methods that are suitable for neural networks. In this work we present comparisons of the parametric uncertainty quantification of neural networks modeling complex spatial–temporal processes with Hamiltonian Monte Carlo and Stein variational gradient descent and its projected variant. Specifically we apply these methods to graph convolutional neural network models of evolving systems modeled with recurrent neural network and neural ordinary differential equations architectures. We show that Stein variational inference is a viable alternative to Monte Carlo methods with some clear advantages for complex neural network models. For our exemplars, Stein variational interference gave similar pushed forward uncertainty profiles through time compared to Hamiltonian Monte Carlo, albeit with generally more generous variance. As a result, projected Stein variational gradient descent also produced similar uncertainty profiles to the non-projected counterpart, but large reductions in the active weight space were confounded by the stability of the neural network predictions and the convoluted likelihood landscape.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Increasing temperatures reduce invertebrate abundance and slow decomposition

Decomposition is an essential ecosystem service driven by interacting biotic and abiotic factors. Increasing temperatures due to climate change can affect soil moisture, soil fauna, and subsequently, decomposition. Understanding how projected climate change scenarios will affect decomposition is of vital importance for predicting nutrient cycling and ecosystem health. In this study, we experimentally addressed the question of how the early stages of decomposition would vary along a gradient of projected climate change scenarios. Given the importance of biodiversity for ecosystem service provisioning, we measured the effect of invertebrate exclusion on red maple ( Acer rubrum ) leaf litter breakdown along a temperature gradient using litterbags in warming chambers over a period of five weeks. Leaf litter decomposed more slowly in the warmer chambers and in the litterbag treatment that minimized invertebrate access. Moreover, increasing air temperature reduced invertebrate abundance and richness, and altered the community composition, independent of exclusion treatment. Using structural equation models, we were able to disentangle the effects of average air temperature on leaf litter loss, finding a direct negative effect of warming on the early stages of decomposition, independent of invertebrate abundance. This result indicates that not only can climate change affect the invertebrate community, but may also directly influence how the remaining organisms interact with their environment and their effectiveness at provisioning ecosystem services. Overall, our study highlights the role of biodiversity in maintaining ecosystem services and contributes to our understanding of how climate change could disrupt nutrient cycling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Multi‐Material Gradient Printing Using Meniscus‐enabled Projection Stereolithography (MAPS)

Light‐based additive manufacturing methods are widely used to print high‐resolution 3D structures for applications in tissue engineering, soft robotics, photonics, and microfluidics, among others. Despite this progress, multi‐material printing with these methods remains challenging due to constraints associated with hardware modifications, control systems, cross‐contamination, waste, and resin properties. Here, a new printing platform coined Meniscus‐enabled Projection Stereolithography (MAPS) is reported, a vat‐free method that relies on generating and maintaining a resin meniscus between a crosslinked structure and bottom window to print lateral, vertical, discrete, or gradient multi‐material 3D structures with no waste and user‐defined mixing between layers. MAPS is compatible with a wide range of resins shown and can print complex multi‐material 3D structures without requiring specialized hardware, software, or complex washing protocols. MAPS's ability to print structures with microscale variations in mechanical stiffness, opacity, surface energy, cell densities, and magnetic properties provides a generic method to make advanced materials for a broad range of applications.

bioprinting↗
DOE OSTI2020

On the Solution of ℓ 0 -Constrained Sparse Inverse Covariance Estimation Problems

The sparse inverse covariance matrix is used to model conditional dependencies between variables in a graphical model to fit a multivariate Gaussian distribution. Estimating the matrix from data are well known to be computationally expensive for large-scale problems. Sparsity is employed to handle noise in the data and to promote interpretability of a learning model. Although the use of a convex ℓ 1 regularizer to encourage sparsity is common practice, the combinatorial ℓ 0 penalty often has more favorable statistical properties. In this paper, we directly constrain sparsity by specifying a maximally allowable number of nonzeros, in other words, by imposing an ℓ 0 constraint. Here, we introduce an efficient approximate Newton algorithm using warm starts for solving the nonconvex ℓ 0 -constrained inverse covariance learning problem. Numerical experiments on standard data sets show that the performance of the proposed algorithm is competitive with state-of-the-art methods.

$\ell_0$-Constrained↗
DOE OSTI2021

Seismic Spatial Gradients and Machine Learning-Based Classifiers for Explosion Monitoring (LDRD 218327)

This final report summarizes the work completed under the Laboratory Directed Research and Development (LDRD) project “Seismic Spatial Gradients as a Machine Learning-Based Classifier for Explosion Monitoring.” The overarching goal of the project was to explore the efficacy of using machine learning-based classification algorithms where the input data are the spatial gradient of the seismic wavefield collected at a single point on the Earth’s surface. The methods that I describe here are in direct contrast to conventional methods of seismic discrimination which typically rely on a spatially extended network of instruments and physics-based wavefield attributes such as, for example, the ratio between $\textit{P}$ and $\textit{S}$ waves. Rather, we use the spatial gradient of the seismic wavefield observed at a single point on the Earth’s surface and data processing approaches inspired by the machine learning community. We tested two algorithms, a neural network and a modified version of principal component analysis termed Spectrally Filtered Principal Component Analysis (SFPCA). To test these algorithms, we first conducted a series of numerical tests using synthetic data and then conducted a small-scale controlled field experiment. The tests using synthetic data showed that both algorithms had high success rates on gradiometric data, even when simulated noise was added to the signal. Furthermore, we found that using seismic spatial gradients increased the performance of our discrimination algorithms when compared to using just the traditional translational motion seismic data. The tests with field data also showed a high degree of discriminative success.

58 GEOSCIENCES↗
DOE OSTI2024

What is the gradient of a scalar function defined on a subspace of square matrices?

We illustrate a technique to calculate the gradient of scalar functions that are defined on any arbitrary matrix subspace. It generalizes our earlier work titled “What is the gradient of a scalar function of a symmetric matrix ?”(Indian Journal of Pure and Applied Mathematics (2022), doi:10.1007/s13226-022-00313-x), in which we considered the special case of the subspace of symmetric matrices. Extant methods to calculate the gradient in such cases have an inherent flaw which leads to spurious results that populate several publications, as well as respected textbooks and handbooks on matrix calculus. We examine these sources and results in a rigorous and concrete mathematical setting of a finite-dimensional inner-product space and discover the inherent flaw and also a remedy. We demonstrate two ways to calculate the derivative/gradient and second derivative for scalar functions of matrices defined over an arbitrary matrix subspace; the first method is by considering any (differentiable) extension to the space of square matrices and projection of its gradient onto the given subspace. The second method utilizes an ordered basis and computes each component of the gradient through evaluation of the directional derivative. All the ideas presented are illustrated by non-trivial examples, namely, considering the subspace of 3 × 3 circulant and Toeplitz matrices and presenting the results of gradient-descent with both the spurious and correct gradients. Moreover, our bibliography makes it clear that a rigorous approach to matrix calculus is not common in practice, and our presentation of matrix calculus in the language of inner-product spaces will be significant and meaningful for applied mathematicians, engineers and researchers working in inter-disciplinary fields to avoid the conceptual pitfalls that exist.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

What is the gradient of a scalar function defined on a subspace of square matrices?

We illustrate a technique to calculate the gradient of scalar functions that are defined on any arbitrary matrix subspace. It generalizes our earlier work titled “What is the gradient of a scalar function of a symmetric matrix ?”(Indian Journal of Pure and Applied Mathematics (2022), https://doi.org/10.1007/s13226-022-00313-x), in which we considered the special case of the subspace of symmetric matrices. Extant methods to calculate the gradient in such cases have an inherent flaw which leads to spurious results that populate several publications, as well as respected textbooks and handbooks on matrix calculus. Here, we examine these sources and results in a rigorous and concrete mathematical setting of a finite-dimensional inner-product space and discover the inherent flaw and also a remedy. We demonstrate two ways to calculate the derivative/gradient and second derivative for scalar functions of matrices defined over an arbitrary matrix subspace; the first method is by considering any (differentiable) extension to the space of square matrices and projection of its gradient onto the given subspace. The second method utilizes an ordered basis and computes each component of the gradient through evaluation of the directional derivative. All the ideas presented are illustrated by non-trivial examples, namely, considering the subspace of 3 x 3 circulant and Toeplitz matrices and presenting the results of gradient-descent with both the spurious and correct gradients. Moreover, our bibliography makes it clear that a rigorous approach to matrix calculus is not common in practice, and our presentation of matrix calculus in the language of inner-product spaces will be significant and meaningful for applied mathematicians, engineers and researchers working in inter-disciplinary fields to avoid the conceptual pitfalls that exist.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A rotorcraft in-flight ice detection framework using computational aeroacoustics and Bayesian neural networks

Abstract This work develops a novel ice detection framework specifically suitable for rotorcraft using computational aeroacoustics and Bayesian neural networks. In an offline phase of the work, the acoustic signature of glaze and rime ice shapes on an oscillating wing are computed. In addition, the aerodynamic performance indicators corresponding to the ice shapes are also monitored. These performance indicators include the lift, drag, and moment coefficients. A Bayesian neural network is subsequently trained using projected Stein variational gradient descent to create a mapping from the acoustic signature generated by the iced wings to predict their performance indicators along with quantified uncertainty that is highly important for time- and safety-critical decision-making scenarios. While the training is carried out fully offline, usage of the Bayesian neural network to make predictions can be conducted rapidly online allowing for an ice detection system that can be used in real time and in-flight.

42 ENGINEERING↗
DOE OSTI2021

Bayesian inference of heterogeneous epidemic models: Application to COVID-19 spread accounting for long-term care facilities

Here we propose a high dimensional Bayesian inference framework for learning heterogeneous dynamics of a COVID-19 model, with a specific application to the dynamics and severity of COVID-19 inside and outside long-term care (LTC) facilities. We develop a heterogeneous compartmental model that accounts for the heterogeneity of the time-varying spread and severity of COVID-19 inside and outside LTC facilities, which is characterized by time-dependent stochastic processes and time-independent parameters in ~ 1500 dimensions after discretization. To infer these parameters, we use reported data on the number of confirmed, hospitalized, and deceased cases with suitable post-processing in both a deterministic inversion approach with appropriate regularization as a first step, followed by Bayesian inversion with proper prior distributions. To address the curse of dimensionality and the ill-posedness of the high-dimensional inference problem, we propose use of a dimension-independent projected Stein variational gradient descent method, and demonstrate the intrinsic low-dimensionality of the inverse problem. We present inference results with quantified uncertainties for both New Jersey and Texas, which experienced different epidemic phases and patterns. Moreover, we also present forecasting and validation results based on the empirical posterior samples of our inference for the future trajectory of COVID-19.

42 ENGINEERING↗
DOE OSTI2024

A Kaczmarz-inspired approach to accelerate the optimization of neural network wavefunctions

Neural network wavefunctions optimized using the variational Monte Carlo method have been shown to produce highly accurate results for the electronic structure of atoms and small molecules, but the high cost of optimizing such wavefunctions prevents their application to larger systems. We propose the Subsampled Projected-Increment Natural Gradient Descent (SPRING) optimizer to reduce this bottleneck. SPRING combines ideas from the recently introduced minimum-step stochastic reconfiguration optimizer (MinSR) and the classical randomized Kaczmarz method for solving linear least-squares problems. We demonstrate that SPRING outperforms both MinSR and the popular Kronecker-Factored Approximate Curvature method (KFAC) across a number of small atoms and molecules, given that the learning rates of all methods are optimally tuned. For example, on the oxygen atom, SPRING attains chemical accuracy after forty thousand training iterations, whereas both MinSR and KFAC fail to do so even after one hundred thousand iterations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Development of an Ultrahigh-bandwidth Phase Contrast Imaging System for detection of electron scale turbulence and Gigahertz Radio-Frequency Waves

The study of waves and turbulence is vital to the development of future reactor-grade plasma devices developed in the quest for fusion energy. These fluctuations are responsible for moving heat and particles across the magnetic field, and a predictive understanding of them is needed to achieve the density and temperature required to sustain a plasma fusion reaction. While many techniques have been developed for measuring waves and fluctuations, every measurement method has limitations. There are relatively few techniques for measuring very high frequency fluctuations, such as radio frequency waves injected to heat the plasma, unstable waves driven by suprathermal particles, or short wavelength electrostatic waves driven by electron temperature or density gradients. The present project builds upon the proven phase contrast imaging (PCI) technique to extend the response of the diagnostic by orders of magnitude in frequency and almost a factor of ten in spatial resolution. PCI provides a measurement of electron density based on small angle scattering of a CO-2 laser beam by using optical techniques to render a phase shift as an intensity change on a detector. Due to the telecommunications revolution, technological development by manufacturers has focused on components in the near -infrared, so that high- quality lasers and detectors at 1.55 µm are readily available. Shifting PCI design to a new, shorter wavelength has numerous advantages and challenges. Similar detector performance is available with room-temperature arrays with GHz bandwidth, while the detector arrays for 10.6 µm required liquid nitrogen cooling and were therefore limited to a bandwidth of about 1 MHz. Shifting to a shorter wavelength reduces the angle at which the laser beam scatters off of plasma waves, allowing more such scattered components to pass through the aperture of the vacuum vessel port and be collected by the PCI, which increases the spatial resolution. Concomitant with these benefits, various questions of performance arise. At shorter laser wave- length, the sensitivity to mirror and lens quality is increased, the contribution of the laser to the overall system noise is increased, and the sensitivity to vibrations is increased. The custom optical components at the heart of the PCI technique were required to be properly scaled for the shorter wavelength, so fabrication technologies needed to be explored. This project was designed to show that a low noise, high response PCI system at 1.55 µm could be constructed and operated, and then to quantify potential issues to allow extrapolation to a full-size production system providing physics measurements on a large plasma device. The first stage, producing the custom optical component called a Phase Plate, was successfully achieved using two methods. First, an easily reproduced masking and coating technique was able to produce good phase plates with the required parameters. Second, a nanofabrication technique was found to produce extremely high quality phase plates at a competitive price. The PCI constructed with the new phase plates and 1.55 µm laser was found to provide excellent wavelength measurements with the theoretically expected response. The sensitivity to optical surface quality was found to be in line with previous measurements at 10.6 µm. The observed signal-to-noise ratio was similar to the theoretically expected value. The effect of vibrations on PCI was studied with the first measurement of the effect of beam motion on PCI response and comparison to theory, allowing for a quantitative prediction of the effect of vibrations on a production PCI system and the requirements for improved beam stabilization. PCI is an extremely cost-effective method to provide a low noise, absolutely calibrated measurement of plasma fluctuations across a wide spatial scale. This project has shown that a 1.55 µm PCI using modern techniques and components is less expensive than the 10.6 µm PCI of a few years ago, with the largest savings in phase plate fabrication and the infrared detector array.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Excellent performance of 650 MHz single-cell niobium cavity after electropolishing

Electropolishing process and cathodes have undergone modification and optimization for both low- and high-beta 650 MHz five-cell niobium cavities for PIP-II. Cavities treated with these modified electropolishing conditions exhibited smooth surfaces and good performance in baseline tests. Nonetheless, due to administrative constraints on project cavities, maximum gradient performance testing was not conducted. This paper presents a study conducted on a single-cell 650 MHz cavity utilizing the optimized electropolishing conditions, highlighting the maximum performance attained for this specific cavity. The cavity tested at 2 K in a vertical cryostat reached a superior accelerating field gradient of 53.3 MV/m at Q0 of 1.6x1010, which is the highest gradient attained for this type of large-sized cavities.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Experimental and Computational Studies of Crystal Nucleation in Composition Gradients (Final Report)

The major goals of this project were to develop and validate a predictive nucleation model that incorporates composition gradients and is applicable to a large range of metallic systems which form both stochiometric and non-stochiometric compounds. Computationally we planned to expand the extent of thermodynamics-based theories and lay the groundwork to improve the general understanding and predictive capabilities of the role that gradients play in phase formation, glass formability and stability, and nucleation and growth events. To address these goals, we used Molecular Dynamics (MD) simulations and both isothermal and isochronal nanocalorimetric experiments on amorphous phases with a controlled composition gradient with the hopes of validating and improving the classical nucleation model and its use in solid solutions. While the computations were successful and identified ways to improve the classical nucleation model, the in situ nanocalorimetry studies proved very challenging due to unexpected difficulties in fabricating effective calorimeters and samples. Thus, we could not experimentally validate our predicted influence of composition gradients on nucleation. Nonetheless, important insights were gained and modifications to the classical nucleation theory were suggested.

36 MATERIALS SCIENCE↗