Search NASA⌕ Search

SEARCH · Search NASA

Results for “gradient flow dynamics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Plateau Phenomenon in Gradient Descent Training of RELU Networks: Explanation, Quantification, and Avoidance

The ability of neural networks to provide ‘best in class’ approximation across a wide range of applications is well-documented. Nevertheless, the powerful expressivity of neural networks comes to naught if one is unable to effectively train (choose) the parameters defining the network. In general, neural networks are trained by gradient descent type optimization methods,a stochastic variant thereof. In practice, such methods result in the loss function decreases rapidly at the beginning of training but then, after a relatively small number of steps, significantly slow down. The loss may even appear to stagnate over the period of a large number of epochs, only to then suddenly start to decrease fast again for no apparent reason. This so-called plateau phenomenon manifests itself in many learning tasks. The present work aims to identify and quantify the root causes of plateau phenomenon.analysis is carried out in the setting of univariate ReLU networks. No assumptions are made on the number of neurons relative to the number of training data, and our results hold for both the lazy and adaptive regimes. Here, the main findings are: plateaux correspond to periods during which activation patterns remain constant, where activation pattern refers to the number of data points that activate a given neuron; quantification of convergence of the gradient flow dynamics; and, characterization stationary points in terms solutions of local least squares regression lines over subsets of the training data. Based on these conclusions, we propose a new iterative training method, the Active Neuron Least Squares (ANLS), characterised by the explicit adjustment of the activation pattern at each step, which is designed to enable a quick exit from a plateau. Illustrative numerical examples are included throughout.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functions

Here we propose a new type of neural networks, Kronecker neural networks (KNNs), that form a general framework for neural networks with adaptive activation functions. KNNs employ the Kronecker product, which provides an efficient way of constructing a very wide network while keeping the number of parameters low. Our theoretical analysis reveals that under suitable conditions, KNNs induce a faster decay of the loss than that by the feed-forward networks. This is also empirically verified through a set of computational examples. Furthermore, under certain technical assumptions, we establish global convergence of gradient descent for KNNs. As a specific case, we propose the Rowdy activation function that is designed to get rid of any saturation region by injecting sinusoidal fluctuations, which include trainable parameters. The proposed Rowdy activation function can be employed in any neural network architecture like feed-forward neural networks, Recurrent neural networks, Convolutional neural networks etc. The effectiveness of KNNs with Rowdy activation is demonstrated through various computational experiments including function approximation using feed-forward neural networks, solution inference of partial differential equations using the physics-informed neural networks, and standard deep learning benchmark problems using convolutional and fully-connected neural networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Effects of an External Magnetic Field on Keyhole Mode Laser Melting of 316 Stainless Steel

Keyhole-mode laser melting is an efficient method for joining or cutting large, thick components, but controlling keyhole depth and fluctuations has remained challenging. Applying an external magnetic field can control melt pool flows and indirectly influence keyhole morphology and dynamics. The induced Lorentz force, comprising Seebeck and damping components, plays a crucial role in the melt pool dynamics, depending on temperature gradient, flow rates, and magnetic field orientation and magnitude. This research investigates the effects of an external magnetic field on keyhole behavior during laser spot melting of 316 stainless steel using synchronized high-speed synchrotron X-ray and thermal imaging. Findings revealed that a longitudinal magnetic field (120 mT) increased keyhole depth but exacerbated lateral fluctuations, resulted in a 20% increase in the melt pool temperature gradient and a 27% decrease in cooling rate. Conversely, a transverse magnetic field (760 mT) reduced keyhole depth and improved porosity formation. The findings suggest that a decrease in keyhole depth correlates with a decrease in fluctuations, and vice versa. These insights enhance understanding of external magnetic fields’ impact on laser melting, with implications for improving part quality.

Alamdari, Aslan Bafahm [The Ohio State Univ., Colu↗
DOE OSTI2025

The impact of argon addition on hydrogen superpermeation through palladium alloy metal foil pumps during direct internal recycling

Metal foil pumps (MFPs) are a leading technology for the direct internal recycling (DIR) of hydrogen isotopes from the plasma exhaust of fusion devices. MFPs rely on the concept of superpermeation, where plasma-generated atomic hydrogen absorbs into the metal foil, rapidly diffuses, and desorbs downstream. To date, studies of superpermeation have predominantly employed pure hydrogen or in some cases trace levels of impurities. In practice the plasma exhaust may contain significant levels of plasma enhancement gases such as argon, an inert gas with metastable states that can enhance the plasma. In this work, we systematically study the impact of Ar addition on the performance of PdCu and PdAg MFPs at low temperature. Performance was strongly dependent on the DIR fraction. At negligible DIR levels Ar addition did not significantly improve the flux over dilution effects. However, under appreciable DIR operation the flux was enhanced up to 90 % relative to pure H 2 , with the optimal concentration range being 5–10 % Ar exiting the system. Beyond 15 % addition plasma enhancement benefits were offset by dilution. Performance correlated with the atomic H emission, and benefits were more pronounced for PdAg than PdCu. Operation at significant DIR levels dramatically alters the flow dynamics resulting in concentration gradients near the MFP, creating plasma conditions that promote H 2 dissociation.

70 - PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Tailoring material microstructure and property in wire-laser directed energy deposition through a wiggle deposition strategy

Developing effective strategies to directly control material microstructure, property, and anisotropy is an active research area in metal additive manufacturing. This work develops a wiggle deposition pattern for wire-laser directed energy deposition (DED) of 316L stainless steel (SS) to modify the solidification texture, particularly in the building direction, in as-deposited samples. Through multi-physics simulation, operando near-infrared imaging, and synchrotron x-ray characterization, it is found that the wiggle deposition strategy induces highly dynamic melt flow and oscillating thermal gradient in the melt pool, which is responsible for the variation of preferable grain growth direction and crystallographic texture in the sample. The specific texture reduces the anisotropy in the tensile strength of as-printed 316L SS samples cut along different directions. Also, it largely increases the ductility along the build direction. Crystal plasticity simulation is performed to correlate the sample texture with mechanical property. In conclusion, this work offers a unique approach for tailoring local properties through the control of melt pool instability by applying different tool paths.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Impact of Different Thermal Gradients on the Dynamics of Cylindrical Lithium-ion Cells Subject to Accelerated Aging and on Module Performance

This study investigates the impacts of applying different thermal gradient patterns to cylindrical lithium-ion cells in a module on cell dynamics (temperatures, current flows, state of charge), module performance (evolution of resistance, capacity, and energy versus cycle number), and module lifetime. The thermal gradients were generated using cooling plates (CPs) with three different flow-field designs, namely, straight, perpendicular, and U-turn. The study uses computational fluid dynamics (CFD), the pseudo-two-dimensional (P2D) battery model, capacity loss and increased impedance due to the growth of a solid-electrolyte-interphase, and the electric current distribution from module terminals to cells that depends on the series-parallel electrical connections among the cells. The impact of the thermal gradient (resulting from the CP designs) on the variability in resistance, current, state of charge, and voltage among the cells was analyzed and linked to differences in the module's performance. Applying a thermal gradient to parallel-connected strings of series-connected cells led to variation in the current through each parallel string and an imbalance in the voltage of series-connected cells. Module performance is poorer when the thermal gradient causes a voltage imbalance than when it causes a current imbalance. Module performance becomes the worst when both current variation and voltage imbalance happen together. For instance, the module's lifetime (estimated as reaching 80% of its initial capacity) varied by 5% to 17.5%, depending on the magnitude and pattern of the imposed thermal gradient. As the relative orientation between thermal gradients and cells' electrical connectivity influences the module's performance, appropriate consideration should be given to the choice of the CP, especially if large thermal gradients are allowed.

Battery thermal management↗
DOE OSTI2021

Temperature Homogeneity under Selective and Localized Microwave Heating in Structured Flow Reactors

Selective heating of different phases of multiphase systems via microwaves can result in energy savings and suppression of side reactions. However, materials properties and operating conditions that maximize temperature gradients are poorly understood. Here we utilize computational fluid dynamics (CFD) computations and temperature measurements in structured flow reactors (monoliths) in a monomodal microwave cavity to assess the temperature difference between the walls and the fluid and develop a simple lumped model to estimate when temperature gradients exist. We also explore the material’s thermal and electrical properties of structured reactors for isothermal catalyst conditions. We propose that CFD simulations can be used as a nonintrusive, predictive tool of temperature homogeneity. Importantly, we demonstrate that localized heating in the bed under several conditions rather than selective heating is responsible for the selectivity enhancement. Furthermore, our results indicate that structured beds made of high thermal conductivity materials avoid arcing and enable temperature homogeneity and low electrical conductivity materials allow microwaves to penetrate the domain.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Sequential formulation of all‐way coupled finite strain thermoporomechanics for largely deformable gas hydrate deposits

We develop a numerically stable sequential formulation of thermoporomechanics for largely deformable gas hydrate deposits, extended from the fixed stress split of infinitesimal transformation. Constitutive equations are based on the total Lagrangian approach for both flow and geomechanics, including dynamic full tensor permeability and thermal conductivity updated from the deformation gradient. For space discretization, we take the cell-centered finite volume and node-based finite element method for flow and geomechanics, respectively. Then, we propose a sequential implicit method for all-way coupled thermoporomechanics, where the nonisothermal multiphase flow problem of gas hydrates is solved implicitly first and then the geomechanics problem is solved implicitly at the next step. During solution of the flow problem, we fix the rate of first Pioal total stress for numerical stability as well as apply porosity correction and entropy correction to account for geomechanical effects. We test numerical examples where flow and geomechanics parameters are based on deep oceanic gas hydrate deposits. When applying depressurization, even though the results between the infinitesimal transformation and finite strain geomechanics are similar in the early stages due to small deformation, we find differences between them in the late times as deformation becomes large. Accordingly, permeability and thermal conductivity tensors become nonisotropic full tensors although they are initially isotropic. Furthermore, we identify numerical stability of the developed sequential method from the test cases that exhibit the highly complex coupled gas hydrate systems with large deformation. Thus, the proposed sequential formulation can be applied in largely deformable gas hydrate systems.

42 ENGINEERING↗
DOE OSTI2020

Investigation of flow regimes in arc plasma–gas interactions using a two-temperature arc in crossflow model

The perpendicular impingement of a gas stream on an electric arc, a configuration known as the arc in crossflow, is of primary relevance in the study of plasma-gas interactions, as well as in industrial applications such as circuit breakers and wire-arc spraying. The flow dynamics in the arc in crossflow are the result of coupled fluid-thermal-electromagnetic phenomena accompanied by large property gradients, which can produce significant deviations from Local Thermodynamic Equilibrium (LTE) among electrons and gas species. These characteristics can lead to the establishment of distinct flow regimes depending on the relative values of the controlling parameters of the system, such as inflow velocity, arc current, and inter-electrode spacing. A two-temperature non-LTE (NLTE) model is used to investigate the arc dynamics and the establishment of flow regimes in the arc in crossflow. The plasma flow model is implemented within a nonlinear Variational Multiscale (VMS) numerical discretization approach that is less dissipative, and hence better suited to capture unstable behavior, than traditional VMS methods commonly used in computational fluid dynamics simulations. The Reynolds and the Enthalpy dimensionless numbers, characterizing the relative flow strength and arc strength, respectively, are chosen as the controlling parameters of the system. Simulation results reveal the onset of dynamic behavior and the establishment of steady, periodic, quasi-periodic, and chaotic or potentially turbulent, regimes, as identified by distinct spatiotemporal fluctuations. The computational findings reveal the role of increasing the relative arc strength on enhancing flow stability by delaying the growth of fluctuating and unstable flow behavior.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Score-based deterministic density sampling

We propose a deterministic sampling framework using Score-Based Transport Modeling for sampling an unnormalized target density π given only its score ∇ log π. Our method approximates the Wasserstein gradient flow on KL($f_t$∥π) by learning the time-varying score ∇ log $f_t$ on the fly using score matching. While having the same marginal distribution as Langevin dynamics, our method produces smooth deterministic trajectories, resulting in monotone noise-free convergence. We prove that our method dissipates relative entropy at the same rate as the exact gradient flow, provided sufficient training. Numerical experiments validate our theoretical findings: our method converges at the optimal rate, has smooth trajectories, and is often more sample efficient than its stochastic counterpart. Experiments on high-dimensional image data show that our method produces high-quality generations in as few as 15 steps and exhibits natural exploratory behavior. The memory and runtime scale linearly in the sample size.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Using Ensemble Data Assimilation to Estimate Transient Hydrologic Exchange Flow Under Highly Dynamic Flow Conditions

Abstract Quantifying dynamic hydrologic exchange flows (HEFs) within river corridors that experience high‐frequency flow variations caused by dam regulations is important for understanding the biogeochemical processes at the river water and groundwater interfaces. Heat has been widely used as a tracer to infer steady‐state flow velocities through analytical solutions of heat transport defined by the diurnal temperature signals. Under sub‐daily dynamic flow conditions, however, such analytical solutions are not applicable due to the violation of their fundamental assumptions. In this study, we developed a data assimilation‐based approach to estimate the sub‐daily flux under highly dynamic flow conditions using multi‐depth temperature observations at a 5‐min resolution. If the hydraulic gradient is measured, Darcy's law was used to calculate the flux with permeability estimated from temperature responses below the riverbed. Otherwise, flux was estimated directly by assimilating multi‐depth temperature data at 1‐ or 2‐hr time intervals assuming one‐dimensional flow and heat transport governing equation. By comparing estimated fluxes with model‐generated synthetic truth, we demonstrated that both schemes have robust performance in estimating fluxes under highly dynamic flow conditions. This data assimilation‐based flux estimation method was able to capture the vertical sub‐daily fluxes using multi‐depth high‐resolution temperature data alone, even in the presence of multi‐dimensional flow. This approach has been successfully applied to real field temperature data collected at the Hanford site, which experiences highly dynamic HEFs. Our study shows the promise of adopting distributed 1‐D temperature monitoring to capture spatial and temporal exchange dynamics in river corridors at a watershed scale or beyond.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

The role of breakup and coalescence in fine-scale bubble-induced turbulence. I. Dynamics

We study the effect of bubble breakup and coalescence on fine-scale dynamics of bubbly turbulent flows using direct numerical simulations. We perform two different simulations of dilute bubbly flows of void fraction 0.5%: one with bubbles breaking up and coalescing and the other without these physical processes. The volume of the fluid method is used for simulating bubbles undergoing breakup and coalescence while the bubbles are treated as rigid spheres in the immersed boundary method simulation. The energy spectrum in both types of simulation, consistent with previous studies, exhibits a -3 slope. We follow a single infinitesimal fluid element as it evolves to understand velocity gradient dynamics using conditional mean trajectories. We note finite-time divergence when the fluid element evolves under the action of inertial and pressure dynamics. The inertial, pressure, and viscous velocity gradient dynamics, when considered individually, produce the same results for bubble-induced turbulence (BIT) as with the classical homogeneous isotropic turbulence (HIT). Yet when the overall velocity gradient dynamics is considered, BIT results in non-cyclic trajectories moving toward stable node and unstable saddle while classical HIT shows cyclic behavior in their trajectories that move toward the origin. Interestingly, both the volume of fluid and immersed boundary simulations produce similar results. Therefore, there are two main takeaways from this research. First, new velocity gradient models are needed for BIT as their velocity gradients behavior is entirely different from the HIT. Second, we can neglect the bubble topology, breakup, and coalescence while studying or modeling the fine-scale dynamics of BIT.

42 ENGINEERING↗
DOE OSTI2023

Modeled sub-hourly nitrate concentrations in subsurface water across a salt marsh system in Elkhorn Slough, California

Salt marshes are dynamic hydrologic systems where terrestrial groundwater, terrestrial surface water, and seawater mix due to bi-directional flows and pressure gradients. Salt marshes are known to remove excess nitrate from water thereby improving water quality in coastal systems. However, our knowledge of the short-term processes (e.g., intra-tidal) in salt marshes is limited. Further, we lack knowledge about how these short-term dynamics may change as a function of seasonality. To address this knowledge gap, we develope a sampling methodology that allowed us to continuously measure nitrate in subsurface water at three different depths across three marsh elevations at sub-hourly time steps. Here we present a data table with the results of nitrate in porewater across the three salt marsh elevations (information in the data set). We analyzed nitrate with a s::can spectrophotometer. We used the UV-Vis absorbance of the samples to calculate nitrate concentrations using a local calibration library. More information about the methodology can be found in Grande et al (2023). Seasonal and Tidal Variations in Hydrologic Inputs Drive Salt Marsh Porewater Nitrate Dynamics, Hydrological Processes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Assessment of Machine Learning Wall Modeling Approaches for Large Eddy Simulation of Gas Turbine Film Cooling Flows: An a Priori Study

Here, in this work, a priori analysis of machine learning (ML) strategies is carried out with the goal of data-driven wall modeling for large eddy simulation (LES) of gas turbine film cooling flows. High-fidelity flow datasets are extracted from wall-resolved LES (WRLES) of flow over a flat plate interacting with the coolant flow supplied by a single row of 7-7-7 shaped cooling holes inclined at 30 degrees with the flat plate at different blowing ratios (BR). The WRLES are performed using the high-order Nek5000 spectral element computational fluid dynamics (CFD) solver. Light gradient boosting machine (LightGBM) is employed as the ML algorithm for the data-driven wall model. Parametric tests are conducted to systematically assess the influence of a wide range of input flow features (velocity components, velocity gradients, pressure gradients, and fluid properties) on the accuracy of ML wall model with respect to prediction of wall shear stress. In addition, the use of spatial stencil and time delay is also explored within the ML wall modeling framework. It is shown that features associated with gradients of the streamwise and spanwise velocity components have a major impact on the prediction fidelity of wall model, while the effect of gradients of wall-normal velocity component is found to be negligible. Moreover, adding flow feature information from an x-y-z spatial stencil significantly improves the ML model accuracy and generalizability compared to just using local flow features from the matching location. Overall, highest prediction accuracy is achieved when both spatial stencil and time delay features are incorporated within the data-driven wall modeling paradigm.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Computational Study on the Effect of Thermal Boundary Conditions and Axial Aspect Ratio on Catalytic Oxidative Coupling of Methane

Packed-bed reactor models with a large reactor-diameter-to-particle-diameter ratio (N > 10) are commonly used in catalysis research. Their use is underpinned by strong simplifying assumptions including unidirectional plug flow, negligible radial gradients, small axial diffusion, and isothermal operation. However, the complex exothermic–endothermic nature of reactions like oxidative coupling of methane (OCM) coupled with heat transfer from the catalyst surface and convective heat losses from the reactor wall provides an interesting case study to evaluate packed-bed assumptions and understand axial and radial temperature variations that may impact conversion and selectivity. This computational study investigates the effect of thermal boundary conditions on catalyst performance in laboratory OCM reactors (N = ~13) through computational fluid dynamics (CFD) simulation. Further, the 1-D model typically used for modeling plug flow reactors assumes negligible radial temperature and species concentration gradients. This assumption is evaluated for OCM reactors over a range of geometric axial aspect ratios, defined as the reactor length divided by the diameter, comparing the 1-D with 3-D CFD results. 1-D model predictions of catalyst performance start to deviate from the 3-D model predictions as the axial aspect ratio decreases, specifically as diameter increases at constant length. In the work, the 1-D model assumption is only found to be valid for axial aspect ratios higher than 1.6, a result considered to be relevant for all exothermic catalytic reactors.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Blade Designs For Improved Multi-Phase Performance In sCO 2 Compressors; Part II - Optical Diagnostics In sCO 2 And Experimental Evaluation With Particle Image Velocimetry

This paper presents the second part of a study in which the leading-edge and suction surface of a compressor blade was modified to delay onset of phase change for sCO 2 compressors operating near the critical point. Using a first-of-its-kind apparatus for the measurement of sCO 2 flow fields, Particle Image Velocimetry (PIV) is used for local flow field measurements of two compressor blade geometries: the modified “biased-wedge,” and a conventional constant thickness blade. Utilizing the developed hardware, the feasibility of a simple, laser-based diagnostic for qualitatively measuring liquid phase regions, is also presented. The design of the optical diagnostics rig, a discussion of numerous challenges, and necessary considerations involved in performing optical-based measurements like PIV, in sCO 2 , are discussed. Velocity field measurements for the modified compressor profile show a much lower suction peak compared to a conventional blade. Furthermore, these results validate numerical results at the tested conditions, where the suction side profile of the biased wedge works to minimize the local pressure gradient.

14 SOLAR ENERGY↗
DOE OSTI2022

Weakly Magnetized, Hall Dominated Plasma Couette Flow

A novel plasma equilibrium in the high-β, Hall regime that produces centrally-peaked, high Mach number Couette flow is described. Flow is driven using a weak, uniform magnetic field and large, cross field currents. Large magnetic field amplification (factor 20) due to the Hall effect is observed when electrons are flowing radially inward, and near perfect field expulsion is observed when the flow is reversed. A dynamic equilibrium is reached between the amplified (removed) field and extended density gradients.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗