Search NASA⌕ Search

SEARCH · Search NASA

Results for “Lyapunov analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

17 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Provably-Stable Overload Ride-Through Control for Grid-Forming Inverters Using System-Wide Lyapunov Function Analysis

A key challenge associated with a grid-forming (GFM) inverter based resource (IBR) is its behavior during severe grid disturbances: since a GFM inverter regulates voltage in the fast timescale instead of current or power, it may experience a transient overload of current, power and/or energy during a severe grid disturbance. While many promising control strategies for overload ride-through have been proposed over the past two decades, transient stability of the system during and after the transition to an overload ride-through control mode remains difficult to guarantee. In this work, a novel overload ride-through control strategy is proposed for a system of grid-forming inverters that takes both self-protection and system-wide transient stability into account. A proposed system-level supervisory control uses slow communication to pre-emptively assign a set of local ride through control parameters to individual GFM IBR, including a current-limiting virtual reactance, that guarantees that synchronism is still preserved for any set of anticipated grid disturbances. At the core of the supervisory control lies a Lyapunov-function-based routine capable of establishing a strong, albeit conservative, transient stability guarantee for the system. Here, the proposed overload ride-through control strategy is validated via numerical integration of a reduced-order model, as well as through detailed electromagnetic transient (EMT) simulation.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2023

Adaptive Path-Following Control for Ground Vehicles Using a Switching Non-Quadratic Lyapunov Function

The application of adaptive control techniques in the development of control systems for intelligent vehicles, especially for ground vehicle path-following controllers, has gained popularity due to their ability to handle large-scale parametric uncertainties. However, the use of a standard quadratic Lyapunov function in existing adaptive control-based path-following controllers can lead to poor transient performance, such as slow convergence and/or large overshoot. To address this limitation, this study proposes the use of a switching non-quadratic Lyapunov function to design a model reference adaptive path-following controller that aims to provide superior transient performance. The stability and signal convergence of the closed-loop system are demonstrated through a Lyapunov-like analysis. Through dSPACE ASM simulation, the effectiveness of the proposed controller is illustrated, which confirms improved tracking performance over a baseline solution.

Zhou, Xingyu↗
DOE OSTI2022

A Lyapunov-Based Generalized Dc-Side Controller Design for PV-Connected Systems: Preprint

The objective of this paper is to realize a universal dc-side controller for photovoltaic (PV) systems where the control is agnostic to the downstream converter configuration. To achieve this, the downstream power converter and its controls are manipulated into an effective power control loop that is then cast into a generalized multi-loop design framework. On the dc side, a nonlinear small-signal model of the PV input is realized exclusively in terms of PV datasheet parameters (i.e., open-circuit voltage, short-circuit current, and maximum power point). Finally, a linear controller is used to modulate the dc-side PV system with the generic downstream power controller. A Lyapunov candidate is proposed to analyze the stability of the interconnected system and provide a streamlined approach for the controller design. The proposed design is validated on a 1-kVA experimental setup that interfaces a PV module to the grid.

dc-dc control↗
DOE OSTI2023

Finite-Time Analysis of Whittle Index based Q-Learning for Restless Multi-Armed Bandits with Neural Network Function Approximation

Whittle index policy is a heuristic to the intractable restless multi-armed bandits (RMAB) problem. Although it is provably asymptotically optimal, finding Whittle indices remains difficult. In this paper, we present Neural-Q-Whittle, a Whittle index based Q-learning algorithm for RMAB with neural network function approximation, which is an example of nonlinear two-timescale stochastic approximation with Q-function values updated on a faster timescale and Whittle indices on a slower timescale. Despite the empirical success of deep Q-learning, the non-asymptotic convergence rate of Neural-Q-Whittle, which couples neural networks with two-timescale Q-learning largely remains unclear. This paper provides a finite-time analysis of Neural-Q-Whittle, where data are generated from a Markov chain, and Q-function is approximated by a ReLU neural network. Our analysis leverages a Lyapunov drift approach to capture the evolution of two coupled parameters, and the nonlinearity in value function approximation further requires us to characterize the approximation error. Combing these provide Neural-Q-Whittle with convergence rate, where is the number of iterations.

reinforcement learning, structured learning, conve↗
DOE OSTI2025

Network analysis of memristive device circuits: dynamics, stability and correlations

Abstract Networks with memristive devices are a potential basis for the next generation of computing devices. They are also an important model system for basic science, from modeling nanoscale conductivity to providing insight into the information-processing of neurons. The resistance in a memristive device depends on the history of the applied bias and thus displays a type of memory. The interplay of this memory with the dynamic properties of the network can give rise to new behavior, offering many fascinating theoretical challenges. But methods to analyze general memristive circuits are not well described in the literature. In this paper we develop a general circuit analysis for networks that combine memristive devices alongside resistors, capacitors and inductors and under various types of control. We derive equations of motion for the memory parameters of these circuits and describe the conditions for which a network should display properties characteristic of a resonator system. For the case of a purely memresistive network, we derive Lyapunov functions, which can be used to study the stability of the network dynamics. Surprisingly, analysis of the Lyapunov functions show that these circuits do not always have a stable equilibrium in the case of nonlinear resistance and window functions. The Lyapunov function allows us to study circuit invariances, wherein different circuits give rise to similar equations of motion, which manifest through a gauge freedom and node permutations. Finally, we identify the relation between the graph Laplacian and the operators governing the dynamics of memristor networks operators, and we use these tools to study the correlations between distant memristive devices through the effective resistance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Space-Split Algorithm for Sensitivity Analysis of Discrete Chaotic Systems With Multidimensional Unstable Manifolds

Accurate approximations of the change of a system's output and its statistics with respect to the input are highly desired in computational dynamics. Ruelle's linear response theory provides breakthrough mathematical machinery for computing the linear response of chaotic dynamical systems. In this paper, we propose an algorithm for sensitivity analysis of discrete chaos with an arbitrary number of positive Lyapunov exponents. We combine the concept of perturbation space-splitting, which regularizes Ruelle's original expression, together with measure-based parameterization of the expanding subspace. We use these tools to rigorously derive trajectory-following recursive relations that converge exponentially fast, and construct a memory-efficient Monte Carlo scheme for derivatives of the output statistics. Thanks to the regularization and lack of simplifying assumptions on the system's behavior, our method is immune to the common problems of other popular methods such as the exploding tangent solutions and unphysical shadowing directions. Here, we provide a ready-to-use algorithm, analyze its complexity, and demonstrate several numerical examples of sensitivity computation using physically-inspired low-dimensional systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Safe Physics-Informed Machine Learning for Dynamics and Control

This tutorial paper focuses on safe physics-informed machine learning in the context of dynamics and control, providing a comprehensive overview of how to integrate physical models and safety guarantees. As machine learning techniques enhance the modeling and control of complex dynamical systems, ensuring safety and stability remains a critical challenge, especially in safety-critical applications like autonomous vehicles, robotics, medical decision-making, and energy systems. We explore various approaches for embedding and ensuring safety constraints, including structural priors, Lyapunov and Control Barrier Functions, predictive control, projections, and robust optimization techniques. Additionally, we delve into methods for uncertainty quantification and safety verification, including reachability analysis and neural network verification tools, which help validate that control policies remain within safe operating bounds even in uncertain environments. The paper includes illustrative examples demonstrating the implementation aspects of safe learning frameworks that combine the strengths of data-driven approaches with the rigor of physical principles, offering a path toward the safe control of complex dynamical systems.

Drgona, Jan↗
DOE OSTI2022

Sensitivity of time-dependent density functional theory to initial conditions

Time-dependent density-functional theory is mathematically formulated through nonlinear coupled time-dependent three-dimensional partial differential equations, and it is natural to expect a strong sensitivity of its solutions to variations of the initial conditions, akin to the butterfly effect ubiquitous in classical dynamics. Since the Schrödinger equation for an interacting many-body system is, however, linear and mathematically the exact equations of the density-functional theory reproduce the corresponding one-body properties, it would follow that the Lyapunov exponents are also vanishing within a density-functional theory framework. Whether for realistic implementations of the time-dependent density-functional theory the question of the absence of the butterfly effect and whether the dynamics provided is indeed a predictable theory was never discussed. At the same time, since the time-dependent density-functional theory is a unique tool allowing us to study the nonequilibrium dynamics of strongly interacting many-fermion systems, the question of predictability of this theoretical framework is of paramount importance. Here our analysis, for a number of quantum superfluid many-body systems (unitary Fermi gas, nuclear fission, and heavy-ion collisions) with a classical equivalent number of degrees of freedom O(10 10 ) and larger, suggests that its maximum Lyapunov exponents are negligible for all practical purposes.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

MFANS 2024 - Formally Proving Characteristics of Cyber-Physical Systems

Cyber-physical systems (CPS) are engineered systems that rely on the smooth integration of computational algorithms and physical elements. This integration presents new challenges for verifying that systems will behave as expected. The goal of this presentation is to present current challenges and potential solutions for the formal verification of cyber-physical systems. For cyber systems, formal methods refer to systematically rigorous mathematical techniques employed in the specification, development, analysis, and verification of both software and hardware systems. Recent advancements in computer science have yielded sophisticated tools specifically designed to address challenges associated with formal methods in complex systems. These tools leverage various foundational concepts such as logic, formal languages, program semantics, type systems, type theory, and automata theory. A notable achievement in the application of formal methods is the seL4 microkernel, claimed to be the first general-purpose operating-system kernel to be verified. Its proof implies the absence of bugs and guarantees that the kernel meets specifications. For physical systems, dynamic and control theory has a history of using rigorous analytic techniques to prove functional correctness. Lyapunov, optimal, classical, modern, and robust control theories all provide rigorous mathematical methods both to analyze system performance and to design controller that can be guaranteed to meet certain objectives. Recent computational techniques like level set theory and reachability analysis provide assertions that a system's state will avoid unsafe regions. Even though success has been independently achieved for cyber systems and physical systems, the integration of such systems creates new challenges. In particular, there is an obvious discrepancy between finite-state machines and infinite-state systems, resulting in different approaches for modeling and analyzing these system. While it is possible to simulate hybrid systems, this provides only a demonstration of a performance and not proof. For hybrid systems, current formal methods and system analysis approaches typically require a workarounds to work on hybrid systems like CPS. This paper will outline the state of the art and limits of current practice for formally verifying CPS and will identify possible research directions that require attention.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Virtual Cable Impedance based Load Sharing in a Microgrid for Parallel Connected Grid Forming Converters

This paper presents a novel approach to power sharing between direct connected grid-forming converters, utilizing virtual cable impedance and droop-based outer loop control. To enhance stability, resistive droop is implemented, while virtual cable impedance with non-zero resistive and inductive components ensures improved power sharing. The inner loop controller employs a Lyapunov energy function to achieve superior dynamic performance. The proposed control architecture is validated through comprehensive modeling and real-time processor-in-the-loop simulations, demonstrating its robustness and efficiency under various operating conditions. The results highlight the potential of this control strategy to improve the reliability and efficiency of renewable energy systems. Additionally, a comparative analysis with traditional methods underscores the advantages of the proposed approach in terms of stability and performance. The proposed control architecture offers a scalable and flexible solution for grid-forming converters, enabling seamless integration of renewable energy sources. Its robustness and adaptability make it an attractive solution for real-world applications. Furthermore, the approach can be extended to other power electronic systems, enhancing overall system performance and efficiency. By providing a reliable and efficient control strategy, this paper contributes to the advancement of renewable energy systems and their adoption in the energy sector. The proposed control strategy has far-reaching implications for the widespread adoption of renewable energy sources, enabling a more sustainable and efficient energy future. The overall system is modeled in MATLAB/Simulink and PLECS software domain.

grid forming converters (GFM)↗
DOE OSTI2023

Machine Learning-Based Model Predictive Control of Two-Time-Scale Systems

In this study, we present a general form of nonlinear two-time-scale systems, where singular perturbation analysis is used to separate the dynamics of the slow and fast subsystems. Machine learning techniques are utilized to approximate the dynamics of both subsystems. Specifically, a recurrent neural network (RNN) and a feedforward neural network (FNN) are used to predict the slow and fast state vectors, respectively. Moreover, we investigate the generalization error bounds for these machine learning models approximating the dynamics of two-time-scale systems. Next, under the assumption that the fast states are asymptotically stable, our focus shifts toward designing a Lyapunov-based model predictive control (LMPC) scheme that exclusively employs the RNN to predict the dynamics of the slow states. Additionally, we derive sufficient conditions to guarantee the closed-loop stability of the system under the sample-and-hold implementation of the controller. A nonlinear chemical process example is used to demonstrate the theory. In particular, two RNN models are constructed: one to model the full two-time-scale system and the other to predict solely the slow state vector. Both models are integrated within the LMPC scheme, and we compare their closed-loop performance while assessing the computational time required to execute the LMPC optimization problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Emergence of many-body quantum chaos via spontaneous breaking of unitarity

It is suggested that many-body quantum chaos appears as the spontaneous symmetry breaking of unitarity in interacting quantum many-body systems. It has been shown that many-body level statistics, probed by the spectral form factor (SFF) defined as K(η,t)=$\langle$|Tr exp(-ηH+itH)| 2 $\rangle$, is dominated by a diffuson-type mode in a field theory analysis. The key finding of this Letter is that the “unitary” η = 0 case is different from the η → 0 ± limit, with the latter leading to a finite mass of these modes due to interactions. This mass suppresses a rapid exponential ramp in the SFF, which is responsible for the fast emergence of Poisson statistics in the noninteracting case, and gives rise to a nontrivial random matrix structure of many-body levels. The interaction-induced mass in the SFF shares similarities with the dephasing rate in the theory of weak localization and the Lyapunov exponent of the out-of-time-ordered correlators.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Semiglobal Safety-Filtered Extremum Seeking With Unknown CBFs

We introduce a safe extremum-seeking (Safe ES) algorithm which achieves the minimization of an unknown objective function while ensuring that an unknown, yet measured, control barrier function (CBF) remains above an arbitrarily small negative value for all time. In other words, “practical safety” is maintained during the entire period of convergence to the constrained extremum. Our design is based on quadratic program (QP) CBF style filters for safety, which is applied in an average and estimated sense. Using nonsmooth analysis tools, we guarantee semiglobal practical asymptotic (SPA) stability of the global constrained optimum, practical convergence to the safe set if starting in a condition violating the CBF, and practical safety for all time—semiglobally—if starting in safe set. The safety result of the paper is analogous with modern notions of SPA stability, guaranteeing that, for any small violation of safety, there exist design coefficients which guarantee that such a small violation is not exceeded. The paper outlines a set of sufficient conditions on the barrier and objective functions, and by way of a Lyapunov argument, we demonstrate that nonconvex constrained optimization problems can be solved. We present these results in the setting of a static map and a dynamical system. A simulation example illustrates the results.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Sparsity-Independent Lyapunov Exponent in the Sachdev-Ye-Kitaev Model

The saturation of a recently proposed universal bound on the Lyapunov exponent has been conjectured to signal the existence of a gravity dual. This saturation occurs in the low-temperature limit of the dense Sachdev-Ye-Kitaev (SYK) model, N Majorana fermions with q body ( q > 2 ) infinite-range interactions. We calculate certain out-of-time-order correlators (OTOCs) for N ≤ 64 fermions for a highly sparse SYK model and find no significant dependence of the Lyapunov exponent on sparsity up to near the percolation limit where the Hamiltonian breaks up into blocks. This provides strong support to the saturation of the Lyapunov exponent in the low-temperature limit of the sparse SYK. A key ingredient to reaching N = 64 is the development of a novel quantum spin model simulation library that implements highly optimized matrix-free Krylov subspace methods on graphical processing units. This leads to a significantly lower simulation time as well as vastly reduced memory usage over previous approaches, while using modest computational resources. Strong sparsity-driven statistical fluctuations require both the use of a much larger number of disorder realizations with respect to the dense limit and a careful finite size scaling analysis. The saturation of the bound in the sparse SYK points to the existence of a gravity analog that would enlarge substantially the number of field theories with this feature. Published by the American Physical Society 2024

Physics↗
DOE OSTI2026

Omega-Limit Sets and Input-To-State Stability in Power Grids with Switching Equilibria

This paper studies a power transmission system with both conventional generators (CGs) and distributed energy assets (DEAs) providing frequency control. We consider an operating condition with demand aggregating two dynamic components: one that switches between different values on a finite set, and one that varies smoothly over time. Such dynamic operating conditions may result from protection scheme activations, external cyber-attacks, or due to the integration of dynamic loads, such as data centers. Mathematically, the dynamics of the resulting system are captured by a system that switches between a finite number of vector fields - or modes -, with each mode having a distinct equilibrium point induced by the demand aggregation. To analyze the stability properties of the resulting switching system, we leverage tools from hybrid dynamic inclusions and the concept of ..omega.. -limit sets from sets. Specifically, we characterize a compact set that is semi-globally practically asymptotically stable under the assumption that the switching frequency and load variation rate are sufficiently slow. For arbitrarily fast variations of the load, we use a level-set argument with multiple Lyapunov functions to establish input-to-state stability of a larger set and with respect to the rate of change of the loads. The theoretical results are illustrated via numerical simulations on the IEEE 39-bus test system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

On the Stability of Power Transmission Systems Under Persistent Inverter Attacks: A Bi-Linear Matrix Approach

We investigate the stability and robustness properties of a power transmission system under persistent deceiving attacks on inverter-interfaced energy resources. The attacks can corrupt the damping coefficients in the inverters' controllers and measurements of the frequency at the points of coupling. Leveraging tools from hybrid dynamical systems theory, we characterize a broad family of persistent (and not necessarily periodic) attacks acting on the inverters, under which the stability properties of the transmission system can be shown to not be compromised. To address potentially conservative conditions identified through conventional bounding techniques, sufficient conditions on the average activation time of the attacks are identified via Lyapunov theory, as well as the formulation and solution of a class of bilinear matrix inequalities (BMI). The results are obtained for constant and slowly time-varying loads via input-to-state stability (ISS) tools. Numerical simulations on the IEEE 39-bus test system are also presented.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

A Stable and Ultrafast Control for Multiparallel Grid-Tied SiC Inverters With LVRT Capability Considering Cable Impedance

The stability of multiparalleled grid-tied inverters remains a challenging issue especially during low-voltage ride-through (LVRT) in the presence of grid impedance. SiC device-based grid-tied inverters can achieve advantages such as higher efficiency, reduced size of interface filters, and fast dynamics; however, they can exacerbate this stability issue particularly when LVRT occurs along with high inrush current due to their low inertia characteristics. In this article, a direct deadbeat control method without any PI control loop is proposed for multiparallel grid-tied SiC inverters. The proposed control achieves instantaneous current regulations within switching cycles. In addition, it mitigates high inrush currents and maintains stability during LVRT transients without requiring mode transitions between normal and LVRT operation modes, thereby achieving an ultrafast response and seamless operation through this unified control method. The Lyapunov method is applied to analyze the multiparallel inverter stability in the presence of grid impedance with proposed deadbeat control method. The inverter V-I trajectories during LVRT transients are derived to illustrate the ultrafast and stable feature of proposed control. Finally, the experimental results of two grid-tied SiC inverters operating at LVRT transients are provided to verify the advantages of the proposed control method.

14 SOLAR ENERGY↗