Search NASA⌕ Search

SEARCH · Search NASA

Results for “Stochastic processes”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Stochastic 2D Hydrodynamical Type Systems: Well Posedness and Large Deviations

We deal with a class of abstract nonlinear stochastic models, which covers many 2D hydrodynamical models including 2D Navier-Stokes equations, 2D MHD models and the 2D magnetic Benard problem and also some shell models of turbulence. We state the existence and uniqueness theorem for the class considered. Our main result is a Wentzell-Freidlin type large deviation principle for small multiplicative noise which we prove by a weak convergence method.

97 MATHEMATICS AND COMPUTING↗

Max-Plus Stochastic Control and Risk-Sensitivity

In the Maslov idempotent probability calculus, expectations of random variables are defined so as to be linear with respect to max-plus addition and scalar multiplication. This paper considers control problems in which the objective is to minimize the max-plus expectation of some max-plus additive running cost. Such problems arise naturally as limits of some types of risk sensitive stochastic control problems. The value function is a viscosity solution to a quasivariational inequality (QVI) of dynamic programming. Equivalence of this QVI to a nonlinear parabolic PDE with discontinuous Hamiltonian is used to prove a comparison theorem for viscosity sub- and super-solutions. An example from mathematical finance is given, and an application in nonlinear H-infinity control is sketched.

97 MATHEMATICS AND COMPUTING↗

A Stochastic Optimal Control Problem for the Heat Equation on the Halfline with Dirichlet Boundary-Noise and Boundary-Control

We consider a controlled state equation of parabolic type on the halfline (0,+{infinity}) with boundary conditions of Dirichlet type in which the unknown is equal to the sum of the control and of a white noise in time. We study finite horizon and infinite horizon optimal control problem related by means of backward stochastic differential equations.

97 MATHEMATICS AND COMPUTING↗

Dynamic Bertrand Oligopoly

We study continuous time Bertrand oligopolies in which a small number of firms producing similar goods compete with one another by setting prices. We first analyze a static version of this game in order to better understand the strategies played in the dynamic setting. Within the static game, we characterize the Nash equilibrium when there are N players with heterogeneous costs. In the dynamic game with uncertain market demand, firms of different sizes have different lifetime capacities which deplete over time according to the market demand for their good. We setup the nonzero-sum stochastic differential game and its associated system of HJB partial differential equations in the case of linear demand functions. We characterize certain qualitative features of the game using an asymptotic approximation in the limit of small competition. The equilibrium of the game is further studied using numerical solutions. We find that consumers benefit the most when a market is structured with many firms of the same relative size producing highly substitutable goods. However, a large degree of substitutability does not always lead to large drops in price, for example when two firms have a large difference in their size.

97 MATHEMATICS AND COMPUTING↗

Stochastic Optimal Control and Linear Programming Approach

We study a classical stochastic optimal control problem with constraints and discounted payoff in an infinite horizon setting. The main result of the present paper lies in the fact that this optimal control problem is shown to have the same value as a linear optimization problem stated on some appropriate space of probability measures. This enables one to derive a dual formulation that appears to be strongly connected to the notion of (viscosity sub) solution to a suitable Hamilton-Jacobi-Bellman equation. We also discuss relation with long-time average problems.

97 MATHEMATICS AND COMPUTING↗

Convex Hamilton-Jacobi Equations Under Superlinear Growth Conditions on Data

Unbounded stochastic control problems may lead to Hamilton-Jacobi-Bellman equations whose Hamiltonians are not always defined, especially when the diffusion term is unbounded with respect to the control. We obtain existence and uniqueness of viscosity solutions growing at most like o(1+ vertical bar x vertical bar {sup p}) at infinity for such HJB equations and more generally for degenerate parabolic equations with a superlinear convex gradient nonlinearity. If the corresponding control problem has a bounded diffusion with respect to the control, then our results apply to a larger class of solutions, namely those growing like O(1+ vertical bar x vertical bar {sup p}) at infinity. This latter case encompasses some equations related to backward stochastic differential equations.

97 MATHEMATICS AND COMPUTING↗

Necessary Conditions for Optimal Control of Stochastic Evolution Equations in Hilbert Spaces

We consider a nonlinear stochastic optimal control problem associated with a stochastic evolution equation. This equation is driven by a continuous martingale in a separable Hilbert space and an unbounded time-dependent linear operator.We derive a stochastic maximum principle for this optimal control problem. Our results are achieved by using the adjoint backward stochastic partial differential equation.

97 MATHEMATICS AND COMPUTING↗

Pathwise Solutions of the 2-D Stochastic Primitive Equations

In this work we consider a stochastic version of the Primitive Equations (PEs) of the ocean and the atmosphere and establish the existence and uniqueness of pathwise, strong solutions. The analysis employs novel techniques in contrast to previous works (Ewald et al. in Anal. Appl. (Singap.) 5(2):183-198, 2007; Glatt-Holtz and Ziane in Discrete Contin. Dyn. Syst. Ser. B 10(4):801-822, 2008) in order to handle a general class of nonlinear noise structures and to allow for physically relevant boundary conditions. The proof relies on Cauchy estimates, stopping time arguments and anisotropic estimates.

97 MATHEMATICS AND COMPUTING↗

Equilibrium in a Production Economy

Consider a closed production-consumption economy with multiple agents and multiple resources. The resources are used to produce the consumption good. The agents derive utility from holding resources as well as consuming the good produced. They aim to maximize their utility while the manager of the production facility aims to maximize profits. With the aid of a representative agent (who has a multivariable utility function) it is shown that an Arrow-Debreu equilibrium exists. In so doing we establish technical results that will be used to solve the stochastic dynamic problem (a case with infinite dimensional commodity space so the General Equilibrium Theory does not apply) elsewhere.

97 MATHEMATICS AND COMPUTING↗

Sufficient Stochastic Maximum Principle in a Regime-Switching Diffusion Model

We prove a sufficient stochastic maximum principle for the optimal control of a regime-switching diffusion model. We show the connection to dynamic programming and we apply the result to a quadratic loss minimization problem, which can be used to solve a mean-variance portfolio selection problem.

97 MATHEMATICS AND COMPUTING↗

On the Value Function of Weakly Coercive Problems in Nonlinear Stochastic Control

In this paper we investigate via a dynamic programming approach some nonlinear stochastic control problems where the control set is unbounded and a classical coercivity hypothesis is replaced by some weaker assumptions. We prove that these problems can be approximated by finite fuel problems; show the continuity of the relative value functions and characterize them as unique viscosity solutions of a quasi-variational inequality with suitable boundary conditions.

97 MATHEMATICS AND COMPUTING↗

Numerical Schemes for Rough Parabolic Equations

This paper is devoted to the study of numerical approximation schemes for a class of parabolic equations on (0,1) perturbed by a non-linear rough signal. It is the continuation of Deya (Electron. J. Probab. 16:1489-1518, 2011) and Deya et al. (Probab. Theory Relat. Fields, to appear), where the existence and uniqueness of a solution has been established. The approach combines rough paths methods with standard considerations on discretizing stochastic PDEs. The results apply to a geometric 2-rough path, which covers the case of the multidimensional fractional Brownian motion with Hurst index H>1/3.

97 MATHEMATICS AND COMPUTING↗

Subsolutions That Are Close in the Uniform Norm Are Close in the Sobolev Norm as Well

A new type weighted reverse Poincare inequality is established for a difference of two continuous weak subsolutions of a linear second order uniformly elliptic partial differential equation in the ball.This result is the key to deriving the error estimate for the gradient of the analytically unknown value function of the optimal stochastic control problem from the uniform error of the value function itself in the related numerical approximation problems.

97 MATHEMATICS AND COMPUTING↗

First and Second Order Necessary Conditions for Stochastic Optimal Control Problems

In this work we consider a stochastic optimal control problem with either convex control constraints or finitely many equality and inequality constraints over the final state. Using the variational approach, we are able to obtain first and second order expansions for the state and cost function, around a local minimum. This fact allows us to prove general first order necessary condition and, under a geometrical assumption over the constraint set, second order necessary conditions are also established. We end by giving second order optimality conditions for problems with constraints on expectations of the final state.

97 MATHEMATICS AND COMPUTING↗

Controlled Nonlinear Stochastic Delay Equations: Part I: Modeling and Approximations

This two-part paper deals with 'foundational' issues that have not been previously considered in the modeling and numerical optimization of nonlinear stochastic delay systems. There are new classes of models, such as those with nonlinear functions of several controls (such as products), each with is own delay, controlled random Poisson measure driving terms, admissions control with delayed retrials, and others. There are two basic and interconnected themes for these models. The first, dealt with in this part, concerns the definition of admissible control. The classical definition of an admissible control as a nonanticipative relaxed control is inadequate for these models and needs to be extended. This is needed for the convergence proofs of numerical approximations for optimal controls as well as to have a well-defined model. It is shown that the new classes of admissible controls do not enlarge the range of the value functions, is closed (together with the associated paths) under weak convergence, and is approximatable by ordinary controls. The second theme, dealt with in Part II, concerns transportation equation representations, and their role in the development of numerical algorithms with much reduced memory and computational requirements.

97 MATHEMATICS AND COMPUTING↗

Snell Envelope with Small Probability Criteria

We present a new algorithm to compute the Snell envelope in the specific case where the criteria to optimize is associated with a small probability or a rare event. This new approach combines the Stochastic Mesh approach of Broadie and Glasserman with a particle approximation scheme based on a specific change of measure designed to concentrate the computational effort in regions pointed out by the criteria. The theoretical analysis of this new algorithm provides non asymptotic convergence estimates. Finally, the numerical tests confirm the practical interest of this approach.

97 MATHEMATICS AND COMPUTING↗