Hamiltonian: Information from Answers.com

The Hamiltonian of optimal control theory was developed by L. S. Pontryagin as part of his minimum principle. It was inspired by, but is distinct from, the Hamiltonian of classical mechanics. Pontryagin proved that a necessary condition for solving the optimal control problem is that the control should be chosen so as to minimize the Hamiltonian. For details see Pontryagin's minimum principle.

1 Definition of the Hamiltonian
2 Notation and Problem statement
3 The Hamiltonian in discrete time
4 The Hamiltonian of control compared to the Hamiltonian of mechanics
5 References

Definition of the Hamiltonian

$H(x,\lambda,u,t)=\lambda^T(t)f(x,u,t)+L(x,u,t) \,$

where $λ(t)$ is a vector of costate variables of the same dimension as the state variables $x (t)$ .

Notation and Problem statement

A control $u (t)$ is to be chosen so as to minimize the objective function:

$J(u)=\Psi(x(T))+\int^T_0 L(x,u,t) dt$

The system state $x (t)$ evolves according to the state equations

$\dot{x}=f(x,u,t) \qquad x(0)=x_0 \quad t \in [0,T]$

the control must satisfy the constraints

$a \le u(t) \le b \quad t \in [0,T]$

The Hamiltonian in discrete time

When the problem is formulated in discrete time, the Hamiltonian is defined as:

$H(x,\lambda,u,t)=\lambda^T(t+1)f(x,u,t)+L(x,u,t) \,$

and the costate equations are

$\lambda(t)=-\frac{\partial H}{\partial x}$

(Note that the discrete time Hamiltonian at time $t$ involves the costate variable at time $t + 1.$ ^[1] This small detail is essential so that when we differentiate with respect to $x$ we get a term involving $λ(t + 1)$ on the right hand side of the costate equations. Using a wrong convention here can lead to incorrect results, i.e. a costate equation which is not a backwards difference equation).

The Hamiltonian of control compared to the Hamiltonian of mechanics

William Rowan Hamilton defined the Hamiltonian as a function of three variables:

$\mathcal{H} = \mathcal{H}(p,q,t) = \langle p,\dot{q} \rangle -L(q,\dot{q},t)$

where $\dot{q}$ is defined implicitly by

$p = \frac{\partial L}{\partial \dot{q}}$

Hamilton then formulated his equations as

$\frac{ d}{ dt}p(t) = -\frac{\partial}{\partial q}\mathcal{H}$

$\frac{ d}{ dt}q(t) =~~\frac{\partial}{\partial p}\mathcal{H}$

In contrast the Hamiltonian of control theory (as defined by Pontryagin) is a function of 4 variables

$H(q,u,p,t)= \langle p,u \rangle -L(q,u,t)$

and the associated conditions for a maximum are

$\frac{dp}{dt} = -\frac{\partial H}{\partial q}$

$\frac{dq}{dt} = ~~\frac{\partial H}{\partial p}$

$\frac{\partial H}{\partial u} = 0$

This difference is somewhat confusing, nevertheless a specific problem, such as the Brachystochrone problem, can be solved by either method. For details, see the article by Sussmann and Willems ^[2].

References

P. Varaiya: Lecture Notes on Optimization, 2d. ed. (1998) [1]

^ Varaiya, Chapter 6
^ Sussmann, Willems: 300 Year of Optimal Control, IEEE Control Systems, June 1997

This entry is from Wikipedia, the leading user-contributed encyclopedia. It may not have been reviewed by professional editors (see full disclaimer)

Donate to Wikimedia

	Hamiltonian graph (mathematics)
	energy operator (quantum mechanics)
	Wigner's theorem (quantum mechanics)

	W HAT IS Hamiltonian? Read answer...
	What is a hamiltonian path in a graph? Read answer...
	Did Thomas Jefferson become a Hamiltonian? Read answer...

	Who were the hamiltonian federalists?
	What is Hamiltonian function?
	What is a Hamiltonian Circuit?

Hamiltonian

Contents

Definition of the Hamiltonian

Notation and Problem statement

The Hamiltonian in discrete time

The Hamiltonian of control compared to the Hamiltonian of mechanics

References