Matrix exponential: Information from Answers.com

In mathematics, the matrix exponential is a matrix function on square matrices analogous to the ordinary exponential function. Abstractly, the matrix exponential gives the connection between a matrix Lie algebra and the corresponding Lie group.

Let X be an n×n real or complex matrix. The exponential of X, denoted by e^X or exp(X), is the n×n matrix given by the power series

$e^X = \sum_{k=0}^\infty{1 \over k!}X^k.$

The above series always converges, so the exponential of X is well-defined. Note that if X is a 1×1 matrix the matrix exponential of X is a 1×1 matrix consisting of the ordinary exponential of the single element of X.

1 Properties
2 Computing the matrix exponential
3 Calculations
4 Applications
- 4.1 Linear differential equations
5 See also
6 References
7 External links

Properties

Let X and Y be n×n complex matrices and let a and b be arbitrary complex numbers. We denote the n×n identity matrix by I and the zero matrix by 0. The matrix exponential satisfies the following properties:

e⁰ = I.
e^aXe^bX = e⁽^{a + b)X}.
e^Xe^−X = I.
If XY = YX then e^Xe^Y = e^Ye^X = e^(X + Y).
If Y is invertible then e^YXY⁻¹ = Ye^XY⁻¹.
exp(X^T) = (exp X)^T, where X^T denotes the transpose of X. It follows that if X is symmetric then e^X is also symmetric, and that if X is skew-symmetric then e^X is orthogonal.
exp(X*) = (exp X)*, where X* denotes the conjugate transpose of X. It follows that if X is Hermitian then e^X is also Hermitian, and that if X is skew-Hermitian then e^X is unitary.

Linear differential equations

One of the reasons for the importance of the matrix exponential is that it can be used to solve systems of linear ordinary differential equations. It follows that

$\frac{d}{dt} y(t) = Ay(t), \quad y(0) = y_0,$

where A is a constant matrix, is given by

$y(t) = e^{At} y_0. \,$

The matrix exponential can also be used to solve the inhomogeneous equation

$\frac{d}{dt} y(t) = Ay(t) + z(t), \quad y(0) = y_0.$

See the section on applications below for examples.

There is no closed-form solution for differential equations of the form

$\frac{d}{dt} y(t) = A(t) \, y(t), \quad y(0) = y_0,$

where A is not constant, but the Magnus series gives the solution as an infinite sum.

The exponential of sums

We know that the exponential function satisfies e^{x + y} = e^xe^y for any real numbers (scalars) x and y. The same goes for commuting matrices: If the matrices X and Y commute (meaning that XY = YX), then

$e^{X+Y} = e^Xe^Y. \,$

However, if they do not commute, then the above equality does not necessarily hold. In which case, we can use the Baker–Campbell–Hausdorff formula to compute e^X + Y.

The converse is false: the equation e^X + Y = e^Xe^Y does not necessarily imply that X and Y commute. However, the converse is true if X and Y contain only algebraic numbers and their size is at least 2×2 (Horn & Johnson 1991, pp. 435–437).

The exponential map

Note that the exponential of a matrix is always an invertible matrix. The inverse matrix of e^X is given by e^−X. This is analogous to the fact that the exponential of a complex number is always nonzero. The matrix exponential then gives us a map

$\exp \colon M_n(\mathbb C) \to \mbox{GL}(n,\mathbb C)$

from the space of all n×n matrices to the general linear group of degree n, i.e. the group of all n×n invertible matrices. In fact, this map is surjective which means that every invertible matrix can be written as the exponential of some other matrix (for this, it is essential to consider the field C of complex numbers and not R).

For any two matrices X and Y, we have

$\| e^{X+Y} - e^X \| \le \|Y\| e^{\|X\|} e^{\|Y\|},$

where || · || denotes an arbitrary matrix norm. It follows that the exponential map is continuous and Lipschitz continuous on compact subsets of M_n(C).

The map

$t \mapsto e^{tX}, \qquad t \in \mathbb R$

defines a smooth curve in the general linear group which passes through the identity element at t = 0. In fact, this gives a one-parameter subgroup of the general linear group since

$e^{tX}e^{sX} = e^{(t+s)X}.\,$

The derivative of this curve (or tangent vector) at a point t is given by

$\frac{d}{dt}e^{tX} = Xe^{tX}. \qquad (1)$

The derivative at t = 0 is just the matrix X, which is to say that X generates this one-parameter subgroup.

More generally,

$\frac{d}{dt}e^{X(t)} = \int_0^1 e^{(1-\alpha) X(t)} \frac{dX(t)}{dt} e^{\alpha X(t)}\,d\alpha.$

Computing the matrix exponential

Finding reliable and accurate methods to compute the matrix exponential is difficult, and this is still a topic of considerable current research in mathematics and numerical analysis. Both Matlab and GNU Octave use Padé approximant^[1]^[2]. Several methods are listed below.

Diagonalizable case

If a matrix is diagonal:

$A=\begin{bmatrix} a_1 & 0 & \ldots & 0 \\ 0 & a_2 & \ldots & 0 \\ \vdots & \vdots & \ddots & \vdots \\ 0 & 0 & \ldots & a_n \end{bmatrix},$

then its exponential can be obtained by just exponentiating every entry on the main diagonal:

$e^A=\begin{bmatrix} e^{a_1} & 0 & \ldots & 0 \\ 0 & e^{a_2} & \ldots & 0 \\ \vdots & \vdots & \ddots & \vdots \\ 0 & 0 & \ldots & e^{a_n} \end{bmatrix}.$

This also allows one to exponentiate diagonalizable matrices. If $A = U D U - 1$ and D is diagonal, then $e A = U e D U - 1$ . Application of Sylvester's formula yields the same result.

Nilpotent case

A matrix N is nilpotent if N^q = 0 for some integer q. In this case, the matrix exponential e^N can be computed directly from the series expansion, as the series terminates after a finite number of terms:

$e^N = I + N + \frac{1}{2}N^2 + \frac{1}{6}N^3 + \cdots + \frac{1}{(q-1)!}N^{q-1}.$

Generalization

When the minimal polynomial of a matrix X can be factored into a product of first degree polynomials, it can be expressed as a sum

$X = A + N \,$

where

A is diagonalizable
N is nilpotent
A commutes with N (i.e. AN = NA)

This is the Jordan–Chevalley decomposition.

This means that we can compute the exponential of X by reducing to the previous two cases:

$e^X = e^{A+N} = e^A e^N. \,$

Note that we need the commutativity of A and N for the last step to work.

Another (closely related) method if the field is algebraically closed is to work with the Jordan form of X. Suppose that X = PJP⁻¹ where J is the Jordan form of X. Then

$e^{X}=Pe^{J}P^{-1}.\,$

Also, since

$J=J_{a_1}(\lambda_1)\oplus J_{a_2}(\lambda_2)\oplus\cdots\oplus J_{a_n}(\lambda_n),$

$\begin{align} e^{J} & {} = \exp \big( J_{a_1}(\lambda_1)\oplus J_{a_2}(\lambda_2)\oplus\cdots\oplus J_{a_n}(\lambda_n) \big) \\ & {} = \exp \big( J_{a_1}(\lambda_1) \big) \oplus \exp \big( J_{a_2}(\lambda_2) \big) \oplus\cdots\oplus \exp \big( J_{a_k}(\lambda_k) \big). \end{align}$

Therefore, we need only know how to compute the matrix exponential of a Jordan block. But each Jordan block is of the form

$J_{a}(\lambda) = \lambda I + N \,$

where N is a special nilpotent matrix. The matrix exponential of this block is given by

$e^{\lambda I + N} = e^{\lambda}e^N. \,$

Alternative

If P and Q_t are nonzero polynomials in one variable, such that P(A) = 0, and if the meromorphic function

$f(z)=\frac{e^{t z}-Q_t(z)}{P(z)}$

is entire, then

e t A = Q t (A)

To prove this, multiply the first of the two above equalities by P(z) and replace z by A.

Such a polynomial Q_t can be found as follows. Let a be a root of P, and Q_a,t the product of P by the principal part of the Laurent series of f at a. Then the sum S_t of the Q_a,t, where a runs over all the roots of P, can be taken as a particular Q_t. All the other Q_t will be obtained by adding a multiple of P to S_t. In particular S_t is the only Q_t whose degree is less than that of P.

Consider the case of a 2 by 2 matrix

$A:=\begin{bmatrix} a & b \\ c & d \end{bmatrix}.$

The exponential matrix $e t A$ is of the form $e^{tA}=s_0(t)\,I+s_1(t)\,A$ . (For any complex number $z$ and any $\mathbb{C}$ -algebra $B$ we denote again by $z$ the product of $z$ by the unit of $B$ .) Let $α$ and $β$ be the roots of the characteristic polynomial

$X^2-(a+d)\ X+ ad-bc.$

Then we have

$s_0(t)=\frac{\alpha\,e^{\beta t} -\beta\,e^{\alpha t}}{\alpha-\beta}\quad,\quad s_1(t)=\frac{e^{\alpha t}-e^{\beta t}}{\alpha-\beta}\quad$

if $\alpha\not=\beta$ , and

$s_0(t)=(1-\alpha\,t)\,e^{\alpha t}\quad,\quad s_1(t)=t\,e^{\alpha t}\quad$

if $α = β$ .

The polynomial $S t$ can also be given the following "interpolation" characterization. Put $e t (z): = e t z$ , $n : = deg P$ . Then $S t$ is the unique degree $< n$ polynomial which satisfies $S_t^{(k)}(a)=e_t^{(k)}(a)$ whenever $k$ is less than the multiplicity of $a$ as a root of $P$ .

We assume (as we obviously can) that $P$ is the minimal polynomial of $A$ .

We also assume that $A$ is a diagonalizable matrix. In particular, the roots of $P$ are simple, and the "interpolation" characterization tells us that $S t$ is given by the Lagrange interpolation formula.

At the other extreme, if $P = (X - a) n$ , then

$S_t=e^{at}\ \sum_{k=0}^{n-1}\ \frac{t^k}{k!}\ (X-a)^k.$

The simplest case not covered by the above observations is when $P=(X-a)^2\,(X-b)$ with $a\not=b$ , which gives

$S_t=e^{at}\ \frac{X-b}{a-b}\ \Bigg(1+\left(t+\frac{1}{b-a}\right)(X-a)\Bigg)+e^{bt}\ \frac{(X-a)^2}{(b-a)^2}\quad.$

Calculations

Suppose that we want to compute the exponential of

$B=\begin{bmatrix} 21 & 17 & 6 \\ -5 & -1 & -6 \\ 4 & 4 & 16 \end{bmatrix}.$

Its Jordan form is

$J = P^{-1}BP = \begin{bmatrix} 4 & 0 & 0 \\ 0 & 16 & 1 \\ 0 & 0 & 16 \end{bmatrix},$

where the matrix P is given by

$P=\begin{bmatrix} -\frac14 & 2 & \frac54 \\ \frac14 & -2 & -\frac14 \\ 0 & 4 & 0 \end{bmatrix}.$

Let us first calculate exp(J). We have

$J=J_1(4)\oplus J_2(16)$

The exponential of a 1×1 matrix is just the exponential of the one entry of the matrix, so exp(J₁(4)) = [e⁴]. The exponential of $J 2 (16)$ can be calculated by the formula exp(λ $I$ +N) = e^λ exp(N) mentioned above; this yields

$\exp \left( \begin{bmatrix} 16 & 1 \\ 0 & 16 \end{bmatrix} \right) = e^{16} \exp \left( \begin{bmatrix} 0 & 1 \\ 0 & 0 \end{bmatrix} \right) = e^{16} \left(\begin{bmatrix} 1 & 0 \\ 0 & 1 \end{bmatrix} + \begin{bmatrix} 0 & 1 \\ 0 & 0 \end{bmatrix} + {1 \over 2!}\begin{bmatrix} 0 & 0 \\ 0 & 0 \end{bmatrix} + \cdots \right) = \begin{bmatrix} e^{16} & e^{16} \\ 0 & e^{16} \end{bmatrix}.$

Therefore, the exponential of the original matrix B is

$\exp(B) = P \exp(J) P^{-1} = P \begin{bmatrix} e^4 & 0 & 0 \\ 0 & e^{16} & e^{16} \\ 0 & 0 & e^{16} \end{bmatrix} P^{-1} = {1\over 4} \begin{bmatrix} 13e^{16} - e^4 & 13e^{16} - 5e^4 & 2e^{16} - 2e^4 \\ -9e^{16} + e^4 & -9e^{16} + 5e^4 & -2e^{16} + 2e^4 \\ 16e^{16} & 16e^{16} & 4e^{16} \end{bmatrix}.$

Applications

Linear differential equations

The matrix exponential has applications to systems of linear differential equations. Recall from earlier in this article that a differential equation of the form

$\mathbf{y}' = C\mathbf{y}$

has solution e^Cty(0). If we consider the vector

$\mathbf{y}(t) = \begin{pmatrix} y_1(t) \\ \vdots \\y_n(t) \end{pmatrix}$

we can express a system of coupled linear differential equations as

$\mathbf{y}'(t) = A\mathbf{y}(t)+\mathbf{b}(t).$

If we make an ansatz and use an integrating factor of e^−At and multiply throughout, we obtain

$e^{-At}\mathbf{y}'-e^{-At}A\mathbf{y} = e^{-At}\mathbf{b}$

$\frac{d}{dt} (e^{-At}\mathbf{y}) = e^{-At}\mathbf{b}.$

If we can calculate e^At, then we can obtain the solution to the system.

Example (homogeneous)

Say we have the system

$\begin{matrix} x' &=& 2x&-y&+z \\ y' &=& &3y&-1z \\ z' &=& 2x&+y&+3z \end{matrix}$

We have the associated matrix

$M=\begin{bmatrix} 2 & -1 & 1 \\ 0 & 3 & -1 \\ 2 & 1 & 3 \end{bmatrix}$

In the example above, we have calculated the matrix exponential

$e^{tM}=\begin{bmatrix} 2e^t - 2te^{2t} & -2te^{2t} & 0 \\ -2e^t + 2(t+1)e^{2t} & 2(t+1)e^{2t} & 0 \\ 2te^{2t} & 2te^{2t} & 2e^t\end{bmatrix}$

so the general solution of the system is

$\begin{bmatrix}x \\y \\ z\end{bmatrix}= C_1\begin{bmatrix}2e^t - 2te^{2t} \\-2e^t + 2(t+1)e^{2t}\\2te^{2t}\end{bmatrix} +C_2\begin{bmatrix}-2te^{2t}\\2(t+1)e^{2t}\\2te^{2t}\end{bmatrix} +C_3\begin{bmatrix}0\\0\\2e^t\end{bmatrix}$

that is,

$\begin{align} x & = C_1(2e^t - 2te^{2t}) + C_2(-2te^{2t}) \\ y & = C_1(-2e^t + 2(t+1)e^{2t})+C_2(2(t+1)e^{2t}) \\ z & = (C_1+C_2)(2te^{2t})+2C_3e^t \end{align}$

Inhomogeneous case – variation of parameters

For the inhomogeneous case, we can use integrating factors (a method akin to variation of parameters). We seek a particular solution of the form y_p(t) = exp(tA) z (t) :

$\begin{align} \mathbf{y}_p'(t) & = (e^{tA})'\mathbf{z}(t)+e^{tA}\mathbf{z}'(t) \\[6pt] & = Ae^{tA}\mathbf{z}(t)+e^{tA}\mathbf{z}'(t) \\[6pt] & = A\mathbf{y}_p(t)+e^{tA}\mathbf{z}'(t). \end{align}$

For y_p to be a solution:

$\begin{align} e^{tA}\mathbf{z}'(t) & = \mathbf{b}(t) \\[6pt] \mathbf{z}'(t) & = (e^{tA})^{-1}\mathbf{b}(t) \\[6pt] \mathbf{z}(t) & = \int_0^t e^{-uA}\mathbf{b}(u)\,du+\mathbf{c}. \end{align}$

So,

$\begin{align} \mathbf{y}_p(t) & {} = e^{tA}\int_0^t e^{-uA}\mathbf{b}(u)\,du+e^{tA}\mathbf{c} \\ & {} = \int_0^t e^{(t-u)A}\mathbf{b}(u)\,du+e^{tA}\mathbf{c} \end{align}$

where c is determined by the initial conditions of the problem.

More precisely, consider the equation

$Y'-A\ Y=F(t)$

with the initial condition $Y (t 0) = Y 0$ , where

$A$ is an $n$ by $n$ complex matrix,

$F$ is a continuous function from some open interval $I$ to $\mathbb{C}^n$ ,

$t 0$ is a point of $I$ , and

$Y 0$ is a vector of $\mathbb{C}^n$ .

Left multiplying the above displayed equality by $e - t A$ , we get

$Y(t)=e^{(t-t_0)A}\ Y_0+\int_{t_0}^t e^{(t-x)A}\ F(x)\ dx.$

We claim that the solution to the equation

$P(d/dt)\ y = f(t)$

with the initial conditions $y (k) (t 0) = y k$ for $0\le k<n$ is

$y(t)=\sum_{k=0}^{n-1}\ y_k\ s_k(t-t_0)+\int_{t_0}^t s_{n-1}(t-x)\ f(x)\ dx,$

where the notation is as follows:

$P\in\mathbb{C}[X]$ is a monic polynomial of degree $n > 0$ ,

$f$ is a continuous complex valued function defined on some open interval $I$ ,

$t 0$ is a point of $I$ ,

$y k$ is a complex number, and

$s k (t)$ is the coefficient of $X k$ in the polynomial denoted by $S_t\in\mathbb{C}[X]$ in Subsection Alternative above.

To justify this claim, we transform our order n scalar equation into an order one vector equation by the usual reduction to a first order system. Our vector equation takes the form

$\frac{dY}{dt}-A\ Y=F(t),\quad Y(t_0)=Y_0,$

where A is the transpose companion matrix of P. We solve this equation as explained above, computing the matrix exponentials by the observation made in Subsection Alternative above.

In the case $n = 2$ we get the following statement. The solution to

$y''-(\alpha+\beta)\ y' +\alpha\,\beta\ y=f(t),\quad y(t_0)=y_0,\quad y'(t_0)=y_1\ .$

$y(t)=y_0\ s_0(t-t_0)+y_1\ s_1(t-t_0) +\int_{t_0}^t s_1(t-x)\,f(x)\ dx,$

where the functions $s 0$ and $s 1$ are as in Subsection Alternative above.

Example (inhomogeneous)

Say we have the system

$\begin{matrix} x' &=& 2x & - & y & + & z & + & e^{2t} \\ y' &=& & & 3y& - & z & \\ z' &=& 2x & + & y & + & 3z & + & e^{2t}. \end{matrix}$

So we then have

$M= \left[ \begin{array}{rrr} 2 & -1 & 1 \\ 0 & 3 & -1 \\ 2 & 1 & 3 \end{array} \right]$

and

$\mathbf{b}=e^{2t}\begin{bmatrix}1 \\0\\1\end{bmatrix}.$

From before, we have the general solution to the homogeneous equation, Since the sum of the homogeneous and particular solutions give the general solution to the inhomogeneous problem, now we only need to find the particular solution (via variation of parameters).

We have, above:

$\mathbf{y}_p = e^{tA}\int_0^t e^{(-u)A}\begin{bmatrix}e^{2u} \\0\\e^{2u}\end{bmatrix}\,du+e^{tA}\mathbf{c}$

$\mathbf{y}_p = e^{tA}\int_0^t \begin{bmatrix} 2e^u - 2ue^{2u} & -2ue^{2u} & 0 \\ \\ -2e^u + 2(u+1)e^{2u} & 2(u+1)e^{2u} & 0 \\ \\ 2ue^{2u} & 2ue^{2u} & 2e^u\end{bmatrix}\begin{bmatrix}e^{2u} \\0\\e^{2u}\end{bmatrix}\,du+e^{tA}\mathbf{c}$

$\mathbf{y}_p = e^{tA}\int_0^t \begin{bmatrix} e^{2u}( 2e^u - 2ue^{2u}) \\ \\ e^{2u}(-2e^u + 2(1 + u)e^{2u}) \\ \\ 2e^{3u} + 2ue^{4u}\end{bmatrix}+e^{tA}\mathbf{c}$

$\mathbf{y}_p = e^{tA}\begin{bmatrix} -{1 \over 24}e^{3t}(3e^t(4t-1)-16) \\ \\ {1 \over 24}e^{3t}(3e^t(4t+4)-16) \\ \\ {1 \over 24}e^{3t}(3e^t(4t-1)-16)\end{bmatrix}+ \begin{bmatrix} 2e^t - 2te^{2t} & -2te^{2t} & 0 \\ \\ -2e^t + 2(t+1)e^{2t} & 2(t+1)e^{2t} & 0 \\ \\ 2te^{2t} & 2te^{2t} & 2e^t\end{bmatrix}\begin{bmatrix}c_1 \\c_2 \\c_3\end{bmatrix}$

which can be further simplified to get the requisite particular solution determined through variation of parameters.

References

Horn, Roger A.; Johnson, Charles R. (1991), Topics in Matrix Analysis, Cambridge University Press, ISBN 978-0-521-46713-1 .
Moler, Cleve; Van Loan, Charles F. (2003), "Nineteen Dubious Ways to Compute the Exponential of a Matrix, Twenty-Five Years Later", SIAM Review 45 (1): 3–49, doi:10.1137/S00361445024180, ISSN 1095-7200, http://www.cs.cornell.edu/cv/researchpdf/19ways+.pdf .

External links

This entry is from Wikipedia, the leading user-contributed encyclopedia. It may not have been reviewed by professional editors (see full disclaimer)

Donate to Wikimedia

	What is an exponential growth? Read answer...
	What does exponential mean? Read answer...
	What does exponentially mean? Read answer...

	What is the echelon of a matrix-eignvalues of matrix-entries of matrix-equality of matrix-matrix of groups-identity of matrix-inverse matrix-multiplication of matrices?
	What are the following terms- echelon of matrix-eignvalues of matrix-entries of matrix-equality of matrix-matrix of groups-identity of matrix-inverse matrix-multiplication of matrices?
	What exponential form?

Matrix exponential

Contents

Properties

Linear differential equations

The exponential of sums

The exponential map

Computing the matrix exponential

Diagonalizable case

Nilpotent case

Generalization

Alternative

Calculations

Applications

Linear differential equations

Example (homogeneous)

Inhomogeneous case – variation of parameters

Example (inhomogeneous)

See also

References

External links