Trace: Definition from Answers.com

In linear algebra, the trace of an n-by-n square matrix A is defined to be the sum of the elements on the main diagonal (the diagonal from the upper left to the lower right) of A, i.e.,

$\mathrm{tr}(A) = a_{11} + a_{22} + \dots + a_{nn}=\sum_{i=1}^{n} a_{i i} \,$

where a_ij represents the entry on the ith row and jth column of A. Equivalently, the trace of a matrix is the sum of its eigenvalues, making it an invariant with respect to a change of basis. This characterization can be used to define the trace for a linear operator in general.

Note that the trace is only defined for a square matrix (i.e. n×n).

The use of the term trace arises from the German term Spur (cognate with the English spoor), which, as a function in mathematics, is often abbreviated to "Sp".

1 Examples
2 Properties
3 Trace of a linear operator
- 3.1 Eigenvalue relationships
- 3.2 Derivatives
4 Applications
5 Lie algebra
6 Inner product
7 Generalization
8 Coordinate-free definition
9 See also
10 Notes

Examples

Let T be a linear operator represented by the matrix

$\begin{bmatrix}-2&2&-3\\ -1& 1& 3\\ 2 &0 &-1\end{bmatrix}.$

Then tr(T) = −2 + 1 − 1 = −2.

The trace of the identity matrix is the dimension of the space. The trace of a projection (i.e., P² = P) is the rank of the projection. The trace of a nilpotent matrix is zero. The product of a symmetric matrix and a skew-symmetric matrix has zero trace.

More generally, if f(x) = (x − λ₁)^d₁···(x − λ_k)^d_k is the characteristic polynomial of a matrix A, then

$\mathrm{tr}(A) = d_1 \lambda_1 + \cdots + d_k \lambda_k.\!$

If A and B are positive semi-definite matrices of the same order then

$0 \leq \mathrm{tr}(AB)^n \leq \mathrm{tr}(A)^n \mathrm{tr}(B)^n.\,$

Properties

The trace is a linear map. That is,

$\mathrm{tr}(A + B) = \mathrm{tr}(A) + \mathrm{tr}(B),\!$

$\mathrm{tr}(cA) = c\cdot \mathrm{ tr}(A),\!$

for all square matrices A and B, and all scalars c.

If A is an m×n matrix and B is an n×m matrix, then

tr(A B) = tr(B A).

^[1]

Conversely, the above properties characterize the trace completely in the sense as follows. Let $f$ be a linear functional on the space of square matrices satisfying $f (x y) = f (y x)$ . Then $f$ and tr are proportional.^[2]

The trace is similarity-invariant, which means that A and P⁻¹AP have the same trace. This is because

$\operatorname{tr}(P^{-1}AP) = \operatorname{tr}((AP) P^{-1}) = \operatorname{tr}(A).$

A matrix and its transpose have the same trace:

$\operatorname{tr}(A) = \operatorname{tr}(A^T). \,$

When both A and B are n by n, the trace of the (ring-theoretic) commutator of A and B vanishes: tr([A, B]) = 0. In particular, using similarity invariance, it follows that the identity matrix is never similar to the commutator of any pair of matrices.

Conversely, any square matrix with zero trace is the commutator of some pair of matrices.^[3] Moreover, any square matrix with zero trace is unitarily equivalent to a square matrix with diagonal consisting of all zeros.

The trace of any power of a nilpotent matrix is zero. When the characteristic of the base field is zero, the converse also holds: if $\operatorname{tr}(x^k) = 0$ for all $k$ , then $x$ is nilpotent.

Note that order does matter in taking traces: in general,

$\mathrm{tr}(ABC) \neq \mathrm{tr}(ACB).$

In other words, we can only interchange the two halves of the expression, albeit repeatedly. This means that the trace is invariant under cyclic permutations, i.e.,

tr(A B C D) = tr(B C D A) = tr(C D A B) = tr(D A B C).

However, if products of three symmetric matrices are considered, any permutation is allowed. (Proof: tr(ABC) = tr(A^T B^T C^T) = tr((CBA)^T) = tr(CBA).) For more than three factors this is not true. This is known as the cyclic property.

Unlike the determinant, the trace of the product is not the product of traces. What is true is that the trace of the tensor product of two matrices is the product of their traces: $\operatorname{tr}(x \otimes y) = \operatorname{tr}(x)\operatorname{tr}(y)$ .

Trace of a linear operator

Given some linear map f : V → V (V is a finite-dimensional vector space) generally, we can define the trace of this map by considering the trace of matrix representation of f, that is, choosing a basis for V and describing f as a matrix relative to this basis, and taking the trace of this square matrix. The result will not depend on the basis chosen, since different bases will give rise to similar matrices, allowing for the possibility of a basis independent definition for the trace of a linear map.

Such a definition can be given using the canonical isomorphism between the space End(V) of linear maps on V and V⊗V^*, where V^* is the dual space of V. Let v be in V and let f be in V^*. Then the trace of the decomposable element v⊗f is defined to be f(v); the trace of a general element is defined by linearity. Using an explicit basis for V and the corresponding dual basis for V^*, one can show that this gives the same definition of the trace as given above.

Eigenvalue relationships

If A is a square n-by-n matrix with real or complex entries and if λ₁,...,λ_n are the (complex and distinct) eigenvalues of A (listed according to their algebraic multiplicities), then

$\operatorname{tr}(A) = \sum \lambda_i.$

This follows from the fact that A is always similar to its Jordan form, an upper triangular matrix having λ₁,...,λ_n on the main diagonal. In contrast, the determinant of $A$ is the product of its eigenvalues; i.e.,

$\operatorname{det}(A) = \prod \lambda_i.$

More generally,

$\operatorname{tr}(A^k) = \sum \lambda_i^k.$

Derivatives

The trace is the derivative of the determinant: it is the Lie algebra analog of the (Lie group) map of the determinant. This is made precise in Jacobi's formula for the derivative of the determinant (see under determinant). As a particular case, $\operatorname{tr}=\operatorname{det}'_I$ : the trace is the derivative of the determinant at the identity. From this (or from the connection between the trace and the eigenvalues), one can derive a connection between the trace function, the exponential map between a Lie algebra and its Lie group (or concretely, the matrix exponential function), and the determinant:

det(exp(A)) = exp(tr(A)).

For example, consider the one-parameter family of linear transformations given by rotation through angle θ,

$R_{\theta} = \left(\begin{array}{cc}\cos \theta & -\sin \theta\\\sin \theta&\cos \theta\end{array}\right).$

These transformations all have determinant 1, so they preserve area. The derivative of this family at θ = 0 is the antisymmetric matrix

$A = \left(\begin{array}{cc}0 & -1\\1&0\end{array}\right)$

which clearly has trace zero, indicating that this matrix represents an infinitesimal transformation which preserves area.

A related characterization of the trace applies to linear vector fields. Given a matrix A, define a vector field F on Rⁿ by F(x) = Ax. The components of this vector field are linear functions (given by the rows of A). The divergence div F is a constant function, whose value is equal to tr(A). By the divergence theorem, one can interpret this in terms of flows: if F(x) represents the velocity of a fluid at the location x, and U is a region in Rⁿ, the net flow of the fluid out of U is given by tr(A)· vol(U), where vol(U) is the volume of U.

The trace is a linear operator, hence its derivative is constant:

${\rm d} \,\, {\rm tr} ( {\mathbf X} ) = {\rm tr}({\rm d} {\mathbf X}).$

Applications

The trace is used to define characters of group representations. Two representations $A,B : G \rightarrow GL(V)$ of a group $G$ are equivalent (up to change of basis on $V$ ) if $\mathop{tr} A(g) = \mathop{tr} B(g)$ for all $g\in G$ .

The trace also plays a central role in the distribution of quadratic forms.

Lie algebra

A matrix whose trace is zero is said to be traceless or tracefree, and these matrices form the simple Lie algebra sl_n, which is the Lie algebra of the special linear group of matrices with determinant 1. The special linear group consists of the matrices which do not change volume, while the special linear algebra is the matrices which infinitesimally do not change volume.

The bilinear form

$B(x, y) = \operatorname{trace}(\operatorname{ad}(x)\operatorname{ad}(y))\text{ where }\operatorname{ad}(x)y = [x, y] = xy - yx$

is called the Killing form, which is used for the classification of Lie algebras.

The trace defines a bilinear form:

$(x, y) \mapsto \operatorname{tr}(xy)$

(x, y square matrices).

The form is symmetric, non-degenerate^[4] and associative in the sense that:

$\operatorname{tr}(x[y, z]) = \operatorname{tr}([x, y]z). \,$

In a simple Lie algebra (e.g., $\mathfrak {sl}_n$ ), every such bilinear form is proportional to each other; in particular, to the Killing form.

Two matrices x and y are said to be trace orthogonal if

$\operatorname{tr}(xy) = 0. \,$

Inner product

For an m-by-n matrix A with complex (or real) entries and ^* being the conjugate transpose, we have

$\operatorname{tr}(A^*A) \ge 0$

with equality if and only if A = 0. The assignment

$\langle A, B\rangle = \operatorname{tr}(A^*B)$

yields an inner product on the space of all complex (or real) m-by-n matrices.

If m = n then the norm induced by the above inner product is called the Frobenius norm of a square matrix. Indeed it is simply the Euclidean norm if the matrix is considered as a vector of length n².

Generalization

The concept of trace of a matrix is generalised to the trace class of compact operators on Hilbert spaces, and the analog of the Frobenius norm is called the Hilbert-Schmidt norm.

The partial trace is another generalization of the trace that is operator-valued.

If A is a general associative algebra over a field k, then a trace on A is often defined to be any map tr: A → k which vanishes on commutators: tr([a, b]) = 0 for all a, b in A. Such a trace is not uniquely defined; it can always at least be modified by multiplication by a nonzero scalar.

A supertrace is the generalization of a trace to the setting of superalgebras.

The operation of tensor contraction generalizes the trace to arbitrary tensors.

Coordinate-free definition

We can identify the space of linear operators on a vector space V with the space $V \otimes V^*$ , where $v \otimes h = (w \mapsto h(w)v)$ . We also have a canonical bilinear function $t:V \times V^* \rightarrow F$ that consists of applying an element of $V *$ to an element of $V$ to get an element of $F$ . This induces a linear function on the tensor product (by its universal property), which, as it turns out, when that tensor product is viewed as the space of operators, is equal to the trace.

For V finite-dimensional, with basis ${e i}$ and dual basis ${e i}$ , then $e_i \otimes e^j$ is the $i j$ entry of the matrix of the operator with respect to that basis. Any operator $A$ is therefore a sum of the form $A = a_{ij} e_i \otimes e^j$ . With $t$ defined as above, $t(A) = a_{ij} t(e_i \otimes e^j)$ . The latter, however, is just the Kronecker delta, being 1 if i=j and 0 otherwise. This shows that $t (A)$ is simply the sum of the coefficients along the diagonal. This method, however, makes coordinate invariance an immediate consequence of the definition.

Notes

^ This is immediate from the definition of matrix multiplication.

$\mathrm{tr}(AB) = \sum_{i=1}^m \sum_{j=1}^n A_{ij} B_{ji} = \mathrm{tr}(BA).$
^ Proof:

$f (e i j) = 0$ if and only if $i \not= j$ and $f (e j j) = f (e 11)$ (with the standard basis $e i j$ ),

and thus

$f(A) = \sum_{i, j} [A]_{ij} f(e_{ij}) = \sum_i [A]_{ii} f(e_{11}) = f(e_{11}) \operatorname{tr}(A)$ .
^ Proof: $\mathfrak{sl}_n$ is a semisimple Lie algebra and thus every element in it is the commutator of some pair of elements.
^ This follows from the fact that $\operatorname{tr}(A^*A) = 0$ if and only if $A = 0$

This entry is from Wikipedia, the leading user-contributed encyclopedia. It may not have been reviewed by professional editors (see full disclaimer)

Donate to Wikimedia

Trace	crimson trace
trace elliot	Crimson Trace Group Buy

	How do you you trace a parent? Read answer...
	How do you trace your registration? Read answer...
	How do you trace a vin? Read answer...

	What is a trace technician?
	What is the definition of trace?
	Can an iphone be traced?

		Sci-Tech Dictionary. McGraw-Hill Dictionary of Scientific and Technical Terms. Copyright © 2003, 1994, 1989, 1984, 1978, 1976, 1974 by McGraw-Hill Companies, Inc. All rights reserved. Read more
		Computer Desktop Encyclopedia. THIS COPYRIGHTED DEFINITION IS FOR PERSONAL USE ONLY. All other reproduction is strictly prohibited without permission from the publisher. © 1981-2009 Computer Language Company Inc. All rights reserved. Read more
		Wikipedia. This article is licensed under the Creative Commons Attribution/Share-Alike License. It uses material from the Wikipedia article "Trace (linear algebra)". Read more

Trace

Contents