Transpose

Transpose

In linear algebra, the transpose of a matrix A is another matrix AT (also written A′, Atr or At) created by any one of the following equivalent actions:

• reflect A over its main diagonal (which runs top-left to bottom-right) to obtain AT
• write the rows of A as the columns of AT
• write the columns of A as the rows of AT
• visually rotate A 90 degrees clockwise, and mirror the image in a vertical line to obtain AT

Formally, the (i,j) element of AT is the (j,i) element of A.

[AT]ij = [A]ji

If A is an m × n matrix then AT is a n × m matrix. The transpose of a scalar is the same scalar.

Examples

• $\begin{bmatrix} 1 & 2 \end{bmatrix}^{\mathrm{T}} \!\! \;\! = \, \begin{bmatrix} 1 \\ 2 \end{bmatrix}.$
• $\begin{bmatrix} 1 & 2 \\ 3 & 4 \end{bmatrix}^{\mathrm{T}} \!\! \;\! = \, \begin{bmatrix} 1 & 3 \\ 2 & 4 \end{bmatrix}.$
• $\begin{bmatrix} 1 & 2 \\ 3 & 4 \\ 5 & 6 \end{bmatrix}^{\mathrm{T}} \!\! \;\! = \, \begin{bmatrix} 1 & 3 & 5\\ 2 & 4 & 6 \end{bmatrix}. \;$

Properties

For matrices A, B and scalar c we have the following properties of transpose:

1. $\left( \mathbf{A}^\mathrm{T} \right) ^\mathrm{T} = \mathbf{A} \quad \,$
Taking the transpose is an involution (self inverse).
2. $(\mathbf{A}+\mathbf{B}) ^\mathrm{T} = \mathbf{A}^\mathrm{T} + \mathbf{B}^\mathrm{T} \,$
3. $\left( \mathbf{A B} \right) ^\mathrm{T} = \mathbf{B}^\mathrm{T} \mathbf{A}^\mathrm{T} \,$
Note that the order of the factors reverses. From this one can deduce that a square matrix A is invertible if and only if AT is invertible, and in this case we have (A−1)T = (AT)−1. It is relatively easy to extend this result to the general case of multiple matrices, where we find that (ABC...XYZ)T = ZTYTXT...CTBTAT.
4. $(c \mathbf{A})^\mathrm{T} = c \mathbf{A}^\mathrm{T} \,$
The transpose of a scalar is the same scalar. Together with (2), this states that the transpose is a linear map from the space of m × n matrices to the space of all n × m matrices.
5. $\det(\mathbf{A}^\mathrm{T}) = \det(\mathbf{A}) \,$
The determinant of a square matrix is the same as that of its transpose.
6. The dot product of two column vectors a and b can be computed as
$\mathbf{a} \cdot \mathbf{b} = \mathbf{a}^{\mathrm{T}} \mathbf{b},$
which is written as ai bi in Einstein notation.
7. If A has only real entries, then ATA is a positive-semidefinite matrix.
8. $(\mathbf{A}^\mathrm{T})^{-1} = (\mathbf{A}^{-1})^\mathrm{T} \,$
The transpose of an invertible matrix is also invertible, and its inverse is the transpose of the inverse of the original matrix. The notation $\mathbf{A}^\mathrm{-T}$ is often used to represent either of these equivalent expressions.
9. If A is a square matrix, then its eigenvalues are equal to the eigenvalues of its transpose.

Special transpose matrices

A square matrix whose transpose is equal to itself is called a symmetric matrix; that is, A is symmetric if

$\mathbf{A}^{\mathrm{T}} = \mathbf{A}.\,$

A square matrix whose transpose is also its inverse is called an orthogonal matrix; that is, G is orthogonal if

$\mathbf{G G}^\mathrm{T} = \mathbf{G}^\mathrm{T} \mathbf{G} = \mathbf{I}_n , \,$   the identity matrix, i.e. GT = G-1.

A square matrix whose transpose is equal to its negative is called skew-symmetric matrix; that is, A is skew-symmetric if

$\mathbf{A}^{\mathrm{T}} = -\mathbf{A}.\,$

The conjugate transpose of the complex matrix A, written as A*, is obtained by taking the transpose of A and the complex conjugate of each entry:

$\mathbf{A}^* = (\overline{\mathbf{A}})^{\mathrm{T}} = \overline{(\mathbf{A}^{\mathrm{T}})}.$

Transpose of linear maps

If f: VW is a linear map between vector spaces V and W with nondegenerate bilinear forms, we define the transpose of f to be the linear map tf : WV, determined by

$B_V(v,{}^tf(w))=B_W(f(v),w) \quad \forall\ v \in V, w \in W.$

Here, BV and BW are the bilinear forms on V and W respectively. The matrix of the transpose of a map is the transposed matrix only if the bases are orthonormal with respect to their bilinear forms.

Over a complex vector space, one often works with sesquilinear forms instead of bilinear (conjugate-linear in one argument). The transpose of a map between such spaces is defined similarly, and the matrix of the transpose map is given by the conjugate transpose matrix if the bases are orthonormal. In this case, the transpose is also called the Hermitian adjoint.

If V and W do not have bilinear forms, then the transpose of a linear map f: VW is only defined as a linear map tf : W*V* between the dual spaces of W and V.

This means that the transpose (and even the orthogonal group) can be defined abstractly, and completely without reference to matrices (nor the components thereof). If f: VW then for any o:WF (that is, any o belonging to W*), if Tf(o) is defined as o composed with f then it will map VF (that is, Tf will map W* to V*). If the vector spaces have metrics then V* can be uniquely mapped to V, etc, such that we can immediately consider whether or not fT : WV is equal to f - 1:WV.

As a shorthand for contraction with the metric tensor

Introductory linear algebra generally does not distinguish between the notion of a vector and a dual vector. Once that distinction is made, many common expressions seem to be freely transposing vectors to create dual vectors, in seeming disregard for the distinction. For example, this is the case in defining the inner product as

$u\cdot v:= u^\top v$.

What is going on here is that $u^\top$ is a notational shortcut for tensor contraction with the metric tensor. Using the Einstein summation convention, with regular (contravariant) vectors having upper indices, this is computing

$u\cdot v:= g_{ij} u^i v^j$

with the metric tensor for the Euclidean metric being the Kronecker delta. In other words, the notation $u^\top$ to create a dual vector is really shorthand:

$(u^\top)_j = g_{ij} u^i$.

with the assumption that gij = δij.

Implementation of matrix transposition on computers

On a computer, one can often avoid explicitly transposing a matrix in memory by simply accessing the same data in a different order. For example, software libraries for linear algebra, such as BLAS, typically provide options to specify that certain matrices are to be interpreted in transposed order to avoid the necessity of data movement.

However, there remain a number of circumstances in which it is necessary or desirable to physically reorder a matrix in memory to its transposed ordering. For example, with a matrix stored in row-major order, the rows of the matrix are contiguous in memory and the columns are discontiguous. If repeated operations need to be performed on the columns, for example in a fast Fourier transform algorithm, transposing the matrix in memory (to make the columns contiguous) may improve performance by increasing memory locality.

Ideally, one might hope to transpose a matrix with minimal additional storage. This leads to the problem of transposing an N × M matrix in-place, with O(1) additional storage or at most storage much less than MN. For N ≠ M, this involves a complicated permutation of the data elements that is non-trivial to implement in-place. Therefore efficient in-place matrix transposition has been the subject of numerous research publications in computer science, starting in the late 1950s, and several algorithms have been developed.

Wikimedia Foundation. 2010.

Synonyms:
(by putting one in place of the other, or substituting one for the other)

Look at other dictionaries:

• Transpose — Trans*pose , v. t. [imp. & p. p. {Transposed}; p. pr. & vb. n. {Transposing}.] [F. transposer; pref. trans (L. trans across) + poser to put. See {Pose}.] [1913 Webster] 1. To change the place or order of; to substitute one for the other of; to… …   The Collaborative International Dictionary of English

• transposé — transposé, ée (tran spô zé, zée) part. passé de transposer. 1°   Dont la place est intervertie. Il y a dans cette ligne des mots transposés. 2°   Terme de minéralogie. Se dit d un cristal, quand il paraît composé de deux moitiés qui auraient fait …   Dictionnaire de la Langue Française d'Émile Littré

• transposé — Transposé, [transpos]ée. part. Joüer sur un ton transposé …   Dictionnaire de l'Académie française

• transpose — index convert (change use), convey (transfer), displace (replace), move (alter position) Burton s Legal Thesaurus. William C. Burton …   Law dictionary

• transpose — late 14c., from O.Fr. transposer (14c.), from L. transponere (pp. transpositus) to place over, from trans over (see TRANS (Cf. trans )) + ponere to put, place (see POSITION (Cf. position)). Form altered in French on model of poser …   Etymology dictionary

• transpose — *reverse, invert Analogous words: *exchange, interchange: transfer, shift (see MOVE) …   New Dictionary of Synonyms

• transpose — [v] swap, switch alter, backtrack*, change, commute, convert, double back, exchange, flip flop*, interchange, inverse, invert, metamorphose, move, put, rearrange, relocate, render, reorder, reverse, revert, shift, substitute, transfer,… …   New thesaurus

• transpose — ► VERB 1) cause to exchange places. 2) transfer to a different place or context. 3) write or play (music) in a different key from the original. DERIVATIVES transposable adjective transposition noun. ORIGIN Old French transposer, from poser to …   English terms dictionary

• transpose — [trans pōz′] vt. transposed, transposing [ME transposen < MFr transposer (for L transponere): see TRANS & POSE1] 1. to transfer or shift; now, specif., to change the usual, normal, relative, or respective order or position of; interchange… …   English World dictionary

• transpose — [[t]trænspo͟ʊz[/t]] transposes, transposing, transposed 1) VERB If you transpose something from one place or situation to another, you move it there. [V n from n to n] Genetic engineers transpose or exchange bits of hereditary material from one… …   English dictionary