Operator norm

Operator norm

In mathematics, the operator norm is a means to measure the "size" of certain linear operators. Formally, it is a norm defined on the space of bounded linear operators between two given normed vector spaces.


Introduction and definition

Given two normed vector spaces V and W (over the same base field, either the real numbers R or the complex numbers C), a linear map A : VW is continuous if and only if there exists a real number c such that

\|Av\| \le c \|v\| \quad \mbox{ for all } v\in V

(the norm on the left is the one in W, the norm on the right is the one in V). Intuitively, the continuous operator A never "lengthens" any vector more than by a factor of c. Thus the image of a bounded set under a continuous operator is also bounded. Because of this property, the continuous linear operators are also known as bounded operators. In order to "measure the size" of A, it then seems natural to take the smallest number c such that the above inequality holds for all v in V. In other words, we measure the "size" of A by how much it "lengthens" vectors in the "biggest" case. So we define the operator norm of A as

\|A\|_{op} = \min\{c\ge 0 : \|Av\| \le c \|v\| \mbox{ for all } v\in V\}

(the minimum exists as the set of all such c is closed, nonempty, and bounded from below).


Every real m-by-n matrix yields a linear map from Rn to Rm. One can put several different norms on these spaces, as explained in the article on norms. Each such choice of norms gives rise to an operator norm and therefore yields a norm on the space of all m-by-n matrices. Examples can be found in the article on matrix norms.

If we specifically choose the Euclidean norm on both Rn and Rm, then we obtain the matrix norm which to a given matrix A assigns the square root of the largest eigenvalue of the matrix A*A (where A* denotes the conjugate transpose of A). This is equivalent to assigning the largest singular value of A.

Passing to a typical infinite dimensional example, consider the sequence space l2 defined by

l^2 = \{ (a_n)_{n \geq 1}: \; a_n \in \mathbb{C}, \; \sum_n |a_n|^2 < \infty \}.

This can be viewed as an infinite dimensional analogue of the Euclidean space Cn. Now take a bounded sequence s = (sn ). The sequence s is an element of the space l , with a norm given by

\| s \|_{\infty} = \sup _n |s_n| .

Define an operator Ts by simply multiplication:

(a_n) \stackrel{T_s}{\longrightarrow} (s_n \cdot a_n) .

The operator T s is bounded with operator norm

\| T_s\|_{op} = \| s \|_{\infty}.

One can extend this discussion directly to the case where l 2 is replaced by a general Lp space with p > 1 and l replaced by L.

Equivalent definitions

One can show that the following definitions are all equivalent:

\|A\|_{op} &= \inf\{c : \|Av\| \le c\|v\| \mbox{ for all } v\in V\} \\
&= \sup\{\|Av\| : v\in V \mbox{ with }\|v\| \le 1\} \\
&= \sup\{\|Av\| : v\in V \mbox{ with }\|v\| = 1\} \\
&= \sup\left\{\frac{\|Av\|}{\|v\|} : v\in V \mbox{ with }v\ne 0\right\}.


The operator norm is indeed a norm on the space of all bounded operators between V and W. This means

\|A\|_{op} \ge 0 \mbox{ and } \|A\|_{op} = 0 \mbox{ if and only if } A = 0 ,
\|aA\|_{op} = |a| \|A\|_{op} \quad\mbox{ for every scalar } a ,
\|A + B\|_{op} \le \|A\|_{op} + \|B\|_{op} .

The following inequality is an immediate consequence of the definition:

\|Av\| \le \|A\|_{op} \|v\| \quad\mbox{ for every } v\in V .

The operator norm is also compatible with the composition, or multiplication, of operators: if V, W and X are three normed spaces over the same base field, and A : VW and B: WX are two bounded operators, then

\|BA\|_{op} \le \|B\|_{op} \|A\|_{op} .

For bounded operators on V, this implies that operator multiplication is jointly continuous.

It follows from the definition that a sequence of operators converge in operator norm means they converge uniformly on bounded sets.

Operators on a Hilbert space

Suppose H is a real or complex Hilbert space. If A : HH is a bounded linear operator, then we have

\|A\|_{op} = \|A^*\|_{op}


\|A^*A\|_{op} = \|A\|_{op}^2

where A* denotes the adjoint operator of A (which in Euclidean Hilbert spaces with the standard inner product corresponds to the conjugate transpose of the matrix A).

In general, the spectral radius of A is bounded above by the operator norm of A:

\rho(A) \le \|A\|_{op}.

To see why equality may not always hold, consider the Jordan canonical form of a matrix in the finite dimensional case. Because there are non-zero entries on the superdiagonal, equality may be violated. The quasinilpotent operators is one class of such examples. A nonzero quasinilpotent operator A has spectrum {0}. So ρ(A) = 0 while ||A||op > 0.

However, when a matrix N is normal, its Jordan canonical form is diagonal (up to unitary equivalence); this is the spectral theorem. In that case it is easy to see that

\rho(N) = \|N\|_{op}.

The spectral theorem can be extended to normal operators in general. Therefore the above equality holds for any bounded normal operator N. This formula can sometimes be used to compute the operator norm of a given bounded operator A: define the Hermitian operator H = A*A, determine its spectral radius, and take the square root to obtain the operator norm of A.

The space of bounded operators on H, with the topology induced by operator norm, is not separable. For example, consider the Hilbert space L2[0,1]. For 0 < t ≤ 1, let Ωt be the characteristic function of [0,t], and Pt be the multiplication operator given by Ωt , i.e.

P_t (f) = f \cdot \Omega_t .

Then each Pt is a bounded operator with operator norm 1 and

\| P_t - P_s \|_{op} = 1, \quad \mbox{for all} \quad t \neq s .

But {Pt} is an uncountable set. This implies the space of bounded operators on L2[0,1] is not separable, in operator norm. One can compare this with the fact that the sequence space l is not separable.

The set of all bounded operators on a Hilbert space, together with the operator norm and the adjoint operation, yields a C*-algebra.

See also


  • Conway, John B. (1990), A course in functional analysis, New York: Springer-Verlag, p. 67, ISBN 0387972455 

Wikimedia Foundation. 2010.

Look at other dictionaries:

  • Operator topology — In the mathematical field of functional analysis there are several standard topologies which are given to the algebra B(H) of bounded linear operators on a Hilbert space H. Contents 1 Introduction 2 List of topologies on B(H) 3 …   Wikipedia

  • Operator (mathematics) — This article is about operators in mathematics. For other uses, see Operator (disambiguation). In basic mathematics, an operator is a symbol or function representing a mathematical operation. In terms of vector spaces, an operator is a mapping… …   Wikipedia

  • Operator algebra — In functional analysis, an operator algebra is an algebra of continuous linear operators on a topological vector space with the multiplication given by the composition of mappings. Although it is usually classified as a branch of functional… …   Wikipedia

  • Norm Nelson — Nationality American Born January 30, 1923(1923 01 30) Died November 8, 1988 Retired 1976 USA …   Wikipedia

  • Norm "Hoot" Hooten — is a former Delta operator who served in Somalia in 1993. In the 2001 film Black Hawk Down , he was portrayed by Eric Bana as Norm Hoot Gibson. He was a member of the Delta squadron that was deployed to Somalia as part of Task Force Ranger in… …   Wikipedia

  • Operator (physics) — In physics, an operator is a function acting on the space of physical states. As a result of its application on a physical state, another physical state is obtained, very often along with some extra relevant information. The simplest example of… …   Wikipedia

  • Bounded operator — In functional analysis, a branch of mathematics, a bounded linear operator is a linear transformation L between normed vector spaces X and Y for which the ratio of the norm of L(v) to that of v is bounded by the same number, over all non zero… …   Wikipedia

  • Compact operator — In functional analysis, a branch of mathematics, a compact operator is a linear operator L from a Banach space X to another Banach space Y, such that the image under L of any bounded subset of X is a relatively compact subset of Y. Such an… …   Wikipedia

  • Matrix norm — In mathematics, a matrix norm is a natural extension of the notion of a vector norm to matrices. Contents 1 Definition 2 Induced norm 3 Entrywise norms 3.1 Frobenius norm …   Wikipedia

  • Nuclear operator — In mathematics, a nuclear operator is roughly a compact operator for which a trace may be defined, such that the trace is finite and independent of the choice of basis (at least on well behaved spaces; there are some spaces on which nuclear… …   Wikipedia