Moment (mathematics)


Moment (mathematics)
Increasing each of the first four moments in turn while keeping the others constant, for a discrete uniform distribution with four values.

In mathematics, a moment is, loosely speaking, a quantitative measure of the shape of a set of points. The "second moment", for example, is widely used and measures the "width" (in a particular sense) of a set of points in one dimension or in higher dimensions measures the shape of a cloud of points as it could be fit by an ellipsoid. Other moments describe other aspects of a distribution such as how the distribution is skewed from its mean, or peaked. The mathematical concept is closely related to the concept of moment in physics, although moment in physics is often represented somewhat differently. Any distribution can be characterized by a number of features (such as the mean, the variance, the skewness, etc.), and the moments of a function[1] describe the nature of its distribution.

The 1st moment is denoted by μ1. The first moment of the distribution of the random variable X is the expectation operator, i.e., the population mean (if the first moment exists).

In higher orders, the central moments (moments about the mean) are more interesting than the moments about zero. The kth central moment, of a real-valued random variable probability distribution X, with the expected value μ is:

\mu_k=E\left[(X-\mu)^k\right].\,

The first central moment is thus 0. The zero-th central moment, μ0 is one. See also central moment.

Other moments may also be defined. For example, the n th inverse moment about zero is E(X n) and the n th logarithmic moment about zero is E(ln n(x)).

Contents

Significance of the moments

The nth moment of a real-valued continuous function f(x) of a real variable about a value c is

\mu'_n=\int_{-\infty}^\infty (x - c)^n\,f(x)\,dx.\,\!

It is possible to define moments for random variables in a more general fashion than moments for real values—see moments in metric spaces. The moment of a function, without further explanation, usually refers to the above expression with c = 0.

Usually, except in the special context of the problem of moments, the function f(x) will be a probability density function. The nth moment about zero of a probability density function f(x) is the expected value of Xn and is called a raw moment or crude moment.[2] The moments about its mean μ are called central moments; these describe the shape of the function, independently of translation.

If f is a probability density function, then the value of the integral above is called the nth moment of the probability distribution. More generally, if F is a cumulative probability distribution function of any probability distribution, which may not have a density function, then the nth moment of the probability distribution is given by the Riemann–Stieltjes integral

\mu'_n = \operatorname{E}(X^n)=\int_{-\infty}^\infty x^n\,dF(x)\,

where X is a random variable that has this distribution and E the expectation operator or mean.

When

\operatorname{E}(|X^n|) = \int_{-\infty}^\infty |x^n|\,dF(x) = \infty,\,

then the moment is said not to exist. If the nth moment about any point exists, so does (n − 1)th moment, and all lower-order moments, about every point.

Variance

The second central moment about the mean is the variance. Its positive square root is the standard deviation σ.

Normalized moments

The normalized nth central moment or standardized moment is the nth central moment divided by σn; the normalized nth central moment of x = E((x − μ)n)/σn. These normalized central moments are dimensionless quantities, which represent the distribution independently of any linear change of scale.

Skewness

The third central moment is a measure of the lopsidedness of the distribution; any symmetric distribution will have a third central moment, if defined, of zero. The normalized third central moment is called the skewness, often γ. A distribution that is skewed to the left (the tail of the distribution is heavier on the left) will have a negative skewness. A distribution that is skewed to the right (the tail of the distribution is heavier on the right), will have a positive skewness.

For distributions that are not too different from the normal distribution, the median will be somewhere near μ − γσ/6; the mode about μ − γσ/2.

Kurtosis

The fourth central moment is a measure of whether the distribution is tall and skinny or short and squat, compared to the normal distribution of the same variance. Since it is the expectation of a fourth power, the fourth central moment, where defined, is always non-negative; and except for a point distribution, it is always strictly positive. The fourth central moment of a normal distribution is 3σ4.

The kurtosis κ is defined to be the normalized fourth central moment minus 3. (Equivalently, as in the next section, it is the fourth cumulant divided by the square of the variance.) Some authorities[3][4] do not subtract three, but it is usually more convenient to have the normal distribution at the origin of coordinates. If a distribution has a peak at the mean and long tails, the fourth moment will be high and the kurtosis positive (leptokurtic); and conversely; thus, bounded distributions tend to have low kurtosis (platykurtic).

The kurtosis can be positive without limit, but κ must be greater than or equal to γ2 − 2; equality only holds for binary distributions. For unbounded skew distributions not too far from normal, κ tends to be somewhere in the area of γ2 and 2γ2.

The inequality can be proven by considering

\operatorname{E} ((T^2 -  aT - 1)^2)\,

where T = (X − μ)/σ. This is the expectation of a square, so it is non-negative whatever a is; on the other hand, it's also a quadratic equation in a. Its discriminant must be non-positive, which gives the required relationship.

Mixed moments

Mixed moments are moments involving multiple variables.

Some examples are covariance, coskewness and cokurtosis. While there is a unique covariance, there are multiple co-skewnesses and co-kurtoses.

Higher moments

High-order moments are moments beyond 4th-order moments. The higher the moment, the harder it is to estimate, in the sense that larger samples are required in order to obtain estimates of similar quality.[citation needed]

Cumulants

The first moment and the second and third unnormalized central moments are additive in the sense that if X and Y are independent random variables then

\mu_1(X+Y)=\mu_1(X)+\mu_1(Y)\,

and

\operatorname{Var}(X+Y)=\operatorname{Var}(X) + \operatorname{Var}(Y)

and

\mu_3(X+Y)=\mu_3(X)+\mu_3(Y).\,

(These can also hold for variables that satisfy weaker conditions than independence. The first always holds; if the second holds, the variables are called uncorrelated).

In fact, these are the first three cumulants and all cumulants share this additivity property.

Sample moments

The moments of a population can be estimated using the sample k-th moment

\frac{1}{n}\sum_{i = 1}^{n} X^k_i\,\!

applied to a sample X1,X2,..., Xn drawn from the population.

It can be shown that the expected value of the sample moment is equal to the k-th moment of the population, if that moment exists, for any sample size n. It is thus an unbiased estimator.

Problem of moments

The problem of moments seeks characterizations of sequences { μn : n = 1, 2, 3, ... } that are sequences of moments of some function f.

Partial moments

Partial moments are sometimes referred to as "one-sided moments." The nth order lower and upper partial moments with respect to a reference point r may be expressed as

\mu_n^-(r)=\int_{-\infty}^r (r - x)^n\,f(x)\,dx,
\mu_n^+(r)=\int_r^\infty (x - r)^n\,f(x)\,dx.

Partial moments are normalized by being raised to the power 1/n. The upside potential ratio may be expressed as a ratio of a first-order upper partial moment to a normalized second-order lower partial moment.

Moments in metric spaces

Let (Md) be a metric space, and let B(M) be the Borel σ-algebra on M, the σ-algebra generated by the d-open subsets of M. (For technical reasons, it is also convenient to assume that M is a separable space with respect to the metric d.) Let 1 ≤ p ≤ +∞.

The pth moment of a measure μ on the measurable space (M, B(M)) about a given point x0 in M is defined to be

\int_{M} d(x, x_{0})^{p} \, \mathrm{d} \mu (x).

μ is said to have finite pth moment if the pth moment of μ about x0 is finite for some x0 ∈ M.

This terminology for measures carries over to random variables in the usual way: if (Ω, Σ, P) is a probability space and X : Ω → M is a random variable, then the pth moment of X about x0 ∈ M is defined to be

\int_{M} d (x, x_{0})^{p} \, \mathrm{d} \left( X_{*} (\mathbf{P}) \right) (x) \equiv \int_{\Omega} d (X(\omega), x_{0})^{p} \, \mathrm{d} \mathbf{P} (\omega),

and X has finite pth moment if the pth moment of X about x0 is finite for some x0 ∈ M.

See also

References

  1. ^ A function such as a probability density function or cumulative distribution function; see Moment-generating function.
  2. ^ http://mathworld.wolfram.com/RawMoment.html Raw Moments at Math-world
  3. ^ Casella, George; Berger, Roger L. (2002). Statistical Inference (2 ed.). Pacific Grove: Duxbury. ISBN 0534243126. 
  4. ^ Ballanda, Kevin P.; MacGillivray, H. L. (1988). "Kurtosis: A Critical Review". The American Statistician (American Statistical Association) 42 (2): 111–119. doi:10.2307/2684482. JSTOR 2684482. 

External links


Wikimedia Foundation. 2010.

Look at other dictionaries:

  • Moment — Moment(s) may refer to: Moment (time) Contents 1 Science, engineering, and mathematics 2 Art and entertainment …   Wikipedia

  • Moment (physics) — Not to be confused with Momentum (physics). For a more abstract concept of moments that evolved from this concept of physics, see Moment (mathematics). Classical mechanics …   Wikipedia

  • Moment of inertia — This article is about the moment of inertia of a rotating object, also termed the mass moment of inertia. For the moment of inertia dealing with the bending of a beam, also termed the area moment of inertia, see second moment of area. In… …   Wikipedia

  • Mathematics and Physical Sciences — ▪ 2003 Introduction Mathematics       Mathematics in 2002 was marked by two discoveries in number theory. The first may have practical implications; the second satisfied a 150 year old curiosity.       Computer scientist Manindra Agrawal of the… …   Universalium

  • Mathematics — Maths and Math redirect here. For other uses see Mathematics (disambiguation) and Math (disambiguation). Euclid, Greek mathematician, 3r …   Wikipedia

  • Moment matrix — In mathematics, a moment matrix is a special symmetric square matrix whose rows and columns are indexed by monomials. The entries of the matrix depend on the product of the indexing monomials only (cf. Hankel matrices.) Moment matrices play an… …   Wikipedia

  • Moment problem — In mathematics, a moment problem arises as the result of trying to invert the mapping that takes a measure μ to the sequences of moments More generally, one may consider for an arbitrary sequence of functions Mn. Contents 1 …   Wikipedia

  • Moment map — In mathematics, specifically in symplectic geometry, the momentum map (or moment map) is a tool associated with a Hamiltonian action of a Lie group on a symplectic manifold, used to construct conserved quantities for the action. The moment map… …   Wikipedia

  • List of mathematics articles (M) — NOTOC M M estimator M group M matrix M separation M set M. C. Escher s legacy M. Riesz extension theorem M/M/1 model Maass wave form Mac Lane s planarity criterion Macaulay brackets Macbeath surface MacCormack method Macdonald polynomial Machin… …   Wikipedia

  • Standardized moment — In probability theory and statistics, the k thstandardized moment of a probability distribution is frac{mu k}{sigma^k}! where mu k is the k th moment about the mean and sigma; is the standard deviation.It is the normalization of the k th moment… …   Wikipedia


Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”

We are using cookies for the best presentation of our site. Continuing to use this site, you agree with this.