Stopping time

Stopping time
Example of a stopping time: a hitting time of Brownian motion

In probability theory, in particular in the study of stochastic processes, a stopping time (also Markov time) is a specific type of “random time”.

The theory of stopping rules and stopping times can be analysed in probability and statistics, notably in the optional stopping theorem. Also, stopping times are frequently applied in mathematical proofs- to “tame the continuum of time”, as Chung put it in his book (1982).

Contents

Definition

A stopping time with respect to a sequence of random variables X1, X2, ... is a random variable τ with the property that for each t, the occurrence or non-occurrence of the event τ = t depends only on the values of X1, X2, ..., Xt. In some cases, the definition specifies that Pr(τ < ∞) = 1, or that τ be almost surely finite, although in other cases this requirement is omitted.

Another, more general definition may be given in terms of a filtration: Let (I, \leq) be an ordered index set (often I=[0,\infty) or a compact subset thereof), and let (\Omega, \mathcal{F}, \mathcal{F}_t, \mathbb{P}) be a filtered probability space, i.e. a probability space equipped with a filtration. Then a random variable \tau : \Omega \to I is called a stopping time if \{ \tau \leq t \} \in \mathcal{F}_{t} for all t in I. Often, to avoid confusion, we call it a \mathcal{F}_t-stopping time and explicitly specify the filtration. Speaking concretely, for τ to be a stopping time, it should be possible to decide whether or not \{ \tau \leq t \} has occurred on the basis of the knowledge of \mathcal{F}_t, i.e., event \{ \tau \leq t \} is \mathcal{F}_t-measurable.

Stopping times occur in decision theory, in which a stopping rule is characterized as a mechanism for deciding whether to continue or stop a process on the basis of the present position and past events, and which will almost always lead to a decision to stop at some time.

Examples

To illustrate some examples of random times that are stopping rules and some that are not, consider a gambler playing roulette with a typical house edge, starting with $100:

  • Playing one, and only one, game corresponds to the stopping time τ = 1, and is a stopping rule.
  • Playing until he either runs out of money or has played 500 games is a stopping rule.
  • Playing until he is the maximum amount ahead he will ever be is not a stopping rule and does not provide a stopping time, as it requires information about the future as well as the present and past.
  • Playing until he doubles his money (borrowing if necessary if he goes into debt) is not a stopping rule, as there is a positive probability that he will never double his money. (Here it is assumed that there are limits that prevent the employment of a martingale system, or a variant thereof, such as each bet being triple the size of the last. Such limits could include betting limits but not limits to borrowing.)
  • Playing until he either doubles his money or runs out of money is a stopping rule, even though there is potentially no limit to the number of games he plays, since the probability that he stops in a finite time is 1.

Localization

Stopping times are frequently used to generalize certain properties of stochastic processes to situations in which the required property is satisfied in only a local sense. First, if X is a process and τ is a stopping time, then Xτ is used to denote the process X stopped at time τ.

 X^\tau_t=X_{\min(t,\tau)}

Then, X is said to locally satisfy some property P if there exists a sequence of stopping times τn, which increases to infinity and for which the processes 1_{\{\tau_n>0\}}X^{\tau_n} satisfy property P. Common examples, with time index set I = [0,∞), are as follows;

  • (Local martingale) A process X is a local martingale if it is càdlàg and there exists a sequence of stopping times τn increasing to infinity, such that 1_{\{\tau_n>0\}}X^{\tau_n} is a martingale for each n.
  • (Locally integrable) A non-negative and increasing process X is locally integrable if there exists a sequence of stopping times τn increasing to infinity, such that \mathbb{E}(1_{\{\tau_n>0\}}X^{\tau_n})<\infty for each n.

Types of stopping times

Stopping times, with time index set I = [0,∞), are often divided into one of several types depending on whether it is possible to predict when they are about to occur.

A stopping time τ is predictable if it is equal to the limit of an increasing sequence of stopping times τn satisfying τn < τ whenever τ > 0. The sequence τn is said to announce τ, and predictable stopping times are sometimes known as announceable. Examples of predictable stopping times are hitting times of continuous and adapted processes. If τ is the first time at which a continuous and real valued process X is equal to some value a, then it is announced by the sequence τn, where τn is the first time at which X is within a distance of 1/n of a.

Accessible stopping times are those that can be covered by a sequence of predictable times. That is, stopping time τ is accessible if, P(τ=τn for some n) = 1, where τn are predictable times.

A stopping time τ is totally inaccessible if it can never be announced by an increasing sequence of stopping times. Equivalently, P(τ = σ < ∞) = 0 for every predictable time σ. Examples of totally inaccessible stopping times include the jump times of Poisson processes.

Every stopping time τ can be uniquely decomposed into an accessible and totally inaccessible time. That is, there exists a unique accessible stopping time σ and totally inaccessible time υ such that τ = σ whenever σ < ∞, τ = υ whenever υ < ∞, and τ = ∞ whenever σ = υ = ∞. Note that in the statement of this decomposition result, stopping times do not have to be almost surely finite, and can equal ∞.

See also

References

  • Chung, Kai Lai (1982). Lectures from Markov processes to Brownian motion. Grundlehren der Mathematischen Wissenschaften No. 249. New York: Springer-Verlag. ISBN 0-387-90618-5. 
  • Revuz, Daniel and Yor, Marc (1999). Continuous martingales and Brownian motion. Grundlehren der Mathematischen Wissenschaften No. 293 (Third edition ed.). Berlin: Springer-Verlag. ISBN 3-540-64325-7. 
  • H. Vincent Poor and Olympia Hadjiliadis (2008). Quickest Detection (First edition ed.). Cambridge: Cambridge University Press. ISBN 9780521621045. 
  • Protter, Philip E. (2005). Stochastic integration and differential equations. Stochastic Modelling and Applied Probability No. 21 (Second edition (version 2.1, corrected third printing) ed.). Berlin: Springer-Verlag. ISBN 3-540-00313-4. 

Further reading

  • Shiryaev, Albert N. (2007). Optimal Stopping Rules. Springer. ISBN 3540740104. 

Wikimedia Foundation. 2010.

Игры ⚽ Поможем решить контрольную работу

Look at other dictionaries:

  • Time Bomb (Angel) — Infobox Television episode Title = Time Bomb Series = Angel Caption = {Caption|} Season = 5 Episode = 19 Airdate = April 28, 2004 Production = 5ADH19 Writer = Ben Edlund Director = Vern Gillum Guests = Jaime Bergman (Amanda) Jeff Yagher (Fell… …   Wikipedia

  • Stopping the clock — is a controversial practice in American and Canadian legislative procedure in which a legislature literally or notionally stops the clock (or moves the hands backwards), usually for the purpose of meeting a constitutional or statutory deadline.… …   Wikipedia

  • Stopping the tide — (fr. etaler les maree ) was a manoeuver in use during the age of sail. In seas with a strong tide, such as those off the coasts of western Europe, particularly the Channel, the force of the tide on a ship could equal, or surpass, the power… …   Wikipedia

  • Stopping down — refers to a photographic technique that increases the depth of field by reducing the aperture of a camera. However, this comes at the expense of reducing the available light and results in dimmer images. Photographers can compensate for this by… …   Wikipedia

  • Stopping sight distance — is a term used in highway design. It is defined as the length of roadway ahead visible to the driver. American Association of State Highway and Transportation Officials (1994) A Policy on Geometric Design of Highways and Streets (pp. 117 118)]… …   Wikipedia

  • Stopping by Woods on a Snowy Evening — is a poem written in 1922 by Robert Frost, and published in 1923 in his New Hampshire volume. Imagery and personification are prominent in the work. Frost wrote this poem about winter in June, 1922 at his house in Shaftsbury, Vermont that is now… …   Wikipedia

  • Time 100 — cover for 2008 Time 100 is an annual list of the 100 most influential people in the world, as assembled by Time. First published in 1999 as a result of a debate among several academics, the list has become an annual event. Contents …   Wikipedia

  • time out — {n. phr.} Time during which a game, a lecture, a discussion or other activity is stopped for a while for some extra questions or informal discussion, or some other reason. * /He took a time out from studying to go to a movie./ * /The player… …   Dictionary of American idioms

  • time out — {n. phr.} Time during which a game, a lecture, a discussion or other activity is stopped for a while for some extra questions or informal discussion, or some other reason. * /He took a time out from studying to go to a movie./ * /The player… …   Dictionary of American idioms

  • Stopping power — For the concept in nuclear physics, see stopping power (particle radiation). Contents 1 History 2 Dynamics of bullets 3 Wound …   Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”