Bernoulli process


Bernoulli process

In probability and statistics, a Bernoulli processis a discrete-time stochastic process consisting ofa sequence of independent random variables taking values over two symbols. Prosaically, a Bernoulli process is coin flipping, possibly with an unfair coin. A variable in such a sequence may be called a Bernoulli variable.

Definition

A Bernoulli process is a discrete-time stochastic process consisting of a finite or infinite sequence of independent random variables "X"1, "X"2, "X"3,..., such that

* For each "i", the value of "X""i" is either 0 or 1;
* For all values of "i", the probability that "X""i" = 1 is the same number "p".

In other words, a Bernoulli process is a sequence of independent identically distributed Bernoulli trials. The two possible values of each "X""i" are often called "success" and "failure", so that, when expressed as a number, 0 or 1, the value is said to be the number of successes on the "i"th "trial".The individual success/failure variables "X""i" are also called Bernoulli trials.

Independence of Bernoulli trials implies memorylessness property: past trials do not provide any information regarding future outcomes. From any given time, future trials is also a Bernoulli process independent of the past (fresh-start property).

Random variables associated with the Bernoulli process include

*The number of successes in the first "n" trials; this has a binomial distribution;
*The number of trials needed to get "r" successes; this has a negative binomial distribution.
*The number of trials needed to get one success; this has a geometric distribution, which is a special case of the negative binomial distribution.

The problem of determining the process, given only a limited sample of Bernoulli trials, is known as the problem of checking if a coin is fair.

Formal definition

The Bernoulli process can be formalized in the language of probability spaces. A Bernoulli process is then a probability space (Omega, Pr) together with a random variable "X" over the set {0,1}, so that for every omega inOmega, one has X_i(omega)=1 with probability "p" and X_i(omega)=0 with probability 1-"p".

Bernoulli sequence

Given a Bernoulli process defined on a probability space (Omega, Pr), then associated with every omega in Omega is a sequence of integers

:mathbb{Z}^omega = {nin mathbb{Z} : X_n(omega) = 1 }

which is called the Bernoulli sequence. So, for example, if omega represents a sequence of coin flips, then the Bernoulli sequence is the list of integers for which the coin toss came out "heads".

Almost all Bernoulli sequences are ergodic sequences.

Bernoulli map

Because every trial has one of two possible outcomes, a sequence of trials may be represented by the binary digits of a real number. When the probability "p" = 1/2, all possible distributions are equally likely, and thus the measure of the σ-algebra of the Bernoulli process is equivalent to the uniform measure on the unit interval: in other words, the real numbers are distributed uniformly on the unit interval.

The shift operator "T" taking each random variable to the next,

:TX_i=X_{i+1}

is then given by the Bernoulli map or the 2x mod 1 map

:b(z)=2z-lfloor 2z floor

where zin [0,1] represents a given sequence of measurements, and lfloor z floor is the floor function, the largest integer less than "z". The Bernoulli map essentially lops off one digit of the binary expansion of "z".

The Bernoulli map is an exactly solvable model of deterministic chaos. The transfer operator, or Frobenius-Perron operator, of the Bernoulli map is solvable; the eigenvalues are multiples of 1/2, and the eigenfunctions are the Bernoulli polynomials.

Generalizations

The generalization of the Bernoulli process to more than two possible outcomes is called the Bernoulli scheme.

References

* Carl W. Helstrom, "Probability and Stochastic Processes for Engineers", (1984) Macmillan Publishing Company, New York ISBN 0-02-353560-1.
* Dimitri P. Bertsekas and John N. Tsitsiklis, "Introduction to Probability", (2002) Athena Scientific, Massachusetts ISBN 1-886529-40-X
* Pierre Gaspard, "r-adic one-dimensional maps and the Euler summation formula", "Journal of Physics A", 25 (letter) L483-L485 (1992). "(Describes the eigenfunctions of the transfer operator for the Bernoulli map)"
* Dean J. Driebe, "Fully Chaotic Maps and Broken Time Symmetry", (1999) Kluwer Academic Publishers, Dordrecht Netherlands ISBN 0-7923-5564-4 "(Chapters 2, 3 and 4 review the Ruelle resonances and subdynamics formalism for solving the Bernoulli map)".


Wikimedia Foundation. 2010.

Look at other dictionaries:

  • Bernoulli — can refer to: *any one or more of the Bernoulli family of Swiss mathematicians in the eighteenth century, including: ** Daniel Bernoulli (1700–1782), developer of Bernoulli s principle ** Jakob Bernoulli (1654–1705), also known as Jean or Jacques …   Wikipedia

  • Bernoulli scheme — In mathematics, the Bernoulli scheme or Bernoulli shift is a generalization of the Bernoulli process to more than two possible outcomes.[1][2] Bernoulli schemes are important in the study of dynamical systems, as most such systems (such as Axiom… …   Wikipedia

  • Bernoulli trial — In the theory of probability and statistics, a Bernoulli trial is an experiment whose outcome is random and can be either of two possible outcomes, success and failure .In practice it refers to a single experiment which can have one of two… …   Wikipedia

  • Bernoulli sampling — In the theory of finite population sampling, Bernoulli sampling is a sampling process where each element of the population that is sampled is subjected to an independent Bernoulli trial which determines whether the element becomes part of the… …   Wikipedia

  • Bernoulli family — The Bernoullis were a family of traders and scholars from Basel, Switzerland. The founder of the family, Leon Bernoulli, immigrated to Basel from Antwerp in the Flanders in the 16th century.The Bernoulli family has produced many notable artists… …   Wikipedia

  • Bernoulli distribution — Probability distribution name =Bernoulli type =mass pdf cdf parameters =1>p>0, pinR support =k={0,1}, pdf = egin{matrix} q=(1 p) mbox{for }k=0 p mbox{for }k=1 end{matrix} cdf = egin{matrix} 0 mbox{for }k …   Wikipedia

  • Bernoulli's principle — This article is about Bernoulli s principle and Bernoulli s equation in fluid dynamics. For Bernoulli s Theorem (probability), see Law of large numbers. For an unrelated topic in ordinary differential equations, see Bernoulli differential… …   Wikipedia

  • Process — In anatomy, a process is a projection from a structure. The process of the mandible is the part of the lower jaw that projects forward. In a more general sense, a process is a series of actions or events that are part of a system or of a… …   Medical dictionary

  • Bernoulli trial — A single random event for which there are two and only two possible outcomes that are mutually exclusive and have a priori fixed (and complementary) probabilities of resulting. The trial is the realization of this process. Conventionally one… …   Medical dictionary

  • Schéma de Bernoulli — Processus de Bernoulli En probabilités et en statistiques, un processus de Bernoulli est un processus stochastique discret qui consiste en une suite de variables aléatoires indépendantes qui prennent leurs valeurs parmi deux symboles.… …   Wikipédia en Français


Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”

We are using cookies for the best presentation of our site. Continuing to use this site, you agree with this.