D'Alembert's formula

My name is Winnie and I am studying Anthropology and Sociology and Modern Languages and Classics at Rillieux-La-Pape / France.

Also visit my web site ... hostgator1centcoupon.info

For other uses, see Chinese restaurant (disambiguation).

In probability theory, the Chinese restaurant process is a discrete-time stochastic process, whose value at any positive-integer time n is a partition B_n of the set {1, 2, 3, ..., n} whose probability distribution is determined as follows. At time n = 1, the trivial partition { {1} } is obtained with probability 1. At time n + 1 the element n + 1 is either:

1. added to one of the blocks of the partition B_n, where each block is chosen with probability |b|/(n + 1) where |b| is the size of the block, or
2. added to the partition B_n as a new singleton block, with probability 1/(n + 1).

The random partition so generated is exchangeable in the sense that relabeling {1, ..., n} does not change the distribution of the partition, and it is consistent in the sense that the law of the partition of n − 1 obtained by removing the element n from the random partition at time n is the same as the law of the random partition at time n − 1.

Definition

Although whimsical, one fancifully imagines a Chinese restaurant with an infinite number of circular tables, each with infinite capacity. Customer 1 is seated at an unoccupied table with probability 1. At time n + 1, a new customer chooses uniformly at random to sit at one of the following n + 1 places: directly to the left of one of the n customers already sitting at an occupied table, or at a new, unoccupied circular table. Each table thus corresponds to a block of a random partition. (For an account of the custom in actual Chinese restaurants, see table sharing). The probability assigned to any particular partition (ignoring the order in which customers sit around any particular table) is

$\Pr(B_{n}=B)={\dfrac {\prod _{b\in B}(|b|-1)!}{n!}}$

where b is a block in the partition B and |b| is the size (i.e. number of elements) of b. David J. Aldous attributes the analogy to Pitman and Dubins in his 1983 book.

Generalization

This construction can be generalized to a model with two parameters, α and θ, commonly called the discount and strength (or concentration) parameters. At time n + 1, the next customer to arrive finds |B| occupied tables and decides to sit at an empty table with probability

${\dfrac {\theta +|B|\alpha }{n+\theta }},$

or at an occupied table b of size |b| with probability

${\dfrac {|b|-\alpha }{n+\theta }}.$

In order for the construction to define a valid probability measure it is necessary to suppose that either α < 0 and θ = - Lα for some L ∈ {1, 2, ...}; or that 0 ≤ α ≤ 1 and θ > −α.

Under this model the probability assigned to any particular partition B of n, in terms of the Pochhammer k-symbol, is

$\Pr(B_{n}=B)={\dfrac {(\theta +\alpha )_{|B|-1,\alpha }}{(\theta +1)_{n-1,1}}}\prod _{b\in B}(1-\alpha )_{|b|-1,1}$

where, by convention, $(a)_{0,c}=1$, and for $b>0$

$(a)_{b,c}=\prod _{i=0}^{b-1}(a+ic)={\begin{cases}a^{b}&{\text{if }}c=0,\\\\{\dfrac {c^{b}\,\Gamma (a/c+b)}{\Gamma (a/c)}}&{\text{otherwise}}.\end{cases}}$

Thus, for the case when $\theta >0$ the partition probability can be expressed in terms of the Gamma function as

$\Pr(B_{n}=B)={\dfrac {\Gamma (\theta )}{\Gamma (\theta +n)}}{\dfrac {\alpha ^{|B|}\,\Gamma (\theta /\alpha +|B|)}{\Gamma (\theta /\alpha )}}\prod _{b\in B}{\dfrac {\Gamma (|b|-\alpha )}{\Gamma (1-\alpha )}}.$

In the one-parameter case, where $\alpha$ is zero, this simplifies to

$\Pr(B_{n}=B)={\dfrac {\Gamma (\theta )\,\theta ^{|B|}}{\Gamma (\theta +n)}}\prod _{b\in B}\Gamma (|b|).$

Or, when $\theta$ is zero,

$\Pr(B_{n}=B)={\dfrac {\alpha ^{|B|-1}\,\Gamma (|B|)}{\Gamma (n)}}\prod _{b\in B}{\dfrac {\Gamma (|b|-\alpha )}{\Gamma (1-\alpha )}}.$

As before, the probability assigned to any particular partition depends only on the block sizes, so as before the random partition is exchangeable in the sense described above. The consistency property still holds, as before, by construction.

If α = 0, the probability distribution of the random partition of the integer n thus generated is the Ewens distribution with parameter θ, used in population genetics and the unified neutral theory of biodiversity.

Derivation

Here is one way to derive this partition probability. Let C_i be the random block into which the number i is added, for i = 1, 2, 3, ... . Then

${\begin{aligned}\Pr(C_{i}=c|C_{1},\ldots ,C_{i-1})&{}={\begin{cases}{\dfrac {\theta +|B|\alpha }{\theta +i-1}}&{\text{if }}c\in {\text{new block}},\\\\{\dfrac {|b|-\alpha }{\theta +i-1}}&{\text{if }}c\in b;\end{cases}}\end{aligned}}$

The probability that B_n is any particular partition of the set { 1, ..., n } is the product of these probabilities as i runs from 1 to n. Now consider the size of block b: it increases by 1 each time we add one element into it. When the last element in block b is to be added in, the block size is (|b| − 1). For example, consider this sequence of choices: (generate a new block b)(join b)(join b)(join b). In the end, block b has 4 elements and the product of the numerators in the above equation gets θ · 1 · 2 · 3. Following this logic, we obtain Pr(B_n = B) as above.

Expected number of tables

For the one parameter case, with α = 0 and 0 < θ < ∞, the expected number of tables, given that there are $n$ seated customers, is

${\begin{aligned}\sum _{k=1}^{n}{\frac {\theta }{\theta +k-1}}.\end{aligned}}$

In general case (α > 0) the expected number of occupied tables is

${\begin{aligned}{\frac {\theta \Gamma (\theta +n+\alpha )\Gamma (\theta +1)}{\alpha \Gamma (\theta +n)\Gamma (\theta +\alpha )}}-{\frac {\theta }{\alpha }}.\end{aligned}}$

The Indian buffet process

It is possible to adapt the model such that each data point is no longer uniquely associated with a class (i.e. we are no longer constructing a partition), but may be associated with any combination of the classes. This strains the restaurant-tables analogy but can instead be described as a process in which each diner samples from some subset of an infinite selection of dishes on offer at a buffet. The probability that a particular diner samples a particular dish is proportional to the popularity of the dish among diners so far, and in addition the diner may sample from the untested dishes. This has been named the Indian buffet process and can be used to infer latent features in data.

Applications

The Chinese restaurant process is closely connected to Dirichlet processes and Polya's urn scheme, and therefore useful in applications of nonparametric Bayesian methods including Bayesian statistics. The Generalized Chinese Restaurant Process is closely related to Pitman–Yor process. These processes have been used in many applications, including modeling text, clustering biological microarray data, biodiversity modelling and detecting objects in images Potter or Ceramic Artist Truman Bedell from Rexton, has interests which include ceramics, best property developers in singapore developers in singapore and scrabble. Was especially enthused after visiting Alejandro de Humboldt National Park..

External links

• Introduction to the Dirichlet Distribution and Related Processes by Frigyik, Kapila and Gupta

• A talk by Michael I. Jordan on the CRP:
  • http://videolectures.net/icml05_jordan_dpcrp/