# Basu's theorem

In statistics, **Basu's theorem** states that any boundedly complete sufficient statistic is independent of any ancillary statistic. This is a 1955 result of Debabrata Basu.^{[1]}

It is often used in statistics as a tool to prove independence of two statistics, by first demonstrating one is complete sufficient and the other is ancillary, then appealing to the theorem.{{ safesubst:#invoke:Unsubst||date=__DATE__ |$B=
{{#invoke:Category handler|main}}{{#invoke:Category handler|main}}^{[citation needed]}
}} An example of this is to show that the sample mean and sample variance of a normal distribution are independent statistics, which is done in the Examples section below. This property (independence of sample mean and sample variance) characterizes normal distributions.

## Statement

Let *P _{θ}* be a family of distributions on a measurable space (

*X, Σ*). Then if

*T*is a boundedly complete sufficient statistic for

*θ*, and

*A*is ancillary to

*θ*, then

*T*is independent of

*A*.

### Proof

Let *P _{θ}^{T}* and

*P*be the marginal distributions of

_{θ}^{A}*T*and

*A*respectively.

The *P _{θ}^{A}* does not depend on

*θ*because

*A*is ancillary. Likewise,

*P*(·|

_{θ}*T = t*) does not depend on

*θ*because

*T*is sufficient. Therefore:

Note the integrand (the function inside the integral) is a function of *t* and not *θ*. Therefore, since *T* is boundedly complete:

Therefore, *A* is independent of *T*.

## Example

### Independence of sample mean and sample variance of a normal distribution

Let *X*_{1}, *X*_{2}, ..., *X*_{n} be independent, identically distributed normal random variables with mean *μ* and variance *σ*^{2}.

Then with respect to the parameter *μ*, one can show that

the sample mean, is a complete sufficient statistic – it is all the information one can derive to estimate *μ,* and no more – and

the sample variance, is an ancillary statistic – its distribution does not depend on *μ.*

Therefore, from Basu's theorem it follows that these statistics are independent.

This independence result can also be proven by Cochran's theorem.

Further, this property (that the sample mean and sample variance of the normal distribution are independent) *characterizes* the normal distribution – no other distribution has this property.^{[2]}

## Notes

## References

- {{#invoke:Citation/CS1|citation

|CitationClass=journal }}

- Mukhopadhyay, Nitis (2000).
*Probability and Statistical Inference*. Statistics: A Series of Textbooks and Monographs.**162**. Florida: CRC Press USA. ISBN 0-8247-0379-0. - {{#invoke:Citation/CS1|citation

|CitationClass=journal }}

- {{#invoke:Citation/CS1|citation

|CitationClass=journal }}