Overring

In statistics, the Hájek–Le Cam convolution theorem states that any regular estimator in a parametric model is asymptotically equivalent to a sum of two independent random variables, one of which is normal with asymptotic variance equal to the inverse of Fisher information, and the other having arbitrary distribution.

The obvious corollary from this theorem is that the “best” among regular estimators are those with the second component identically equal to zero. Such estimators are called efficient and are known to always exist for regular parametric models.

The theorem is named after Jaroslav Hájek and Lucien Le Cam.

Theorem statement

Let ℘ = {P_θ | θ ∈ Θ ⊂ ℝ^k} be a regular parametric model, and q(θ): Θ → ℝ^m be a parameter in this model (typically a parameter is just one of the components of vector θ). Assume that function q is differentiable on Θ, with the m × k matrix of derivatives denotes as q̇_θ. Define

$I_{q(\theta )}^{-1}=\dot{q}(\theta )I^{-1}(\theta )\dot{q}(\theta {)}^{\prime }$  — the information bound for q,

${\psi }_{q(\theta )}=\dot{q}(\theta )I^{-1}(\theta )\dot{\ell }(\theta )$  — the efficient influence function for q,

where I(θ) is the Fisher information matrix for model ℘, $\dot{\ell }(\theta )$ is the score function, and ′ denotes matrix transpose.

Theorem Template:Harv. Suppose T_n is a uniformly (locally) regular estimator of the parameter q. Then

1. There exist independent random m-vectors $Z_{\theta }\sim \mathcal{𝒩}(0,I_{q(\theta )}^{-1})$ and Δ_θ such that

   $\sqrt{n}(T_n-q(\theta ))\stackrel{d}{\to }{Z}_{\theta }+{\mathrm{\Delta }}_{\theta },$

   where ^d denotes convergence in distribution. More specifically,

   $\left(\begin{array}{c}\sqrt{n}(T_n-q(\theta ))-\frac{1}{\sqrt{n}}\sum _{i=1}^n{\psi }_{q(\theta )}(x_i)\\ \frac{1}{\sqrt{n}}\sum _{i=1}^n{\psi }_{q(\theta )}(x_i)\end{array}\right)\stackrel{d}{\to }\left(\begin{array}{c}{\mathrm{\Delta }}_{\theta }\\ Z_{\theta }\end{array}\right).$

2. If the map θ → q̇_θ is continuous, then the convergence in (A) holds uniformly on compact subsets of Θ. Moreover, in that case Δ_θ = 0 for all θ if and only if T_n is uniformly (locally) asymptotically linear with influence function ψ_q(θ)

References

• 20 year-old Real Estate Agent Rusty from Saint-Paul, has hobbies and interests which includes monopoly, property developers in singapore and poker. Will soon undertake a contiki trip that may include going to the Lower Valley of the Omo.
  
  My blog: http://www.primaboinca.com/view_profile.php?userid=5889534

43 year old Petroleum Engineer Harry from Deep River, usually spends time with hobbies and interests like renting movies, property developers in singapore new condominium and vehicle racing. Constantly enjoys going to destinations like Camino Real de Tierra Adentro.