Английская Википедия:Adaptive estimator

Содержание

Текст

Текст

Текст

Текст

Текст

Текст

Текст

Текст

Текст

Шаблон:One source In statistics, an adaptive estimator is an estimator in a parametric or semiparametric model with nuisance parameters such that the presence of these nuisance parameters does not affect efficiency of estimation.

Definition

Formally, let parameter θ in a parametric model consists of two parts: the parameter of interest Шаблон:Nowrap, and the nuisance parameter Шаблон:Nowrap. Thus Шаблон:Nowrap. Then we will say that <math style="vertical-align:-.1em">\scriptstyle\hat\nu_n</math> is an adaptive estimator of ν in the presence of η if this estimator is regular, and efficient for each of the submodels

<math>

   \mathcal{P}_\nu(\eta_0) = \big\{ P_\theta: \nu\in N,\, \eta=\eta_0\big\}.
 </math>

Adaptive estimator estimates the parameter of interest equally well regardless whether the value of the nuisance parameter is known or not.

The necessary condition for a regular parametric model to have an adaptive estimator is that

<math>

   I_{\nu\eta}(\theta) = \operatorname{E}[\, z_\nu z_\eta' \,] = 0 \quad \text{for all }\theta,
 </math>

where z_ν and z_η are components of the score function corresponding to parameters ν and η respectively, and thus I_νη is the top-right k×m block of the Fisher information matrix I(θ).

Example

Suppose <math>\scriptstyle\mathcal{P}</math> is the normal location-scale family:

<math>

   \mathcal{P} = \Big\{\ f_\theta(x) = \tfrac{1}{\sqrt{2\pi}\sigma} e^{ -\frac{1}{2\sigma^2}(x-\mu)^2 }\ \Big|\ \mu\in\mathbb{R}, \sigma>0 \ \Big\}.
 </math>

Then the usual estimator <math>\hat\mu\,=\,\bar{x}</math> is adaptive: we can estimate the mean equally well whether we know the variance or not.

Basic references

• Шаблон:Cite book

Other useful references

• I. V. Blagouchine and E. Moreau: "Unbiased Adaptive Estimations of the Fourth-Order Cumulant for Real Random Zero-Mean Signal", IEEE Transactions on Signal Processing, vol. 57, no. 9, pp. 3330–3346, September 2009.