M -estimators of structural parameters in pseudolinear models

Friedrich Liese; Igor Vajda

Applications of Mathematics (1999)

  • Volume: 44, Issue: 4, page 245-270
  • ISSN: 0862-7940

Abstract

top
Real valued M -estimators θ ^ n : = min 1 n ρ ( Y i - τ ( θ ) ) in a statistical model with observations Y i F θ 0 are replaced by p -valued M -estimators β ^ n : = min 1 n ρ ( Y i - τ ( u ( z i T β ) ) ) in a new model with observations Y i F u ( z i t β 0 ) , where z i p are regressors, β 0 p is a structural parameter and u : a structural function of the new model. Sufficient conditions for the consistency of β ^ n are derived, motivated by the sufficiency conditions for the simpler “parent estimator” θ ^ n . The result is a general method of consistent estimation in a class of nonlinear (pseudolinear) statistical problems. If F θ has a natural exponential density e θ x - b ( x ) then our pseudolinear model with u = ( g μ ) - 1 reduces to the well known generalized linear model, provided μ ( θ ) = d b ( θ ) / d θ and g is the so-called link function of the generalized linear model. General results are illustrated for special pairs ρ and τ leading to some classical M -estimators of mathematical statistics, as well as to a new class of generalized α -quantile estimators.

How to cite

top

Liese, Friedrich, and Vajda, Igor. "$M$-estimators of structural parameters in pseudolinear models." Applications of Mathematics 44.4 (1999): 245-270. <http://eudml.org/doc/33033>.

@article{Liese1999,
abstract = {Real valued $M$-estimators $\hat\{\theta \}_n:=\min \sum _1^n\rho (Y_i-\tau (\theta ))$ in a statistical model with observations $Y_i\sim F_\{\theta _0\}$ are replaced by $\mathbb \{R\}^p$-valued $M$-estimators $\hat\{\beta \}_n:=\min \sum _1^n\rho (Y_i-\tau (u(z_i^T\,\beta )))$ in a new model with observations $Y_i\sim F_\{u(z_i^t\beta _0)\}$, where $z_i\in \mathbb \{R\}^p$ are regressors, $\beta _0\in \mathbb \{R\}^p$ is a structural parameter and $u:\mathbb \{R\}\rightarrow \mathbb \{R\}$ a structural function of the new model. Sufficient conditions for the consistency of $\hat\{\beta \}_n$ are derived, motivated by the sufficiency conditions for the simpler “parent estimator” $\hat\{\theta \}_n$. The result is a general method of consistent estimation in a class of nonlinear (pseudolinear) statistical problems. If $F_\theta $ has a natural exponential density $\mathrm \{e\}^\{\theta x-b(x)\}$ then our pseudolinear model with $u=(g\circ \mu )^\{-1\}$ reduces to the well known generalized linear model, provided $\mu (\theta )= \{\mathrm \{d\}\}b(\theta )/\{\mathrm \{d\}\}\theta $ and $g$ is the so-called link function of the generalized linear model. General results are illustrated for special pairs $\rho $ and $\tau $ leading to some classical $M$-estimators of mathematical statistics, as well as to a new class of generalized $\alpha $-quantile estimators.},
author = {Liese, Friedrich, Vajda, Igor},
journal = {Applications of Mathematics},
keywords = {$M$-estimator; generalized linear models; pseudolinear models; M-estimator; pseudo-linear models},
language = {eng},
number = {4},
pages = {245-270},
publisher = {Institute of Mathematics, Academy of Sciences of the Czech Republic},
title = {$M$-estimators of structural parameters in pseudolinear models},
url = {http://eudml.org/doc/33033},
volume = {44},
year = {1999},
}

TY - JOUR
AU - Liese, Friedrich
AU - Vajda, Igor
TI - $M$-estimators of structural parameters in pseudolinear models
JO - Applications of Mathematics
PY - 1999
PB - Institute of Mathematics, Academy of Sciences of the Czech Republic
VL - 44
IS - 4
SP - 245
EP - 270
AB - Real valued $M$-estimators $\hat{\theta }_n:=\min \sum _1^n\rho (Y_i-\tau (\theta ))$ in a statistical model with observations $Y_i\sim F_{\theta _0}$ are replaced by $\mathbb {R}^p$-valued $M$-estimators $\hat{\beta }_n:=\min \sum _1^n\rho (Y_i-\tau (u(z_i^T\,\beta )))$ in a new model with observations $Y_i\sim F_{u(z_i^t\beta _0)}$, where $z_i\in \mathbb {R}^p$ are regressors, $\beta _0\in \mathbb {R}^p$ is a structural parameter and $u:\mathbb {R}\rightarrow \mathbb {R}$ a structural function of the new model. Sufficient conditions for the consistency of $\hat{\beta }_n$ are derived, motivated by the sufficiency conditions for the simpler “parent estimator” $\hat{\theta }_n$. The result is a general method of consistent estimation in a class of nonlinear (pseudolinear) statistical problems. If $F_\theta $ has a natural exponential density $\mathrm {e}^{\theta x-b(x)}$ then our pseudolinear model with $u=(g\circ \mu )^{-1}$ reduces to the well known generalized linear model, provided $\mu (\theta )= {\mathrm {d}}b(\theta )/{\mathrm {d}}\theta $ and $g$ is the so-called link function of the generalized linear model. General results are illustrated for special pairs $\rho $ and $\tau $ leading to some classical $M$-estimators of mathematical statistics, as well as to a new class of generalized $\alpha $-quantile estimators.
LA - eng
KW - $M$-estimator; generalized linear models; pseudolinear models; M-estimator; pseudo-linear models
UR - http://eudml.org/doc/33033
ER -

References

top
  1. Fundamentals of Statistical Exponential Families. Lecture Notes No. 9, Institute of Mathematical Statistics, Hayward, California, 1986. (1986) MR0882001
  2. 10.1214/aos/1176346597, Annals of Statistics 13 (1985), 342–368. (1985) MR0773172DOI10.1214/aos/1176346597
  3. Robust Statistics: The Approach Based on Influence Functions, Wiley, New York, 1986. (1986) MR0829458
  4. Regression quantiles and trimmed least squares estimator in nonlinear regression model, Nonparametric Statistics 3 (1994), 201–222. (1994) MR1291545
  5. Robust Statistical Procedures, Wiley, New York, 1996. (1996) MR1387346
  6. 10.2307/1913643, Econometrica 46 (1978), 33–50. (1978) MR0474644DOI10.2307/1913643
  7. 10.1006/jmva.1994.1036, J. Multivar. Analysis 50 (1994), 93–114. (1994) MR1292610DOI10.1006/jmva.1994.1036
  8. 10.1007/BF01894328, Metrika 42 (1995), 291–324. (1995) MR1380211DOI10.1007/BF01894328
  9. Theory of Point Estimation, Wiley, New York, 1983. (1983) MR0702834
  10. 10.1093/biomet/79.4.747, Biometrika 79 (1992), 747–754. (1992) Zbl0850.62562DOI10.1093/biomet/79.4.747
  11. Parametric Statistical Theory, De Gruyter, Berlin, 1994. (1994) Zbl0807.62016MR1291393
  12. Convergence of Stochastic Processes. Springer, New York, 1984. (1984) MR0762984
  13. Empirical Processes: Theory and Applications, IMS, Hayward, 1990. (1990) Zbl0741.60001MR1089429
  14. 10.1017/S0266466600004394, Econometric Theory 7 (1991), 186–199. (1991) MR1128411DOI10.1017/S0266466600004394
  15. Weak Convergence and Empirical Processes, Springer, New York, 1996. (1996) MR1385671
  16. On L 1 -norm estimators in nonlinear regression and in nonlinear error-in-variables models, IMS Lecture Notes 31, 101–118, Hayward, 1997. (1997) Zbl0935.62074MR1833587

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.