TY - JOUR
T1 - Relative efficiencies of kernel and local likelihood density estimators
AU - Hall, Peter
AU - Tao, Terence
PY - 2002
Y1 - 2002
N2 - Local likelihood methods enjoy advantageous properties, such as good performance in the presence of edge effects, that are rarely found in other approaches to nonparametric density estimation. However, as we argue in this paper, standard kernel methods can have distinct advantages when edge effects are not present. We show that, whereas the integrated variances of the two methods are virtually identical, the integrated squared bias of a conventional kernel estimator is less than that of a local log-linear estimator by as much as a factor of 4. Moreover, the greatest bias improvements offered by kernel methods occur when they are needed most-i.e. when the effect of bias is particularly high. Similar comparisons can also be made when high degree local log-polynomial fits are assessed against high order kernel methods. For example, although (as is well known) high degree local polynomial fits offer potentially infinite efficiency gains relative to their kernel competitors, the converse is also true. Indeed, the asymptotic value of the integrated squared bias of a local log-quadratic estimator can exceed any given constant multiple of that for the competing kernel method. In all cases the densities that suffer problems in the context of local log-likelihood methods can be chosen to be symmetric, either unimodal or bimodal, either infinitely or compactly supported, and to have arbitrarily many derivatives as functions on the real line. They are not pathological. However, our results reveal quantitative differences between global performances of local log-polynomial estimators applied to unimodal or multimodal distributions.
AB - Local likelihood methods enjoy advantageous properties, such as good performance in the presence of edge effects, that are rarely found in other approaches to nonparametric density estimation. However, as we argue in this paper, standard kernel methods can have distinct advantages when edge effects are not present. We show that, whereas the integrated variances of the two methods are virtually identical, the integrated squared bias of a conventional kernel estimator is less than that of a local log-linear estimator by as much as a factor of 4. Moreover, the greatest bias improvements offered by kernel methods occur when they are needed most-i.e. when the effect of bias is particularly high. Similar comparisons can also be made when high degree local log-polynomial fits are assessed against high order kernel methods. For example, although (as is well known) high degree local polynomial fits offer potentially infinite efficiency gains relative to their kernel competitors, the converse is also true. Indeed, the asymptotic value of the integrated squared bias of a local log-quadratic estimator can exceed any given constant multiple of that for the competing kernel method. In all cases the densities that suffer problems in the context of local log-likelihood methods can be chosen to be symmetric, either unimodal or bimodal, either infinitely or compactly supported, and to have arbitrarily many derivatives as functions on the real line. They are not pathological. However, our results reveal quantitative differences between global performances of local log-polynomial estimators applied to unimodal or multimodal distributions.
KW - Bandwidth
KW - Global performance
KW - High order methods
KW - Integrated squared bias
KW - Local linear estimator
KW - Log-polynomial
KW - Mean-squared error
KW - Nonparametric curve estimation
UR - http://www.scopus.com/inward/record.url?scp=0036020895&partnerID=8YFLogxK
U2 - 10.1111/1467-9868.00349
DO - 10.1111/1467-9868.00349
M3 - Article
SN - 1369-7412
VL - 64
SP - 537
EP - 547
JO - Journal of the Royal Statistical Society. Series B: Statistical Methodology
JF - Journal of the Royal Statistical Society. Series B: Statistical Methodology
IS - 3
ER -