Abstract
Akaike (1973, 2nd International Symposium on Information Theory, 267-281,Akademiai Kiado, Budapest) proposed AIC as an estimate of the expected loglikelihood to evaluate the goodness of models fitted to a given set of data.The introduction of AIC has greatly widened the range of application ofstatistical methods. However, its limit lies in the point that it can beapplied only to the cases where the parameter estimation are performed bythe maximum likelihood method. The derivation of AIC is based on theassessment of the effect of data fluctuation through the asymptoticnormality of MLE. In this paper we propose a new information criterion EICwhich is constructed by employing the bootstrap method to simulate the datafluctuation. The new information criterion, EIC, is regarded as an extensionof AIC. The performance of EIC is demonstrated by some numerical examples.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle, 2nd International Symposium on Information Theory (eds. B. N. Petrov and F. Csaki), 267–281, Akademiai Kiado, Budapest. (Reproduced in Breakthroughs in Statistics, Vol. 1 (eds. S. Kotz and N. L. Johnson), Springer, New York (1992))
Akaike, H. (1980). Likelihood and Bayes procedure, Bayesian Statistics (eds. J. M. Bernardo, M. H. De Groot, D. U. Lindley and A. F. M. Smith), 143–166, University Press, Valencia, Spain.
Efron, B. (1979). Bootstrap methods: another look at the jackknife, Ann. Statist., 7(1), 1–26.
Huber, P. J. (1967). The behavior of maximum likelihood estimators under nonstandard conditions, Proc. Fifth Berkely Sympos. Probab. Statist., 1, 221–233, Univ. of California Press, Berkeley.
Hurvich, C. M. and Tsai, C. L. (1989). Regression and time-series model selection in small samples, Biometrika, 76(2), 297–307.
Hurvich, C. M., Shumway, R. and Taai, C.-L. (1990). Improved catirnators of Kulback-Lcibler information for autoregressive model selection in small samples, Biometrika, 77(4), 709–719.
Ishiguro, M. and Sakamoto, Y. (1991). WIC: an estimator-free information criterion, Research Memo., No. 410, The Institute of Statistical Mathematics.
Sakamoto, Y. (1991). Categorical Data Analysis by AIC, Kluwer, Dordrecht.
Sakamoto, Y., Ishiguro, M. and Kitagawa, G. (1986). Akaike Information Criterion Statistics, Reidel, Dordrecht.
Shibata, R. (1989). Statistical aspect of model selection, From Data to Model (ed. J. C. Willems), 215–240, Springer, Berlin.
Sugiura, N. (1978). Further analysis of the data by Akaike's information criterion and the finite corrections, Comm. Statist. A-Theory Methods, 7(1), 13–26.
Takeuchi, K. (1976). Distribution of information number statistics and criteria for adequacy of models, Mathematical Sciences, No. 153, 12–18 (in Japanese).
Wong, W. H. (1983). A note on the modified likelihood for density estimation, J. Amer. Statist. Assoc., 78, 461–463.
Author information
Authors and Affiliations
About this article
Cite this article
Ishiguro, M., Sakamoto, Y. & Kitagawa, G. Bootstrapping Log Likelihood and EIC, an Extension of AIC. Annals of the Institute of Statistical Mathematics 49, 411–434 (1997). https://doi.org/10.1023/A:1003158526504
Issue Date:
DOI: https://doi.org/10.1023/A:1003158526504