Comparison Between the Exact Likelihood and Whittle Likelihood for Moving Average Processes
Keywords:Gaussian stationary process, Spectral density, Likelihood function, Whittle likelihood, Moving average process
For Gaussian stationary processes, the likelihood functions include the inverse and determinant of the covariance matrices, and Whittle likelihood is considered as a standard technique to avoid expensive matrix determinant and inversions under large sample size. In this paper, we investigate the difference between the exact likelihood and Whittle likelihood with finite sample size for moving average processes of order one. We elucidate the theoretical expressions of two likelihood functions and their expectations and evaluate the performance between exact likelihood and Whittle likelihood numerically. We find that the exact likelihood and Whittle likelihood perform similarly when the true value of parameter is close to zero, while the difference becomes large and Whittle estimator performs poorly when absolute value of parameter gets close to one. This is an important warning when we use the Whittle likelihood and estimator if the parameter of moving average process nears the boundary of parameter space.
T. ANDERSON (1977). Estimation for autoregressive moving average models in the time and frequency domains. The Annals of Statistics, 5, no. 5, pp. 842–865.
T. W. ANDERSON (1971). The statistical analysis of time series, vol. 19. John Wiley & Sons.
M. DOW (2002). Explicit inverses of toeplitz and associated matrices. ANZIAM Journal, 44, pp. E185–E215.
Y. FUJIKOSHI, Y.OCHI (1984). Asymptotic properties of the maximum likelihood estimate in the first order autoregressive process. Annals of the Institute of Statistical Mathematics, 36, no. 1, pp. 119–128.
L. GIRAITIS, M. S. TAQQU (1999). Whittle estimator for finite-variance non-gaussian time series with long memory. The Annals of Statistics, 27, no. 1, pp. 178–203.
Y.HOSOYA, M. TANIGUCHI (1982). A central limit theorem for stationary processes and the parameter estimation of linear processes. The Annals of Statistics, pp. 132–153.
P. KETZ (2018). Subvector inference when the true parameter vector may be near or at the boundary. Journal of Econometrics, 207, no. 2, pp. 285–306.
A. C.MONTI, M. TANIGUCHI (2018). Adjustments for a class of tests under nonstandard conditions. Statistica Sinica, 28, no. 3, pp. 1437–1458.
M. TANIGUCHI (1983). On the second order asymptotic efficiency of estimators of Gaussian ARMA processes. The Annals of Statistics, pp. 157–169.
M. TANIGUCHI, Y. KAKIZAWA (2000). Asymptotic theory of statistical inference for time series. Springer Science & Business Media.
P.WHITTLE (1961). Gaussian estimation in stationary time series. Bull. Internat. Statist. Inst., 39, pp. 105–129.
How to Cite
Copyright (c) 2022 Statistica
This work is licensed under a Creative Commons Attribution 3.0 Unported License.