NO : WP-2025-020
AUTHOR : Dilip M.Nachane
TITLE : MAXIMUM ENTROPY SPECTRAL ANALYSIS
ABSTRACT :
The maximum entropy principle is characterized as assuming the least about the unknown parameters in a statistical model. In its applied manifestations, it uses all the available information and makes the fewest possible assumptions regarding the unavailable information. The application of this principle to parametric spectrum estimation leads to an autoregressive transfer function. By appeal to a well known theorem in stochastic processes, a rational transfer function leads to a factorizable spectrum. This result combined with a classical theorem of analysis (due to Szeg̈) forms the basis for two important algorithms for estimating the autoregressive spectrum viz. the Levinson-Durbin and Burg algorithms. The latter leads to estimators which are asymptotically MLEs (maximum likelihood estimators).
Keywords: Entropy—Jaynes’ Principle-autoregressive spectrum-spectral factorization-Levinson-Durbin-Burg-MLE
JEL Code: C22, C32
Weblink: http://www.igidr.ac.in/pdf/publication/WP-2025-020.pdf