Derivations of Learning Statistics from Absorbing Markov Chains

Publisher Website
Google Scholar
Abstract
Learning-process statistics for absorbing Markov-chain models are developed by using matrix methods exclusively. The paper extends earlier work by Bernbach by deriving the distribution of the total number of errors, u-tuples, autocorrelation of errors, sequential statistics, and the expectation and variance of all statistics presented. The technique is then extended to latency derivations including the latencies of sequential statistics. Suggestions are made for using the sequential-statistic algorithm in a maximum-likelihood estimation procedure. The technique is important because statistics for very large absorbing matrices can be easily computed without going through tedious theoretical calculations to find explicit mathematical expressions.