TY - JOUR
T1 - On semimeasures predicting Martin-Löf random sequences
AU - Hutter, Marcus
AU - Muchnik, Andrej
PY - 2007/9/6
Y1 - 2007/9/6
N2 - Solomonoff's central result on induction is that the prediction of a universal semimeasure M converges rapidly and with probability 1 to the true sequence generating predictor μ, if the latter is computable. Hence, M is eligible as a universal sequence predictor in the case of unknown μ. Despite some nearby results and proofs in the literature, the stronger result of convergence for all (Martin-Löf) random sequences remained open. Such a convergence result would be particularly interesting and natural, since randomness can be defined in terms of M itself. We show that there are universal semimeasures M which do not converge to μ on all μ-random sequences, i.e. we give a partial negative answer to the open problem. We also provide a positive answer for some non-universal semimeasures. We define the incomputable measure D as a mixture over all computable measures and the enumerable semimeasure W as a mixture over all enumerable nearly measures. We show that W converges to D and D to μ on all random sequences. The Hellinger distance measuring closeness of two distributions plays a central role.
AB - Solomonoff's central result on induction is that the prediction of a universal semimeasure M converges rapidly and with probability 1 to the true sequence generating predictor μ, if the latter is computable. Hence, M is eligible as a universal sequence predictor in the case of unknown μ. Despite some nearby results and proofs in the literature, the stronger result of convergence for all (Martin-Löf) random sequences remained open. Such a convergence result would be particularly interesting and natural, since randomness can be defined in terms of M itself. We show that there are universal semimeasures M which do not converge to μ on all μ-random sequences, i.e. we give a partial negative answer to the open problem. We also provide a positive answer for some non-universal semimeasures. We define the incomputable measure D as a mixture over all computable measures and the enumerable semimeasure W as a mixture over all enumerable nearly measures. We show that W converges to D and D to μ on all random sequences. The Hellinger distance measuring closeness of two distributions plays a central role.
KW - Algorithmic information theory
KW - Martin-Löf randomness
KW - Mixture distributions
KW - Predictive convergence
KW - Quasimeasures
KW - Sequence prediction
KW - Supermartingales
KW - Universal enumerable semimeasure
UR - http://www.scopus.com/inward/record.url?scp=34547917200&partnerID=8YFLogxK
U2 - 10.1016/j.tcs.2007.03.040
DO - 10.1016/j.tcs.2007.03.040
M3 - Article
SN - 0304-3975
VL - 382
SP - 247
EP - 261
JO - Theoretical Computer Science
JF - Theoretical Computer Science
IS - 3
ER -