Abstract
Solomonoff's central result on induction is that the posterior of a universal semimeasure M converges rapidly and with probability 1 to the true sequence generating posterior μ, if the latter is computable. Hence, M is eligible as a universal sequence predictor in case of unknown μ. Despite some nearby results and proofs in the literature, the stronger result of convergence for all (Martin-Löf) random sequences remained open. Such a convergence result would be particularly interesting and natural, since randomness can be defined in terms of M itself. We show that there are universal semimeasures M which do not converge for all random sequences, i.e. we give a partial negative answer to the open problem. We also provide a positive answer for some non-universal semimeasures. We define the incomputable measure D as a mixture over all computable measures and the enumerable semimeasure W as a mixture over all enumerable nearly-measures. We show that W converges to D and D to μ. on all random sequences. The Hellinger distance measuring closeness of two distributions plays a central role.
| Original language | English |
|---|---|
| Pages (from-to) | 234-248 |
| Number of pages | 15 |
| Journal | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
| Volume | 3244 |
| DOIs | |
| Publication status | Published - 2004 |
| Externally published | Yes |
| Event | 15th International Conference ALT 2004: Algorithmic Learning Theory - Padova, Italy Duration: 2 Oct 2004 → 5 Oct 2004 |
Fingerprint
Dive into the research topics of 'Universal convergence of semimeasures on individual random sequences'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver