On the existence and convergence of computable universal priors

Marcus Hutter*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

14 Citations (Scopus)

Abstract

Solomonoff unified Occam’s razor and Epicurus’ principle of multiple explanations to one elegant, formal, universal theory of inductive inference, which initiated the field of algorithmic information theory. His central result is that the posterior of his universal semimeasure M converges rapidly to the true sequence generating posterior μ, if the latter is computable. Hence, M is eligible as a universal predictor in case of unknown μ. We investigate the existence and convergence of computable universal (semi)measures for a hierarchy of computability classes: finitely computable, estimable, enumerable, and approximable. For instance, M is known to be enumerable, but not finitely computable, and to dominate all enumerable semimeasures. We define seven classes of (semi)measures based on these four computability concepts. Each class may or may not contain a (semi)measure which dominates all elements of another class. The analysis of these 49 cases can be reduced to four basic cases, two of them being new. We also investigate more closely the types of convergence, possibly implied by universality: in difference and in ratio, with probability 1, in mean sum, and for Martin-Löf random sequences. We introduce a generalized concept of randomness for individual sequences and use it to exhibit difficulties regarding these issues.

Original languageEnglish
Title of host publicationAlgorithmic Learning Theory - 14th International Conference, ALT 2003, Proceedings
EditorsRicard Gavalda, Klaus P. Jantke, Eiji Takimoto
PublisherSpringer Verlag
Pages298-312
Number of pages15
ISBN (Print)3540202919, 9783540202912
DOIs
Publication statusPublished - 2003
Externally publishedYes
Event14th International Conference on Algorithmic Learning Theory, ALT 2003 - Sapporo, Japan
Duration: 17 Oct 200319 Oct 2003

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume2842
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th International Conference on Algorithmic Learning Theory, ALT 2003
Country/TerritoryJapan
CitySapporo
Period17/10/0319/10/03

Fingerprint

Dive into the research topics of 'On the existence and convergence of computable universal priors'. Together they form a unique fingerprint.

Cite this