On universal prediction and Bayesian confirmation

Marcus Hutter*

*Corresponding author for this work

    Research output: Contribution to journalArticlepeer-review

    64 Citations (Scopus)

    Abstract

    The Bayesian framework is a well-studied and successful framework for inductive reasoning, which includes hypothesis testing and confirmation, parameter estimation, sequence prediction, classification, and regression. But standard statistical guidelines for choosing the model class and prior are not always available or can fail, in particular in complex situations. Solomonoff completed the Bayesian framework by providing a rigorous, unique, formal, and universal choice for the model class and the prior. I discuss in breadth how and in which sense universal (non-i.i.d.) sequence prediction solves various (philosophical) problems of traditional Bayesian sequence prediction. I show that Solomonoff's model possesses many desirable properties: strong total and future bounds, and weak instantaneous bounds, and, in contrast to most classical continuous prior densities, it has no zero p(oste)rior problem, i.e. it can confirm universal hypotheses, is reparametrization and regrouping invariant, and avoids the old-evidence and updating problem. It even performs well (actually better) in non-computable environments.

    Original languageEnglish
    Pages (from-to)33-48
    Number of pages16
    JournalTheoretical Computer Science
    Volume384
    Issue number1
    DOIs
    Publication statusPublished - 24 Sept 2007

    Fingerprint

    Dive into the research topics of 'On universal prediction and Bayesian confirmation'. Together they form a unique fingerprint.

    Cite this