No free lunch versus Occam's Razor in supervised learning

Tor Lattimore, Marcus Hutter

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    20 Citations (Scopus)

    Abstract

    The No Free Lunch theorems are often used to argue that domain specific knowledge is required to design successful algorithms. We use algorithmic information theory to argue the case for a universal bias allowing an algorithm to succeed in all interesting problem domains. Additionally, we give a new algorithm for off-line classification, inspired by Solomonoff induction, with good performance on all structured (compressible) problems under reasonable assumptions. This includes a proof of the efficacy of the well-known heuristic of randomly selecting training data in the hope of reducing the misclassification rate.

    Original languageEnglish
    Title of host publicationAlgorithmic Probability and Friends
    Subtitle of host publicationBayesian Prediction and Artificial Intelligence - Papers from the Ray Solomonoff 85th Memorial Conference
    PublisherSpringer Verlag
    Pages223-235
    Number of pages13
    ISBN (Print)9783642449574
    DOIs
    Publication statusPublished - 2013
    EventRay Solomonoff 85th Memorial Conference on Algorithmic Probability and Friends: Bayesian Prediction and Artificial Intelligence - Melbourne, VIC, Australia
    Duration: 30 Nov 20112 Dec 2011

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume7070 LNAI
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    ConferenceRay Solomonoff 85th Memorial Conference on Algorithmic Probability and Friends: Bayesian Prediction and Artificial Intelligence
    Country/TerritoryAustralia
    CityMelbourne, VIC
    Period30/11/112/12/11

    Fingerprint

    Dive into the research topics of 'No free lunch versus Occam's Razor in supervised learning'. Together they form a unique fingerprint.

    Cite this