Agnostic learning nonconvex function classes

Shahar Mendelson, Robert C. Williamson

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    6 Citations (Scopus)

    Abstract

    We consider the sample complexity of agnostic learning with respect to squared loss. It is known that if the function class F used for learning is convex then one can obtain better sample complexity bounds than usual. It has been claimed that there is a lower bound that showed there was an essential gap in the rate. In this paper we show that the lower bound proof has a gap in it. Although we do not provide a definitive answer to its validity. More positively, we show one can obtain "fast" sample complexity bounds for nonconvex F for "most" target conditional expectations. The new bounds depend on the detailed geometry of F, in particular the distance in a certain sense of the target's conditional expectation from the set of nonuniqueness points of the class F.

    Original languageEnglish
    Title of host publicationComputational Learning Theory - 15th Annual Conference on Computational Learning Theory, COLT 2002, Proceedings
    EditorsJyrki Kivinen, Robert H. Sloan
    PublisherSpringer Verlag
    Pages1-13
    Number of pages13
    ISBN (Electronic)354043836X, 9783540438366
    DOIs
    Publication statusPublished - 2002
    Event15th Annual Conference on Computational Learning Theory, COLT 2002 - Sydney, Australia
    Duration: 8 Jul 200210 Jul 2002

    Publication series

    NameLecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science)
    Volume2375
    ISSN (Print)0302-9743

    Conference

    Conference15th Annual Conference on Computational Learning Theory, COLT 2002
    Country/TerritoryAustralia
    CitySydney
    Period8/07/0210/07/02

    Fingerprint

    Dive into the research topics of 'Agnostic learning nonconvex function classes'. Together they form a unique fingerprint.

    Cite this