8

Techniques like Adaboost use a ensemble of weak classifiers to obtain a "better" classifier.

Does(Can) the final classifier have a greater VC-dimension than the weak classifier?

An intuitive explanation would suffice.

Franck Dernoncourt
  • 42,093
  • 30
  • 155
  • 271
shyamupa
  • 383
  • 2
  • 9
  • 1
    Well, just thinking about the definition of VC-dimension, do you think (say) boosted decision stumps can shatter a larger number of points than a single decision stump? – guy Nov 29 '13 at 22:31

1 Answers1

2

It depends on the ensemble method you use. Usually the VC-dimension increases. But in the case of AdaBoost, you can find the answer here: http://www.cs.princeton.edu/courses/archive/spr08/cos511/scribe_notes/0305.pdf http://cseweb.ucsd.edu/~yfreund/papers/IntroToBoosting.pdf

Daniel
  • 1,366
  • 8
  • 13