1

One of the images that i recently noticed on the internet that compares machine learning and Deep learning is this:

enter image description here

What I understood from it is, deep learning performance is not limited when we increase the amount of data for learning "training" ..

So, is this feature restricted to the specific structure of a model!? for example, if I have a Deep neural network with a 10 layers and each layer contains 8 hidden units! if i continue increase the amount of data, Do the performance will still increase, or i have to build another complex one more number of layers and units?

Minions
  • 135
  • 5
  • 3
    Related thread: https://stats.stackexchange.com/questions/310958/reference-showing-that-only-deep-learning-algorithms-benefit-from-using-huge-dat – Tim Feb 15 '18 at 10:56

1 Answers1

5

This is an over simplified and misleading plot. Ultimately performance is determined by the quality of the predictors and the signal to noise ratio. Adding more rows of data (more examples) may help with SNR but can't improve the quality of the predictors, whether you take a deep learning or alternative approach. The unbounded trend in the plot suggests perfect prediction is attainable if only one had enough data. The truth is that in many contexts deep learning will perform no better than other approaches. It may perform better, particularly when you add more columns (predictors), but this is certainly not guaranteed.

HEITZ
  • 1,682
  • 7
  • 15