0

Whenever I encounter articles on supervised learning examples are things like regression, classification, object detection, which are obviously ones following frequentist approach.

I've recently studied generative models, which are basically Bayesian approach since it learns whole distribution, not just a parameter, and found some explanation saying that generative models can be trained using supervised learning (i.e, using labels)

Is supervised learning just the concept about the methodology, in which labels are used or not? Are the common examples suggested above just for ease of understanding, but not the concept itself?

Rhee
  • 111
  • 2

2 Answers2

5

Loosely speaking, supervised learning means that you have labels for the data (all the clustering and regression), while unsupervised learning that you don't (e.g. clustering).

Bayesian inference is just another way of thinking of the models, parameters, and estimating them. So there is Bayesian linear regression, ridge regression, logistic regression, you can use Bayesian estimation for parameters of neural networks, etc. All those are supervised learning algorithms. There are also clustering (unsupervised) Bayesian models. So Bayesian inference has nothing to do with supervised/unsupervised classification of algorithms.

Tim
  • 108,699
  • 20
  • 212
  • 390
2

Of course. There are even Bayesian neural networks.

There is nothing about the Bayesian approach that conflicts with the presence of labels in your dataset.

Josh Bone
  • 123
  • 7