I am doing multiclass classification for 3 labell with neural net. The model works fine but when I check precision/recall per label in validation set I can see that precision is a little bit too low to be acceptable for one label only.
I have introduced threshold only for this label, if score is below this threshold I classify with label 'other'.
E.g threshold 0.8 for label 'third_label'
1)
proba = [0.2, 0.1, 0.7]
predicted_label -> 'other'
2)
proba = [0.1, 0.1, 0.8]
predicted_label -> 'third_label'
3)
proba = [0.4, 0.3, 0.3]
predicted_label -> 'first_label'
I have obtained acceptable threshold by try and error on validation dataset. Do I do something wrong, do I miss something?