I have a binary dataset and I want to build a classifier. I understand that to monitor performance I need to split to training/test set and report accuracy or any other metrics that interest me on the test set. Now, I have a new example for which I do not know the label and I want to predict it using my classifier.
My question is: should I use the classifier that I built using the training set only or merge both training and test set, build a classifier based on all available data and then predict my new example while still reporting the accuracy based only on a the test set?