Is it necessary for the observations of the data set to be IID in order to use cross-validation on it? If so, why ? Could you explain in the context of a classification using decision tree.
Asked
Active
Viewed 219 times
4
-
1features or the samples? – gunes Jul 06 '20 at 10:25
-
1@gunes I mean the samples / rows of a data set – learner Jul 07 '20 at 01:37
1 Answers
2
Yes, the typical cross validation assumes iid samples, so that it can freely split the data into training and validation. In case of dependency, such as the temporal dependency in time series datasets, modifications respecting this dependency should be done for the splitting of data. Otherwise, there will be data leakage. See the following for an example of validation in non iid case: time series cross validation.
gunes
- 49,700
- 3
- 39
- 75