I am currently reading the book called “Intro to Statistical Learning”. Here, it firstly generates new samples by simulation (1000) to get population mean and then estimates std.err. But then states that
In practice, we can not generate new samples from original population ...
and chooses “Bootstrapping”.
In this approach we obtain distinct samples by repeatedly sampling from the original (real) data set and this approach allows some observation to be repeated more than once in a given sample.
So, my question is that don't we follow the same procedure in the “bootstraping” because here we also somehow generate new samples from the data implementing some kind of simulation? What does it mean (the sentence quoted above)? Consequently, what is the difference?
Source -- The introduction to statistical learning, Chapter 5.2, page 188-189