I know what a regression line is.
What I'm curious about is the use of the word "regression". What's regressive about a regression line?
The etymology of "regression" is
early 15c., from Latin regressionem (nominative regressio) "a going back, a return," noun of action from past participle stem of regredi).
So, how is a regression line a "going back, a return"?