I have a dataset of 150 observations and I want to make a linear model to try to explain relations. I use backwards regression. When I keep all variables (10), I have an adjusted R² value of 0.8076. When I remove the variables with p-values higher than 5% in order from highest to lowest, the adjusted R² value goes up to 0.8189. This leaves me with 6 variables, which is still quite a lot. Adding the $log_{10}$ of one of the variables also improves the R² variable ever so slightly to 0.8259, doing this let's me remove a different variable since its p-value has rised to 16%. Removing more variables drops the adjusted R² value to $\approx$ 0.79xx depending on which variable I remove.
My question is, when should I stop removing variables? As soon as I see the adjusted R²-value drop or should I wait until my adjusted R² value drops below a certain value? Or should I look at something else?
Thanks in advance!