Super basic question about the BIC — is it defined in terms of log base ten or the natural logarithm? I see the latter on Wikipedia; but see ‘log’ not ‘ln’ in the original paper (though am aware that ‘log’ can mean ‘ln’...)
Asked
Active
Viewed 100 times
0
-
Here $\log$ means the natural log, *logarithmus naturali*, or `ln`. – AdamO Feb 19 '21 at 16:22
-
Also related: https://stats.stackexchange.com/questions/205312/in-statistics-should-i-assume-log-to-mean-log-10-or-the-natural-logarit – AdamO Feb 19 '21 at 16:37
2 Answers
2
Note that $\log_b(x)=\frac{\log_a(x)}{\log_a(b)} =: c \log_a(x)$. In that sense, all logs are proportional. So they all have the same order. In statistics, the logarithms are often not distinguished for this reason. I saw people use “log” for cases where they don’t care about the base (as it just leads to a different constant).
In this specific case, using a different base will change the result. You’re minimizing something $+ c \ln(d)$, where $c$ is a constant which is determined by the basis of choice. So, if you choose a different basis, the penalty becomes larger (or smaller).
knrumsey
- 5,943
- 17
- 40
Idontgetit
- 141
- 3
1
If one isn't clarifying the base when calling "log" normally the natural logarithm is meant. And so it is the case here as well.
-
2At least in statistics that's the convention. Other fields may be different! – kjetil b halvorsen Feb 19 '21 at 16:29
-
2I'd say that introductory statistics texts and courses might mean log base 10 when they say log, but once past that stage the default surely changes to natural logarithms. Halmos called ln “a textbook vulgarization", Not for me to say he was wrong. I use it all the time -- when among geographers and kin -- to disambiguate. – Nick Cox Feb 19 '21 at 16:35
-
1Some authors in some fields e.g. in information theory use base 2 as a default. If you're talking about bits, that is a natural convention. – Nick Cox Feb 20 '21 at 10:24