Can someone explain in simple words and with many good down-to-earth examples what is the p-value and how do we find it?
Is it true that it shows what is the probability that the sample we have tested is true not simply by chance? Isn't that the point of the alpha level to guarantee that for an instance, for 95% of the time, it is not a chance that our hypothesis is true? For the rest of the 5% if it is true, it is by chance?
I will greatly appreciate if you can explain the difference between p-value and alpha level(significance level), how are they connected, what do they tell me for the "real world" and give me examples! (Because any mathematical explanation seems to confuse me more)
Thanks in advance!
PS: I am aware that there are questions about p-value with good explanations out there, would then just like to have answers for the other questions.