0

Reading this question and this question and the answers and comments, I have another question. Does the effect size of a normality test determine whether the normality assumption can be ignored for parametric tests with large samples?

The two examples I am particularly interested in right now are: normalizing data for an array of machine learning algorithms, some of which may employ parametric methods; comparing data using parametric tests like Student's t-test or MANOVA. I'm specifically using the Shapiro-Wilk test of normality, but I am also interested in other tests of normality.

I'm understanding that testing the normality of large samples with the Shapiro-Wilk test may produce statistically significant rejections of the null that are actually of no practical significance. The test may determine that the distribution deviates from normality, while in reality it is "normal enough" for all intents and purposes.

What do I mean by "normal enough" you ask? Thanks for asking. That's kind of the crux of the question, isn't it? How do we determine what's "normal enough" for a parametric test? Student's t-test is a good example, but I am interested to hear about how the answer may depend on the parametric test in question.

My hunch is that figuring out the effect size might somehow lend a practical interpretation to the statistical significance of the Shapiro-Wilk test and/or other tests of normality. But, I'm having trouble fleshing the idea out, and I wonder if anyone can help me with that, or perhaps set me straight if I'm barking up the wrong tree.

kjetil b halvorsen
  • 63,378
  • 26
  • 142
  • 467
Kaleb Coberly
  • 121
  • 3
  • 1
    I am not sure there is some agreed-upon concept of "effect size" for tests of normality, do you have some reference? And I cannot see that mentioned in the posts you link ... please tell us why you do need normality tests. Edit your Q to include that information and other context, please! – kjetil b halvorsen Jun 26 '21 at 17:29
  • @kjetilbhalvorsen, no, the linked posts don't mention effect size. That's why I'm asking about it. – Kaleb Coberly Jun 27 '21 at 16:15
  • @kjetilbhalvorsen, I need normality tests to check whether the assumption of normality is met for parametric tests that assume normality, per the OP. – Kaleb Coberly Jun 27 '21 at 16:16
  • 1
    I you have doubts about normality, perhaps consider going with a nonparametric method by default. By checking the data for normality, you run into issues involving multiple testing, and it might be more powerful to go with Wilcoxon Mann-Whitney U by default than to do a normality test and then a t-test once you adjust for multiple tests. (Frank Harrell takes this stance, if he has to be a frequentist.) – Dave Jun 27 '21 at 17:21
  • @Dave, that has been my approach when doing a hypothesis test, to use the Wilcoxon rank-sum test. But, I'm still curious about whether and when the assumption of normality may be ignored. – Kaleb Coberly Jul 08 '21 at 20:42

0 Answers0