One-way ANOVA with a balanced K-group design is equivalent to a regression on the intercept and K-1 dummy variables. The quiz is on the correlation between any two dummy variable——positive, zero, or negative? One may think it is zero for any two dummy variables are orthogonal with one another. The answer will emerges after your click.
For a planned SINGLE comparison, the CI of can be interpreted as , in which . The and should be defined according to the denominator of .
For post hoc multiple comparisons, the CI of can still be interpreted as , wherein indicates the number of sub-groups whose means are compared. Note that qtukey(...) and ptukey(...) is defined with a two-tailed probability while qt(...) and pt(...) with a single-tailed one.
To verify it with a single click
Control group includes 150 Poisson (=2.3) cases;
Experiment group includes 200 cases, with fixed effect +1 which is unknown but interested in.
Researcher A chose Z test, considering the big sample sizes.
Researcher B chose Mann-Whitney-Wilcoxon Test, considering the non-normal distributions.
Whose confidence interval will beat?
Researcher A might complain: "Your CI width is actually from Poisson distribution. Most time it is actually zero. Let's try . It would be fairer for Z-Test to use a continual distribution."
Mann-Whitney-Wilcoxon plays better than his expectation even in the continual case.