Resources
An educational researcher compares a peer-tutoring method to standard lecture instruction for an introductory statistics unit. A sample of students taught via peer tutoring achieves a mean exam score of with , while a sample of students taught via traditional lecture achieves with . (a) Determine the pooled standard deviation and the standardized effect size (Cohen's ). (b) Rather than reporting a simple -value, calculate the confidence interval for the true difference in population means using degrees of freedom (critical value ). (c) Interpret whether the difference is both statistically significant at and practically significant if course coordinators consider any effect size with practically meaningful.
Answer and steps
Final answer
(a) ; Cohen's . (b) Standard error ; Margin of error ; CI is , or points. (c) The intervention is statistically significant at because is not contained in the CI (), and it is practically significant because , indicating a moderate, pedagogically substantial improvement.
Steps
Part (a): Calculate the Pooled Standard Deviation and Cohen's
When comparing two independent groups with assumed equal variances, the pooled sample standard deviation is a weighted average of the two sample standard deviations:
Since both groups have equal sample sizes (), the formula simplifies to the root-mean-square of the two sample standard deviations:
Next, Cohen's measures the standardized effect size, representing the mean difference in units of pooled standard deviation:
Part (b): Calculate the Confidence Interval for
-
Calculate the Standard Error ():
-
Calculate the Margin of Error (): Using the given critical value for :
-
Construct the Confidence Interval: The point estimate of the difference is:
Therefore, the interval is:
Part (c): Evaluate Statistical and Practical Significance
- Statistical Significance: A hypothesis test at significance level checks whether the null value of zero difference () is plausible. Because is entirely outside the confidence interval , the observed difference is statistically significant at .
- Practical Significance: Practical significance depends on the magnitude of the effect in context rather than just sample size. Since the standardized effect size is , which exceeds the coordinator's threshold of (conventionally considered a medium-to-large effect in education), the tutoring intervention also demonstrates practical significance.
Pitfall to Avoid: A statistically significant result ( or ) merely indicates that the observed difference is unlikely due to random sampling variability; it does not guarantee that the difference is large enough to be meaningful in the real world. Both statistical significance and effect size must be evaluated together.
Typical errors
01 The student averages the sample standard deviations directly instead of pooling variances, which distorts the pooled standard deviation and effect size calculation.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1Correct
You averaged the standard deviations directly ( and ). Standard deviations cannot be averaged linearly; you must pool the sample variances ( and ) by taking their weighted mean and then taking the square root.
- Step 2Correct
Your formula for Cohen's is correct, but your calculation carried forward the unpooled value from Step 1.
- Step 3Correct
Your steps for standard error, margin of error, and confidence interval are mathematically sound, though they relied on the unpooled standard deviation from Step 1.
- Step 4
The difference is statistically significant because is not in the confidence interval. It is practically significant because .
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly applied the formula for Cohen's using the mean difference and a standard deviation estimate.
You calculated the standard error, margin of error, and confidence interval correctly from your intermediate values.
You properly distinguished statistical significance (zero outside the confidence interval) from practical significance ().
THE ERROR
Where Your ACEpath Teacher Spotted the Mistakeno
WHY IT HAPPENED
ACEpath Teacher's DiagnosisYou treated sample standard deviations as additive quantities rather than recognizing that variance is the additive measure of dispersion, requiring a root-mean-square combination.
REASONING PATH
Your ACEpath teacher’s suggested approach- Pooling Variances vs. Averaging Standard Deviations
, so
Never compute ; always square the sample standard deviations, weight by their degrees of freedom, and take the square root of the pooled variance.
CORRECTED PATH
ACEpath Teacher's DemonstrationCompute the pooled variance:
Take the square root:
Recalculate effect size:
Recalculate standard error:
(a) , ; (b) ; (c) Statistically significant because ; practically significant because .
02 The student mistakenly omits the square root over the sample size term when calculating standard error, leading to an erroneously wide confidence interval.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
\n
- Step 2Correct
You omitted the square root over the sample size factor . The standard error is the square root of the variance of the difference between means.
- Step 3Correct
You correctly multiplied your standard error by and constructed the interval around , but the numerical limits were affected by the standard error calculation error in Step 2.
- Step 4
Statistically significant because is not in the interval . \n Practically significant because .
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly calculated the pooled standard deviation and Cohen's .
You correctly identified the critical value multiplication step for the margin of error.
You correctly interpreted statistical significance using the confidence interval.
You properly evaluated practical significance against the designated effect size threshold.
THE ERROR
Where Your ACEpath Teacher Spotted the MistakeYou forgot to place the radical over the term when calculating the two-sample standard error.
WHY IT HAPPENED
ACEpath Teacher's DiagnosisConfusing the pooled variance formula with the standard error formula: the pooled variance is scaled by , so the standard error (which is a standard deviation) must place that factor under a square root: .
REASONING PATH
Your ACEpath teacher’s suggested approach- Standard Error Formula Structure
Always check that the sample sizes inside the standard error are under a square root, ensuring that units match standard deviations rather than variances.
CORRECTED PATH
ACEpath Teacher's DemonstrationRecalculate the standard error with the square root included: .
Recalculate the margin of error: .
Construct the corrected confidence interval: .
(a) , ; (b) CI is ; (c) Statistically significant because , and practically significant because .
03 The student misinterprets practical significance as requiring d to strictly exceed rather than be greater than or equal to the threshold, or confuses the threshold rule.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
- Step 2
- Step 3
Statistically significant because the confidence interval excludes .
- Step 4
Not practically significant because statistical significance does not imply practical significance, and the lower bound of difference is too small to be meaningful.
CorrectPractically significant because , meeting the coordinator's predefined practical significance threshold.
While it is true that statistical significance does not guarantee practical significance, the prompt defined practical significance using the objective threshold . Since your calculated value of satisfies , the tutoring intervention is practically significant.
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly calculated the pooled standard deviation and standardized effect size ().
You correctly computed the standard error, margin of error, and confidence interval.
You accurately evaluated statistical significance using the confidence interval.
THE ERROR
Where Your ACEpath Teacher Spotted the Mistakeconceptual
WHY IT HAPPENED
ACEpath Teacher's DiagnosisYou correctly recognized the conceptual distinction between statistical and practical significance, but you relied on an informal, subjective assessment of the confidence interval's lower bound instead of checking the standardized effect size against the given operational threshold ().
REASONING PATH
Your ACEpath teacher’s suggested approach- Statistical Significance Criterion
Statistical significance at occurs when the -value , or equivalently when lies outside the confidence interval for .
Check whether is contained within the confidence interval.
- Practical Significance Criterion
Practical significance is determined by comparing an effect size measure (such as Cohen's ) against a domain-specific threshold (here, ).
Compare the calculated effect size directly to the established cutoff value rather than making an arbitrary judgment on raw point values.
CORRECTED PATH
ACEpath Teacher's DemonstrationIdentify the given criterion for practical significance: .
Recall the calculated effect size from part (a): .
Compare the value to the threshold: is true.
Conclude that the intervention satisfies the criterion for practical significance.
The difference is both statistically significant (because ) and practically significant (because ).
Lock it in
Why is when combining two independent samples with equal sample sizes?
Variances () are additive and can be averaged, but standard deviations are non-linear; the correct formula is .
Similar question
Two classes take a chemistry test. Group A has , ; Group B has , . Calculate the pooled standard deviation .
Answer
Since , .
In an experiment comparing two training programs, points with . The confidence interval for is . Is the difference statistically significant at ? Is it practically significant if the threshold for a meaningful effect is ?
Answer
- Statistically significant: Yes, because lies entirely outside . 2. Practical significance: . Since , it is not practically significant.
Group 1 has , , . Group 2 has , , . Compute and Cohen's .
Answer
- , , . 2. . 3. .