Resources
A nutritionist measures the effect of a low-sodium diet on systolic blood pressure () across hypertensive patients, recording the difference as . The sample mean reduction is with sample standard deviation . (a) State the null and alternative hypotheses for testing if the diet reduces blood pressure, set up the test statistic , and determine whether the result is statistically significant at ( for ). (b) A novice researcher incorrectly defines the difference as , obtains , and mistakenly concludes: 'Because is negative and the -value for is , the diet significantly raised blood pressure and was harmful.' Diagnose this sign convention trap and state the correct one-tailed -value for the test of blood pressure reduction. (c) If cardiologists define practical significance as a mean systolic reduction of at least , evaluate the practical significance of the observed sample result.
Answer and steps
Final answer
(a) versus . . Because , we fail to reject at (); the reduction is not statistically significant. (b) The researcher fell into a sign convention trap: defining post minus pre reverses the sign of improvement to negative, requiring . The correct one-tailed -value for a reduction is , not . (c) With , the observed sample mean does not reach the clinical benchmark of ; hence, it lacks practical significance while also failing to achieve statistical significance at .
Steps
Part (a): Hypotheses, Test Statistic, and Statistical Significance
-
State the Hypotheses: Since the difference is defined as a reduction, , a positive value indicates that blood pressure decreased.
- Null hypothesis (): The diet has no effect on blood pressure:
- Alternative hypothesis (): The diet reduces blood pressure (one-tailed test):
- Compute the Standard Error ():
- Calculate the -statistic:
-
Make the Decision:
- Degrees of freedom: .
- The critical value for a one-tailed test at is .
- Comparing the values:
- Because the test statistic is slightly less than the critical value (corresponding to ), we fail to reject at the significance level. The sample reduction is not statistically significant.
Part (b): Diagnosing the Sign Convention Trap
-
The Nature of the Trap:
- Defining the change as means a decrease in blood pressure produces a negative number (e.g., ).
- Therefore, evidence of a reduction corresponds to the lower tail: .
- The researcher kept the alternative hypothesis as while using the negative sample mean. Testing the upper tail when the test statistic is computes the area to the right:
- A large -value in the wrong tail simply means the data do not support an increase in blood pressure; it does not indicate that the diet was harmful.
-
Correct One-Tailed -value:
- For a reduction under the convention, the correct upper-tail or lower-tail equivalence is:
Part (c): Evaluating Practical Significance
- Statistical Significance vs. Practical Significance:
- Statistical significance addresses whether an observed effect is likely due to chance given the sample size ().
- Practical significance (clinical relevance) addresses whether the magnitude of the effect is large enough to be meaningful in the real world.
- Evaluation:
- Cardiologists established that a clinically meaningful reduction must be at least .
- The observed mean reduction is , which is substantially smaller than the threshold ().
- Therefore, the observed reduction lacks practical significance, in addition to failing to meet the threshold for statistical significance at .
Typical errors
01 The student forgets to divide the sample standard deviation by the square root of n when computing the test statistic.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
- Step 2Correct
You divided by the sample standard deviation instead of the standard error of the mean .
- Step 3Correct
Your comparison logic was correct, but it relied on your incorrect -value of rather than .
- Step 4
- Step 5
WHAT YOU DID WELL
Compliments from Your TeacherYou stated the correct one-sided hypotheses for blood pressure reduction.
You clearly identified that a negative post-pre difference corresponds to an improvement rather than harm.
You correctly calculated the one-tailed -value as .
You properly evaluated practical significance against the clinical threshold.
THE ERROR
Where Your ACEpath Teacher Spotted the MistakeYou substituted the raw sample standard deviation into the denominator of the -statistic instead of the standard error .
WHY IT HAPPENED
ACEpath Teacher's DiagnosisConfusing the spread of individual observations () with the spread of the sample mean () when standardizing a sample statistic.
REASONING PATH
Your ACEpath teacher’s suggested approach- Standard Deviation vs. Standard Error
The denominator of a one-sample -test is always the standard error of the mean, , not the individual standard deviation .
Always compute first before forming the test statistic ratio.
CORRECTED PATH
ACEpath Teacher's Demonstration(a) , fail to reject ; not statistically significant. (b) Reversing subtraction makes reduction negative (); correct -value is . (c) Because , the reduction lacks practical significance.
02 The student uses degrees of freedom n = 16 to find the standard error or critical value rather than recognizing df = 15, and misinterprets t > 1.75 as significant by confusing borderline rounding.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
- Step 2Correct
Because , fail to reject ; the reduction is not statistically significant at .
In hypothesis testing, the rejection region requires the test statistic to strictly meet or exceed the critical threshold ( for an upper-tailed test). Approximating crosses the decision boundary; since , the result fails to reach statistical significance.
- Step 3
- Step 4
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly set up the one-sided null and alternative hypotheses.
You calculated the standard error and test statistic with complete arithmetic accuracy.
You correctly diagnosed the sign reversal trap in part (b) and deduced the proper tail probability.
You accurately distinguished practical significance from statistical significance by comparing the sample mean to the clinical threshold.
THE ERROR
Where Your ACEpath Teacher Spotted the MistakeYou treated as approximately equal to and used that approximation to reject .
WHY IT HAPPENED
ACEpath Teacher's DiagnosisYou relaxed the strict inequality requirement for statistical significance. In critical-value testing, the test statistic must fall strictly inside the critical region (). Even a tiny gap where means the data remain consistent with at the specified level.
REASONING PATH
Your ACEpath teacher’s suggested approach- Strict Rejection Threshold
For an upper-tailed test at significance level , reject if and only if (or ).
Never round or approximate a test statistic across the critical value boundary; preserve all precision when comparing to .
CORRECTED PATH
ACEpath Teacher's DemonstrationCompare the exact test statistic to the critical value: and .
Observe that , which places outside the rejection region.
Conclude that we fail to reject at .
(a) , fail to reject ; the reduction is not statistically significant. (b) A negative change signifies improvement under ; the correct one-tailed -value is (). (c) Because , the result lacks practical significance.
03 The student conflates statistical significance with practical significance, believing that practical significance depends solely on a small p-value rather than the magnitude of the effect.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
- Step 2
A negative difference under indicates blood pressure dropped, meaning the diet reduced blood pressure. The appropriate one-tailed -value is .
- Step 3
Practical significance requires statistical significance first, so because the test was not significant at [crossed out: ], it cannot be practically significant regardless of the cutoff.
CorrectCompare the observed sample mean reduction directly to the clinical benchmark: , meaning the effect fails to reach the threshold for practical significance.
You incorrectly stated that practical significance requires statistical significance as a prerequisite. Practical significance is an independent evaluation of whether the magnitude of an observed effect (ar{x} = 2.80\text{ mmHg}) is meaningful in a real-world clinical context relative to the benchmark ().
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly formulated the one-sided null and alternative hypotheses.
You accurately calculated the standard error and test statistic.
You correctly compared the test statistic to the critical value to conclude that the result was not statistically significant.
You clearly identified how reversing the subtraction order inverted the sign of the effect in part (b).
THE ERROR
Where Your ACEpath Teacher Spotted the Mistakeno
WHY IT HAPPENED
ACEpath Teacher's DiagnosisYou treated practical significance as a hierarchical downstream outcome of a hypothesis test rather than an independent domain-specific assessment of effect size.
REASONING PATH
Your ACEpath teacher’s suggested approach- Evaluate effect magnitude directly
Practical significance measures whether an effect size is large enough to matter in practice, regardless of sample size or hypothesis test outcomes.
Always compare the point estimate (or confidence interval) directly against the practical threshold value.
CORRECTED PATH
ACEpath Teacher's DemonstrationIdentify the practical/clinical threshold: .
Compare the observed sample reduction to the clinical threshold: .
State whether the observed reduction meets the standard of practical importance.
Because the observed mean reduction of is less than the required clinical threshold of , the result is not practically significant.
Lock it in
What is the formula for the denominator in a one-sample -test statistic ?
. It represents the standard error of the sample mean, not the raw standard deviation .
Similar question
A researcher tests a new study technique on students. The mean test score gain is points with sample standard deviation points. Calculate the standard error of the mean and the test statistic for .
Answer
. Then .
In a matched-pairs experiment with subjects, the mean reduction in cholesterol is with . A clinical benchmark requires a reduction of at least to be considered practically significant. (1) Find the test statistic for vs. . (2) Does the result meet practical significance?
Answer
(1) ; . (2) No; the observed sample mean of is below the clinical threshold of , so it lacks practical significance.
An analyst tests versus where . The sample size is , , and . (1) Calculate the test statistic . (2) If a colleague mistakenly evaluated the right-tail probability and got , what is the correct one-tailed -value?
Answer
(1) ; . (2) Because the test is left-tailed, the correct -value is .