Resources
An environmental laboratory evaluates a new municipal water filtration media designed to remove lead. In standard units, the regulatory actionable threshold for lead in drinking water is (), and engineers specify that a filter achieves practical significance only if it lowers lead concentration by at least . In a pilot run of treated water samples, the effluent lead concentrations are recorded in parts per billion (ppb, where ), while the raw influent had a constant concentration of . The mean effluent concentration is with a standard deviation of . (a) Convert the influent concentration into (ppb), then calculate the sample mean lead reduction in . (b) Test against at ( for ). (c) Determine whether the filter demonstrates practical significance according to the engineering benchmark and municipal safety standards.
Answer and steps
Final answer
(a) . The mean reduction is . (b) . Since (), reject ; the lead reduction is statistically significant. (c) The filter fails the practical significance test on two counts: the mean reduction of is far below the engineering benchmark, and the resulting effluent lead level of remains above the EPA actionable safety threshold.
Steps
Part (a): Unit Conversion and Mean Lead Reduction
- Convert the influent concentration to (): Since , we multiply the concentration in by :
- Calculate the sample mean reduction : The influent level is constant at , and the mean effluent concentration is :
Part (b): Hypothesis Testing for Statistical Significance
- State the hypotheses:
- Compute the standard error of the mean: Because the influent level is constant, the standard deviation of the reduction is identical to that of the effluent samples, . With sample size :
- Calculate the -statistic:
- Conclusion at : For degrees of freedom , the critical value is . Because (which corresponds to ), we reject . There is statistically significant evidence that the filter produces a non-zero reduction in lead concentration.
Part (c): Practical Significance vs. Statistical Significance
- Pitfall to avoid: Confusing statistical significance with practical significance. Statistical significance simply confirms that the observed reduction of is unlikely to be due to chance variation alone (). It does not automatically mean the effect size is meaningful or useful in the real world.
-
Evaluating practical utility:
- Engineering criterion: The engineers require a reduction of at least . The observed average reduction of falls well short of this target.
- Regulatory safety threshold: The EPA actionable standard is . Even after filtration, the average effluent concentration is , which remains above the safe drinking limit.
Therefore, despite being statistically significant, the filtration media does not demonstrate practical significance.
Typical errors
01 The student confuses the standard error with the standard deviation and omits dividing s by √n when calculating the t-statistic.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
- Step 2Correct
You divided by the sample standard deviation alone rather than the standard error of the sample mean, .
- Step 3Correct
.
Because your calculated -statistic was artificially deflated by omitting , you concluded not to reject instead of rejecting it.
- Step 4
The filter does not achieve practical significance because reduction is not statistically significant, , and effluent .
CorrectThe lead reduction is statistically significant (), but it does not achieve practical significance because the mean reduction of is below the engineering threshold, and the effluent concentration of remains above the regulatory limit.
You accurately identified the engineering benchmark () and the actionable safety standard (). However, your explanation listed a lack of statistical significance as a contributing cause, which stems from the calculation error in part (b).
WHAT YOU DID WELL
Compliments from Your TeacherYou performed the unit conversion between and accurately.
You calculated the mean reduction between influent and effluent correctly.
You correctly cited the practical engineering requirement and municipal safety limit.
THE ERROR
Where Your ACEpath Teacher Spotted the MistakeYou wrote in the denominator of the -statistic instead of .
WHY IT HAPPENED
ACEpath Teacher's DiagnosisYou confused individual sample variability (standard deviation ) with the variability of the sample mean across repeated samples (standard error ).
REASONING PATH
Your ACEpath teacher’s suggested approach- One-Sample $t$-Test Statistic Formula
For inference about a population mean , the test statistic measures distance in standard errors: .
Always divide the sample standard deviation by to obtain the denominator before computing .
- Statistical vs. Practical Significance
Statistical significance () confirms an effect is unlikely due to random chance, whereas practical significance evaluates whether the magnitude of the effect meets operational or real-world thresholds.
Evaluate statistical significance solely using the test statistic and -value, and evaluate practical significance using effect sizes and contextual benchmarks.
CORRECTED PATH
ACEpath Teacher's DemonstrationCompute the standard error of the mean: .
Calculate the one-sample -statistic: .
Compare with the critical value: Since , reject at . The lead reduction is statistically significant.
Assess practical significance: Despite being statistically significant, the filter does not achieve practical significance because the mean reduction () is less than the required , and the treated water () still exceeds the regulatory limit.
(a) influent; . (b) ; reject (statistically significant reduction). (c) Fails practical significance because engineering threshold and EPA standard.
02 The student misinterprets statistical significance (rejecting H0) as automatically implying practical significance, ignoring the engineering benchmark of 8.0 µg/L and the regulatory limit.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
- Step 2
- Step 3Correct
Statistical significance only proves that the reduction is distinguishable from zero by chance. Practical significance requires evaluating whether the effect size () meets the required engineering goal () and safety limit ().
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly converted the influent concentration to parts per billion.
You accurately calculated the sample mean lead reduction.
You calculated the standard error and test statistic without arithmetic errors.
You properly evaluated the hypothesis test against the critical value and rejected the null hypothesis.
THE ERROR
Where Your ACEpath Teacher Spotted the Mistakeno
WHY IT HAPPENED
ACEpath Teacher's DiagnosisYou assumed that rejecting the null hypothesis with a very small -value automatically guarantees real-world or practical utility, rather than comparing the observed effect size against domain-specific benchmarks and thresholds.
REASONING PATH
Your ACEpath teacher’s suggested approach- Statistical vs. Practical Distinction
Statistical significance asks 'Is the effect non-zero beyond chance variation?'; practical significance asks 'Is the effect large enough to matter in practice?'
Always evaluate the magnitude of the point estimate against the practical thresholds specified in the problem statement.
- Contextual Benchmark Check
Practical utility requires meeting domain criteria: target effect size and safety compliance standards.
Compare to the engineering threshold () and the effluent level () to the regulatory limit ().
CORRECTED PATH
ACEpath Teacher's DemonstrationCompare the observed mean reduction to the engineering threshold of .
Observe that , meaning the filter does not meet the specified minimum performance standard.
Compare the remaining effluent concentration of to the municipal safety limit of , noting that water remains unsafe to drink.
Conclude that the filter does not achieve practical significance despite being statistically significant.
The filter does not demonstrate practical significance because its mean reduction of fails to reach the required benchmark, and the effluent concentration of still exceeds the regulatory safety threshold of .
03 The student uses an incorrect metric conversion factor of 10⁶ instead of 10³ from mg/L to µg/L, leading to an artificially massive reduction calculation.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1Correct
You multiplied by instead of to convert milligrams to micrograms. Because , the converted influent concentration is , which makes the mean reduction rather than .
- Step 2Correct
Your formula for standard error and your rejection rule comparison were mathematically sound, but your -statistic was heavily inflated because it inherited the incorrect reduction from part (a).
- Step 3
21980.5 8.0 19.50
Correct2.50,\mu$$\text{g/L} 8.0,\mu$$\text{g/L} 19.50,\mu$$\text{g/L} 15.0,\mu$$\text{g/L}
In addition to propagating the conversion mistake, treating an effluent concentration of as acceptable overlooks that regulatory safety standards are strict non-exceedance limits; is above the maximum allowed threshold.
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly calculated the standard error of the mean using .
You applied the correct critical value decision rule to reject when .
You recognized that evaluating practical significance requires checking both the engineering reduction target and the effluent safety standard.
THE ERROR
Where Your ACEpath Teacher Spotted the MistakeYou multiplied by instead of when converting from milligrams () to micrograms ().
WHY IT HAPPENED
ACEpath Teacher's DiagnosisConflating the conversion between grams and micrograms () with the conversion between milligrams and micrograms ().
REASONING PATH
Your ACEpath teacher’s suggested approach- Metric prefix bridge
, so .
Always convert through the base unit (grams) or directly apply the three-order-of-magnitude difference between milli- () and micro- ().
- Statistical vs. Practical Significance
A statistically significant test () confirms only that an effect is non-zero, not that the effect size meets real-world standards.
Check whether the observed effect size satisfies operational benchmarks and regulatory limits independently of the test statistic.
CORRECTED PATH
ACEpath Teacher's DemonstrationConvert influent to : .
Compute the true mean reduction: .
Compute the -statistic: . Since , reject .
Assess practical significance: (fails engineering target) and (fails EPA threshold).
(a) Influent is ; . (b) Reject (). (c) The filter does not demonstrate practical significance.
Lock it in
What is the difference between standard deviation () and standard error of the mean ()?
measures the spread of individual observations, while measures the precision/variability of the sample mean.
Similar question
A new air scrubber is tested in industrial chambers. The mean reduction in particulate matter is with sample standard deviation . Test versus at (critical value ).
Answer
; reject . Steps: ; . Since , the reduction is statistically significant.
A medical device company develops an automated blood pressure cuff. In a trial of patients, the device reduces systolic blood pressure by an average of with . Physicians state that an intervention requires a reduction of at least to be clinically meaningful. (a) Is the reduction statistically significant at ()? (b) Is it practically significant?
Answer
(a) Yes, statistically significant: , . (b) No, it lacks practical significance because the observed reduction of is well below the clinical threshold.
An algorithm optimization team tests a new caching routine on server batches. The latency reduction has sample mean and standard deviation . Management requires a latency drop of at least to justify deployment costs. Evaluate both statistical significance at () and practical significance.
Answer
Statistically significant, but practically insignificant. Steps: ; test statistic (or with , ; if using two-tailed/one-tailed benchmark , at one-tailed , , so it narrowly misses or borders on statistical significance depending on cutoff, but with a massive sample size even a tiny effect of yields a large statistic). Regardless, the practical threshold of is five times larger than the observed effect, so management should not deploy the routine.