Resources
A municipal transit authority analyzes rider satisfaction ratings on a scale from to . When evaluated overall, Bus Route A has an average rider satisfaction score of across daily surveyed riders, whereas Bus Route B has an average satisfaction score of across daily surveyed riders. However, the data is confounded by travel period (Peak Rush Hour vs. Off-Peak). On Route A, riders were surveyed during Peak hours (mean score ) and riders were surveyed during Off-Peak hours (mean score ). On Route B, riders were surveyed during Peak hours. Assuming that within each travel period Route A scored higher than or equal to Route B, solve backwards for the maximum possible Peak-hour mean satisfaction score for Route B given that its Off-Peak mean satisfaction score was , and explain how this reverse scenario illustrates Simpson's Paradox.
Answer and steps
Final answer
. Despite Route A outperforming Route B in the Off-Peak stratum ( vs. implies Route B is slightly higher off-peak, but during peak hours Route A achieves while Route B achieves , or Route A outperforms within comparable weighted conditions), the aggregate mean for Route B () appears higher than Route A () because of Route B riders were surveyed during high-satisfaction Off-Peak hours compared to only for Route A, demonstrating Simpson's Paradox driven by unequal subgroup sampling weights.
Steps
Determine the Subgroup Counts for Route B
Route B has a total of surveyed riders, divided into Peak and Off-Peak travel periods:
- Peak riders:
- Off-Peak riders:
Calculate the Peak-Hour Mean for Route B ()
The overall mean rating is the weighted average of the subgroup means:
Substitute the given values into the equation:
Multiply both sides by :
Subtract from both sides to find the total satisfaction points scored during Peak hours:
Solve for :
Understand the Mechanism of Simpson's Paradox
Simpson's Paradox occurs when a trend or comparison seen in aggregated data is altered or reversed when the data is separated into subgroups, caused by an underlying confounding variable.
-
Subgroup Performance vs. Aggregate Performance:
- Peak hours: Route A scored , while Route B scored .
- Off-Peak hours: Route A scored , while Route B scored .
- Within both travel periods, satisfaction ratings are relatively close (with Route B slightly higher by points in each stratum).
- Yet, in the aggregate, Route B () appears to drastically outperform Route A () by points.
-
The Confounding Variable (Subgroup Weights):
- Travel period is a confounding variable because satisfaction is inherently higher during Off-Peak hours ( to ) than during Peak hours ( to ) across both routes.
- For Route A, of riders () were surveyed during low-satisfaction Peak hours, dragging its overall average down to .
- For Route B, of riders () were surveyed during high-satisfaction Off-Peak hours, pulling its overall average up to .
The disproportionate sample weights across conditions distort the aggregate result, illustrating Simpson's Paradox.
Typical errors
01 The student treats the aggregate mean as an unweighted simple average of the peak and off-peak satisfaction scores, ignoring subgroup sample sizes.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1Correct
You set up the aggregate mean as a simple arithmetic average of the two periods, dividing by . However, Route B has peak riders and off-peak riders out of total, so the overall mean must be a weighted average reflecting those unequal sample sizes.
- Step 2Correct
Your algebraic manipulation was executed cleanly, but the resulting value is incorrect because it inherited the unweighted equation from Step 1.
- Step 3
Simpson's Paradox occurs because Route B has a higher overall average even though Route A scores better in subgroups.
CorrectSimpson's Paradox is driven by the confounding variable of travel period: satisfaction is naturally higher off-peak (–), and Route B surveyed of its riders off-peak compared to only for Route A, inflating Route B's aggregate score.
You accurately stated the surface-level paradox, but you did not explain the underlying statistical mechanism: the disproportionate subgroup weights (confounding by travel period) that cause the reversal.
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly identified the given aggregate score of and the off-peak score of .
You solved your linear algebraic equation accurately without arithmetic slips.
You correctly recognized that Simpson's Paradox describes a reversal between aggregate and subgroup trends.
THE ERROR
Where Your ACEpath Teacher Spotted the MistakeYou divided by instead of weighting each subgroup mean by its sample size ( and ).
WHY IT HAPPENED
ACEpath Teacher's DiagnosisYou treated the aggregate mean as an unweighted simple average of stratum means, overlooking that combined means must be weighted by group sizes, which is the exact mechanism causing Simpson's Paradox.
REASONING PATH
Your ACEpath teacher’s suggested approach- Weighted Mean Formula
For subgroups of size and combining to , the overall mean is .
Always multiply each stratum mean by its subgroup frequency before summing and dividing by the total sample size.
- Explaining Simpson's Paradox
A complete explanation of Simpson's Paradox must name the confounding variable and identify how unequal distribution across subgroups shifts the overall average.
Highlight the difference in subgroup proportions between the two groups being compared.
CORRECTED PATH
ACEpath Teacher's DemonstrationDetermine subgroup counts for Route B: and .
Set up the weighted mean equation: .
Multiply by and simplify: .
Subtract : .
Solve for the peak mean: .
02 The student sets up the weighted average correctly but makes a division error by dividing by 3 instead of 0.3, yielding an implausible rating.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
- Step 2Correct
You divided by instead of the coefficient (or ), which shifted the decimal point by one place and produced instead of .
- Step 3
Unequal subgroup weights create Simpson's Paradox because Route B surveyed 70% off-peak versus Route A surveying only 20% off-peak.
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly calculated the peak and off-peak weights ( and ) for Route B.
You accurately set up and simplified the linear equation for the weighted mean.
You clearly explained how disproportionate sampling across conditions produces Simpson's Paradox.
THE ERROR
Where Your ACEpath Teacher Spotted the MistakeYou divided by rather than by .
WHY IT HAPPENED
ACEpath Teacher's DiagnosisDropping the leading decimal point when dividing by a decimal coefficient shifts the quotient by a factor of , producing an answer outside the reasonable range of the problem scale ( to ).
REASONING PATH
Your ACEpath teacher’s suggested approach- Isolate with the Exact Coefficient
When solving , always divide both sides by , preserving all decimal places: .
Divide by , which is equivalent to .
- Contextual Feasibility Check
A weighted average of two values must lie strictly between the minimum and maximum subgroup values.
Since the aggregate is and the off-peak mean is , the peak mean must be close to , so a score of on a – scale is impossible.
CORRECTED PATH
ACEpath Teacher's DemonstrationDivide both sides by :
Multiply the numerator and denominator by to clear decimals:
03 The student solves for the peak mean correctly but attributes Simpson's Paradox to extreme outliers or respondent bias rather than disproportionate stratum weights.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
- Step 2
This demonstrates Simpson's Paradox because extreme outlier scores from dissatisfied peak-hour commuters pulled Route A's overall rating down. The disparity is caused by measurement bias among rush hour riders.
CorrectSimpson's Paradox occurs because travel period is a confounding variable with disproportionate subgroup weights. Route B has of its sample in the higher-satisfaction Off-Peak stratum (), pulling its overall average up to . In contrast, Route A has of its sample in the lower-satisfaction Peak stratum (), dragging its overall average down to . The overall gap ( vs. ) is an artifact of unequal subgroup sample sizes, not outliers or measurement bias.
Simpson's Paradox is a mathematical consequence of combining groups with unequal sample weights across strata, not an artifact of outliers or measurement errors.
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly identified the subgroup sample sizes for Route B ( peak and off-peak riders).
You accurately set up the weighted average equation and solved for .
THE ERROR
Where Your ACEpath Teacher Spotted the MistakeYou attributed the reversal to outliers and measurement bias instead of unequal subgroup sample weights.
WHY IT HAPPENED
ACEpath Teacher's DiagnosisConfusing structural confounding (unequal distribution across subgroups with different baseline means) with data quality issues (such as outliers, unrepresentative respondents, or measurement error). In Simpson's Paradox, every individual measurement can be perfectly accurate, but the aggregate average is dominated by the stratum that makes up the majority of each group.
REASONING PATH
Your ACEpath teacher’s suggested approach- Mathematical Origin of Simpson's Paradox
An aggregate mean is , where are stratum proportions.
Check whether group weights () differ significantly between the comparison groups before suspecting outliers.
- Identifying Confounding Variables
A confounding variable is associated with both the grouping factor (route) and the outcome (satisfaction).
Verify if one route is sampled primarily during high-performing conditions while the other is sampled primarily during low-performing conditions.
CORRECTED PATH
ACEpath Teacher's DemonstrationCompare stratum proportions: Route A is Peak () and Off-Peak (), while Route B is Peak () and Off-Peak ().
Compare within-stratum performance: Route B leads Route A by just points in both strata ( vs. Peak; vs. Off-Peak).
Explain the aggregate distortion: Route B's overall average is heavily weighted by the high Off-Peak score ( at ), whereas Route A's overall average is heavily weighted by the lower Peak score ( at ), inflating Route B's aggregate lead to points.
. Simpson's Paradox is illustrated because the large aggregate difference ( vs. ) is driven by unequal sampling weights across the confounding travel periods ( Off-Peak for Route B vs. only for Route A), rather than a large difference in route performance within either period.
Lock it in
When combining two subgroup means and with sample sizes and , what is the correct formula for the overall mean ?
. Use a weighted average; a simple average is only valid when .
Similar question
A clinic tests recovery rates under Treatment 1 and Treatment 2. Treatment 1 treats mild cases with an recovery rate and severe cases with a recovery rate. Treatment 2 treats mild cases with an recovery rate and severe cases with a recovery rate. Calculate the aggregate recovery rate for each treatment and identify the confounding variable.
Answer
Treatment 1 aggregate rate: . Treatment 2 aggregate rate: . The confounding variable is disease severity (mild vs. severe), because severity affects recovery and is disproportionately assigned between treatments.
In a company with two divisions, Division X has entry-level workers with an average salary of and managers with an average salary of . Division Y has entry-level workers averaging and managers averaging . Within each job level, Division Y pays higher salaries. Compute the overall average salary for each division to determine whether Simpson's Paradox occurs.
Answer
Division X overall mean: . Division Y overall mean: . Yes, Simpson's Paradox occurs in appearance because Division Y looks vastly higher overall ( vs ) mainly because of its staff are managers, compared to only in Division X.
A university department admits students into two majors, Arts and Engineering. Across the department, female and male applicants apply. In Arts, the female admission rate is and the male admission rate is . In Engineering, the female admission rate is and the male admission rate is . If women apply to Arts and to Engineering, while men apply to Arts and to Engineering, find the overall admission rate for each gender and explain how Simpson's Paradox manifests.
Answer
Overall female admission rate: . Overall male admission rate: . Simpson's Paradox occurs because within both majors females have a higher acceptance rate ( and ), and the overall gap is magnified to vs because women predominantly applied to the high-admit major (Arts, of female applicants) while men applied predominantly to the low-admit major (Engineering, of male applicants).