Resources
An applied mathematics researcher fits a linear regression model to evaluate the braking distance (in feet) of passenger vehicles traveling at initial speed (in miles per hour). (a) State the homoscedasticity assumption required for ordinary least squares (OLS) inference on this linear model. (b) Rather than evaluating residual variance directly, determine the theoretical physical dependence of braking distance on velocity under constant braking friction, and identify the resulting systematic violation in the model's residual pattern as speed increases.
Answer and steps
Final answer
(a) The variance of the error terms must remain constant across all levels of the explanatory variable: for all . (b) By the work-energy theorem (), stopping distance scales quadratically with speed (); fitting a linear model forces the residuals to exhibit systematic non-random curvature (fanning out and quadratic bowing), violating both the linearity assumption and homoscedasticity.
Steps
Theoretical Relationship (Work-Energy Theorem)
Part (a): Stating the Homoscedasticity Assumption
In an ordinary least squares (OLS) linear regression model: the random error term accounts for deviations from the true regression line.
- The Homoscedasticity Assumption: The variance of the error terms given the explanatory variable must be constant for all observations:
- This means that regardless of whether the vehicle travels at a low speed or a high speed, the spread of the random errors around the true relationship must remain the same finite value .
Part (b): Theoretical Derivation and Residual Pattern
To find how braking distance physically depends on speed, consider a vehicle of mass brought to a stop from an initial speed by a constant frictional braking force :
- By the work-energy theorem, the work done by the braking force equals the change in kinetic energy:
- Substituting :
Thus, braking distance depends quadratically on initial speed:
Systematic Violations in the Residual Pattern
When a straight line is fitted to data that inherently follows a quadratic curve ():
- Quadratic Bowing (Non-Linearity): The residuals do not scatter randomly around zero. Instead, they follow a systematic parabolic curve: residuals tend to be positive at low speeds, negative at intermediate speeds, and strongly positive at high speeds. This directly violates the assumption that the conditional expectation of the errors is zero:
- Fanning Out (Heteroscedasticity): In physical testing, higher absolute stopping distances compound small variations in reaction time, road conditions, and tire grip, causing errors to scale with distance. Combined with the mis-specified model, the residual spread increases markedly (fans out) as speed increases, violating homoscedasticity.
Pitfall: A common mistake is to treat heteroscedasticity as merely a numerical error; here, it is driven by a fundamental model misspecification—using a linear equation to represent a quadratic physical law.
Typical errors
01 The student confuses the homoscedasticity assumption with the assumption of zero conditional mean of errors, stating that the expected value rather than the variance must be constant.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
The expected value of the error terms given must be constant and equal to zero across all levels of speed: .
Correctfor all (the conditional variance of the error terms is constant across all levels of ).
You stated the zero conditional mean assumption , which governs model unbiasedness and exogeneity. Homoscedasticity specifically requires the conditional variance of the errors to be constant across all predictor levels, written as .
- Step 2
Work done by friction equals initial kinetic energy: Solving for distance yields , showing distance is proportional to .
- Step 3
Fitting a linear model instead of a quadratic model causes the residuals to exhibit a non-random U-shaped curve as speed increases.
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly used the work-energy theorem to deduce that stopping distance is proportional to the square of initial velocity.
You correctly recognized that model misspecification creates a non-random, curved residual pattern across speed levels.
THE ERROR
Where Your ACEpath Teacher Spotted the Mistakeno
WHY IT HAPPENED
ACEpath Teacher's DiagnosisYou confused the homoscedasticity assumption (constant conditional variance of the error terms) with the exogeneity or strict exogeneity assumption (zero conditional mean of the error terms).
REASONING PATH
Your ACEpath teacher’s suggested approach- Homoscedasticity vs. Zero Conditional Mean
Homoscedasticity specifies constant spread: . Zero conditional mean specifies center: .
When asked for homoscedasticity, verify that you are writing a condition about , not .
CORRECTED PATH
ACEpath Teacher's DemonstrationIdentify the root words: 'homo' means same, and 'scedastic' refers to scatter or dispersion.
Express the constant dispersion mathematically using conditional variance: for all observations .
(a) for all ; (b) , leading to systematic U-shaped residual curvature and non-constant residual spread.
02 The student assumes braking distance is proportional to velocity rather than velocity squared, concluding the linear model is theoretically correct and will produce purely random residuals.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
a) The variance of the error terms given speed is constant across all observations: .
- Step 2
b) Braking distance is proportional to initial velocity, , because stopping time increases linearly with speed.
CorrectBy the work-energy theorem (, or ), braking distance is proportional to speed squared: .
While stopping time is indeed proportional to initial speed under constant deceleration (), stopping distance is the integral of velocity over time (), which makes distance scale quadratically (), not linearly.
- Step 3
c) Since distance depends linearly on speed, the linear regression model correctly captures the relationship and the residuals will be randomly scattered around zero with no systematic pattern as increases.
CorrectFitting a linear line to a quadratic physical law () causes residuals to exhibit systematic quadratic curvature (bowing) and fanning out as increases, violating both linearity and homoscedasticity.
Because this conclusion relies on your incorrect linear scaling from step 2, you missed the systematic parabolic bowing and fanning out that appear when fitting a straight line to an inherently quadratic curve.
WHAT YOU DID WELL
Compliments from Your TeacherYou correctly formulated and mathematically expressed the homoscedasticity assumption for ordinary least squares regression.
You recognized that constant braking friction implies constant deceleration.
THE ERROR
Where Your ACEpath Teacher Spotted the MistakeConflating stopping time () with stopping distance ().
WHY IT HAPPENED
ACEpath Teacher's DiagnosisYou related stopping distance directly to stopping time without accounting for the fact that average speed during braking also increases linearly with initial speed, or by omitting the work-energy theorem (). This led to misspecifying the underlying deterministic relationship as linear instead of quadratic.
REASONING PATH
Your ACEpath teacher’s suggested approach- Work-Energy Scaling
When a constant retarding force acts over distance to stop an object of mass with initial speed , the work done equals the initial kinetic energy: , so .
Always verify physical model specifications using conservation laws or kinematics () before choosing a linear regression model.
- Residual Bowing from Underfitting
Fitting a first-order linear model to a quadratic process forces the residuals into a distinct parabolic arc (positive at extremes, negative in the middle).
Look for parabolic or curved trends in residual vs. fitted plots as an immediate indicator of missing higher-order terms.
CORRECTED PATH
ACEpath Teacher's DemonstrationApply the work-energy theorem: the work done by friction equals the change in kinetic energy: .
Substitute constant frictional force : , meaning .
Compare the quadratic relationship to the fitted linear model : a straight line fitted across a parabola underestimates values at the lowest and highest speeds and overestimates values in the middle.
Identify the residual pattern: the residuals show a systematic U-shaped quadratic curve (bowing) and fanning out with speed, violating both and constant variance.
(a) for all . (b) By the work-energy theorem, ; fitting a linear model forces residuals to exhibit systematic quadratic bowing and fanning out, violating both linearity and homoscedasticity.
03 The student confuses the violation of linearity with heteroscedasticity, incorrectly concluding that the residual variance systematically fans out rather than forming a curved pattern.
Sample Student Work
Reviewed by ACEpath TeacherStep-by-Step Review
Walk Through It with Your Teacher- Step 1
The variance of the error terms is constant for all values of initial speed: .
- Step 2
Work-energy theorem: , so braking distance is proportional to .
- Step 3
Because distance grows quadratically while the model is linear, the residuals fan outward with increasing variance as speed increases, violating homoscedasticity.
CorrectFitting a linear model to a quadratic physical relationship causes the residuals to show a systematic curved (parabolic/bowed) pattern, violating the linearity assumption .
When a linear model is fitted to quadratic data, the mean of the residuals depends systematically on as . This creates a distinct U-shaped or inverted U-shaped parabolic curve (a violation of the linearity assumption), not a fan-shaped spread in variance.
WHAT YOU DID WELL
Compliments from Your TeacherYou clearly and formally stated the constant variance condition .
You used the work-energy theorem to deduce the correct quadratic relationship .
THE ERROR
Where Your ACEpath Teacher Spotted the MistakeYou identified the discrepancy between linear and quadratic growth but attributed it to changing variance rather than systematic curvature in the residual mean.
WHY IT HAPPENED
ACEpath Teacher's DiagnosisYou conflated a violation of zero conditional mean (linearity, , where points follow a curved trajectory) with a violation of constant variance (homoscedasticity, , where the spread widens or narrows). Functional form misspecification primarily bends the centerline of the residuals into a curve.
REASONING PATH
Your ACEpath teacher’s suggested approach- Residual Pattern vs. Model Assumption
A systematic curve (U-shape or inverted U-shape) in a residual plot indicates model misspecification / non-linearity (). A funnel or fan shape indicates heteroscedasticity ( depends on ).
Check the centerline of residuals first: if the average residual shifts systematically above and below zero across , diagnose non-linearity.
CORRECTED PATH
ACEpath Teacher's DemonstrationCompare the true conditional expectation with the fitted line .
Calculate the expected residual: , which is quadratic in .
Conclude that the residuals exhibit a systematic parabolic bowed curve across , directly violating the linearity assumption .
(a) for all . (b) By the work-energy theorem, ; fitting a linear model forces the residuals to exhibit a systematic parabolic curve (quadratic bowing), violating the assumption of linearity .
Lock it in
What does the homoscedasticity assumption in an OLS linear regression model state mathematically?
for all . It requires the conditional variance (spread) of the error terms to be constant across all predictor values.
Similar question
A researcher fits . State the mathematical condition for the Gauss-Markov assumption of 'no autocorrelation' among error terms.
Answer
for all . The error terms of distinct observations must be uncorrelated.
Suppose the true physical law is , but a researcher fits over . At the endpoints ( and ), will the residuals tend to be positive or negative? Explain briefly.
Answer
Positive. A straight line fitted to an upward-opening parabola intersects the curve at two intermediate points, lying below the curve at the low and high extremes. Hence , making residuals positive.
In a physics experiment measuring the period of a simple pendulum against length , the theoretical formula is . If a student fits a simple linear regression , describe the curvature of the residual plot versus .
Answer
An inverted U-shape (concave downward). Because the true curve is strictly concave, a fitted straight line underestimates in the middle and overestimates at the ends, producing negative residuals at the ends and positive residuals in the middle.