There are 50 observations and 3 fitted slope coefficients. Residual df is:
Multiple regression and model selection
Interpret adjusted slopes, compare model fit, and recognize collinearity.
Key ideas
- Adjusted slope
The estimated change in mean response per unit of a predictor while holding the other included predictors fixed.
- Collinearity
Strong association among predictors can inflate coefficient standard errors and make individual estimates unstable, even when overall prediction is useful.
- Adjusted R-squared
A fit measure that penalizes additional coefficients. Unlike ordinary R-squared, it may fall when a predictor is added.
- Predictor selection
Consider subject-matter relevance, adjusted R-squared, residual error, and overlap among predictors. The smallest individual p-value is not a complete model-selection strategy.
Formulas
Which procedure?
Parcel weight and route length
For 40 parcels, model delivery cost in dollars from weight in kg and route length in km. Interpret weight and compare fit. This is an original example with composed R output.
coef(lm(cost ~ kg + km, data = parcels))
(Intercept) kg km
4.00 1.50 0.25
# Same 40 observations, same response; selected summaries
# model R-squared Adj R-squared RSE residual df
# kg only 0.5000 0.4868 4.59 38
# kg + km 0.6300 0.6100 4.00 37Holding route length fixed, each extra kilogram is associated with an estimated $1.50 increase in mean cost.
For 2 kg and 8 km, fitted cost = 4 + 1.5(2) + 0.25(8) = $9.
Both adjusted R-squared and RSE improve after route length is included.
This supports the expanded model on these criteria; it does not establish that the model controls every confounder.
The two-predictor model accounts for 63% of sample cost variability and has a typical residual scale of about $4. The weight coefficient is conditional on route length.
Three-question check
Two highly correlated predictors have large SEs when included together. This suggests:
Which comparison is most useful when an extra predictor is added?