8.4 - Estimating the standard deviation of the error term

8.4 - Estimating the standard deviation of the error term

Our simple linear regression model is:

\(Y=\beta_0+\beta_1X+\epsilon\)

The errors for the \(n\) observations are denoted as \(\epsilon_i\), for \(i=1, …, n\). One of our assumptions is that the errors have equal variance (or equal standard deviation). We can estimate the standard deviation of the error by finding the standard deviation of the residuals, \(\hat{\epsilon}_i=\hat{y}_i-y_i\). Minitab also provides the estimate for us, denoted as \(S\), under the Model Summary. We can also calculate it by:

\(s=\sqrt{\text{MSE}}\)

Find the MSE in the ANOVA table, under the Adj MS column and the Error row. The value of 1.12 represents the average squared error. This becomes the denominator for the F test.

Analysis of Variance
Source DF Adj SS Adj MS F-Value P-Value
Regression 1 9281.7 9281.72 8267.30 0.000
Critical Areas 1 9287.7 9281.72 8267.30 0.000
Error 93 104.4 1.12    
Total 94 9386.1      

Legend
[1]Link
Has Tooltip/Popover
 Toggleable Visibility