Lesson 2: Simple Linear Regression (SLR) Model

Overview of this Lesson

Simple linear regression is a statistical method that allows us to summarize and study relationships between two continuous (quantitative) variables. This lesson introduces the concept and basic procedures of simple linear regression. We will also learn two measures that describe the strength of the linear association that we find in data.

Key Learning Goals for this Lesson:
  • Distinguish between a deterministic relationship and a statistical relationship.
  • Understand the concept of the least squares criterion.
  • Interpret the intercept b0 and slope b1 of an estimated regression equation.
  • Know how to obtain the estimates b0 and b1 using statistical software.
  • Recognize the distinction between a population regression line and the estimated regression line.
  • Summarize the four conditions that underlie the simple linear regression model.
  • Know what the unknown population variance σ2 quantifies in the regression setting.
  • Know how to obtain the estimate MSE of the unknown population variance σusing statistical software.
  • Know that the coefficient of determination (r2) and the correlation coefficient (r) are measures of linear association. That is, they can be 0 even if there is perfect nonlinear association.
  • Know how to interpret the r2 value.
  • Understand the cautions necessary in using the r2 value as a way of assessing the strength of the linear association.
  • Know how to calculate the correlation coefficient r from the r2 value.
  • Know what various correlation coefficient values mean. There is no meaningful interpretation for the correlation coefficient as there is for the r2 value.