Lesson 1: Simple Linear Regression

Printer-friendly versionPrinter-friendly version

Introduction

Simple linear regression is a statistical method that allows us to summarize and study relationships between two continuous (quantitative) variables. This lesson introduces the concept and basic procedures of simple linear regression. We will also learn two measures that describe the strength of the linear association that we find in data.

Learning objectives & outcomes

Upon completion of this lesson, you should be able to do the following:

  • Distinguish between a deterministic relationship and a statistical relationship.
  • Understand the concept of the least squares criterion.
  • Interpret the intercept b0 and slope b1 of an estimated regression equation.
  • Know how to obtain the estimates b0 and b1 from Minitab's fitted line plot and regression analysis output.
  • Recognize the distinction between a population regression line and the estimated regression line.
  • Summarize the four conditions that comprise the simple linear regression model.
  • Know what the unknown population variance σ2 quantifies in the regression setting.
  • Know how to obtain the estimate MSE of the unknown population variance σ2 from Minitab's fitted line plot and regression analysis output.
  • Know that the coefficient of determination (r2) and the correlation coefficient (r) are measures of linear association. That is, they can be 0 even if there is perfect nonlinear association.
  • Know how to interpret the r2 value.
  • Understand the cautions necessary in using the r2 value as a way of assessing the strength of the linear association.
  • Know how to calculate the correlation coefficient r from the r2 value.
  • Know what various correlation coefficient values mean. There is no meaningful interpretation for the correlation coefficient as there is for the r2 value.