1.9 - Hypothesis Test for the Population Correlation Coefficient

Printer-friendly versionPrinter-friendly version

There is one more point we haven't stressed yet in our discussion about the correlation coefficient r and the coefficient of determination r2 — namely, the two measures summarize the strength of a linear relationship in samples only. If we obtained a different sample, we would obtain different correlations, different r2 values, and therefore potentially different conclusions. As always, we want to draw conclusions about populations, not just samples. To do so, we either have to conduct a hypothesis test or calculate a confidence interval. In this section, we learn how to conduct a hypothesis test for the population correlation coefficient ρ (the greek letter "rho").

In general, a researcher should use the hypothesis test for the population correlation ρ to learn of a linear association between two variables, when it isn't obvious which variable should be regarded as the response. Let's clarify this point with examples of two different research questions.

Consider evaluating whether or not a linear relationship exists between skin cancer mortality and latitude. We will see in Lesson 2 that we can perform either of the following tests:

  • t-test for testing H0: β1= 0
  • ANOVA F-test for testing H0: β1= 0

For this example it is fairly obvious that latitude should be treated as the predictor variable and skin cancer mortality as the response.

By contrast suppose we want to evaluate whether or not a linear relationship exists between a husband's age and his wife's age (husbandwife.txt)? In this case, one could treat husband's age as the response:

husband's age vs wife's age plot

minitab output

or one could treat wife's age as the response:

wife's age vs husband's age plot

minitab output

In cases such as these, we answer our research question concerning the existence of a linear relationship by using the t-test for testing the population correlation coefficient H0: ρ = 0.

Let's jump right to it! We follow standard hypothesis test procedures in conducting a hypothesis test for the population correlation coefficient ρ. First, we specify the null and alternative hypotheses:

Null hypothesis H0: ρ = 0
Alternative hypothesis HA: ρ ≠ 0 or HA: ρ < 0 or HA: ρ > 0

Second, we calculate the value of the test statistic using the following formula:

Test statistic:  \(t^*=\frac{r\sqrt{n-2}}{\sqrt{1-r^2}}\) 

Third, we use the resulting test statistic to calculate the P-value. As always, the P-value is the answer to the question "how likely is it that we’d get a test statistic t* as extreme as we did if the null hypothesis were true?" The P-value is determined by referring to a t-distribution with n-2 degrees of freedom.

Finally, we make a decision:

  • If the P-value is smaller than the significance level α, we reject the null hypothesis in favor of the alternative. We conclude "there is sufficient evidence at the α level to conclude that there is a linear relationship in the population between the predictor x and response y."
  • If the P-value is larger than the significance level α, we fail to reject the null hypothesis. We conclude "there is not enough evidence at the α level to conclude that there is a linear relationship in the population between the predictor x and response y."

Let's perform the hypothesis test on the husband's age and wife's age data in which the sample correlation based on n = 170 couples is r = 0.939. To test H0: ρ = 0 against the alternative HA: ρ ≠ 0, we obtain the following test statistic:

\[t^*=\frac{r\sqrt{n-2}}{\sqrt{1-r^2}}=\frac{0.939\sqrt{170-2}}{\sqrt{1-0.939^2}}=35.39\]

To obtain the P-value, we need to compare the test statistic to a t-distribution with 168 degrees of freedom (since 170 - 2 = 168). In particular, we need to find the probability that we'd observe a test statistic more extreme than 35.39, and then, since we're conducting a two-sided test, multiply the probability by 2. Minitab helps us out here:

minitab output

The output tells us that the probability of getting a test-statistic smaller than 35.39 is greater than 0.999. Therefore, the probability of getting a test-statistic greater than 35.39 is less than 0.001. As illustrated in this , we multiply by 2 and determine that the P-value is less than 0.002. Since the P-value is small — smaller than 0.05, say — we can reject the null hypothesis. There is sufficient statistical evidence at the α = 0.05 level to conclude that there is a significant linear relationship between a husband's age and his wife's age.

Incidentally, we can let statistical software like Minitab do all of the dirty work for us. In doing so, Minitab reports:

minitab output

One final note ... as always, we should clarify when it is okay to use the t-test for testing H0: ρ = 0? The guidelines are a straightforward extension of the "LINE" assumptions made for the simple linear regression model. It's okay:

  • When it is not obvious which variable is the response.
  • When the (x, y) pairs are a random sample from a bivariate normal population.
    • For each x, the y's are normal with equal variances.
    • For each y, the x's are normal with equal variances.
    • Either, y can be considered a linear function of x.
    • Or, x can be considered a linear function of y.
  • The (x, y) pairs are independent