5.4 - Models of Independence and Associations in 3-Way Tables
For multinomial sampling and a two-dimensional table only independence of row and column is of interest. With three-dimensional tables, there are at least eight models of interest. In the next sections of this lesson we are going to look at different models of independence and dependence that can capture relationships between variables in a three-way table. Please note that these concepts extend to any number of categorical variables (e.g., k-way table), and are NOT unique to categorical data only. But we will consider their mathematical and graphical representation and interpretations within the context of categorical data, and links to odd-ratios, and marginal and partial tables. In the later lessons we will see different ways of fitting these models, e.g., log-linear models, logistic regression, etc...
Recall that independence means "no association", while dependence can be equated with "association" between variables. Here are the types of independence and associations relationships, i.e., models, that we will consider.
- Mutual independence -- all variables are independent from each other, denoted \((A,B,C)\) or \(A\perp\!\!\perp B \perp\!\!\perp C\).
- Joint independence -- two variables are jointly independent of the third, denoted \((AB,C)\) or \(A B \perp\!\!\perp C\).
- Marginal independence -- two variables are independent while ignoring the third, e.g., θAB=1, denoted \((A, B)\).
- Conditional independence -- two variables are independent given the third, e.g., θAB(C=k)=1 for all k=1,2,...,K, denoted \((AC, BC)\) or \(A \perp\!\!\perp B | C\).
- Homogeneous associations -- conditional (partial) odds-ratios don't depend on the value of the third variable, denoted \((AB, AC, BC)\).
Before we look at the details, here is a summary of the relationships among these models:
- Mutual independence implies joint independence, i.e., all variables are independent of each other.
- Joint independence implies marginal independence, i.e., one variable is independent of the other two.
- Marginal independence does NOT imply joint independence.
- Marginal independence does NOT imply conditional independence.
- Conditional independence does NOT imply marginal independence.
It is worth noting that a minimum of three variables are required for all the above types of independences to be defined.