Categorical tests of independence : a monte carlo simula8on study

Abstract EN

The X² and G² tests are the most frequently applied tests for testing the independence of two categorical variables.

however, no one, to the best of our knowledge has compared them, extensively, and ultimately answer the question of which to use and when.

further, their applicability in cases with zero frequencies has been debated and (non parametric) permutation tests are suggested.

in this work we perform extensive monte carlo simulation studies attempting to answer both aforementioned points.

as expected, in large sample sized cases (1,000) the X² and G² are indistinguishable.

in the small sample-sized cases (<1,000) though, we provide strong evidence supporting the use of the X² test regardless of zero frequencies for the case of unconditional independence.

also, we suggest the use of the permutation based G² test for testing conditional independence, at the cost of being computationally more expensive.

the G² test exhibited inferior performance and its use should be limited.