What's the difference between concordance correlation and intraclass correlation?

user1205901 07/05/2016. 1 answers, 2.022 views
correlation terminology intraclass-correlation agreement-statistics

I understand there are various formulae for calculating an intraclass correlation, and various formulae for calculating a concordance correlation. Is there something that all intraclass correlations have in common, and all concordance correlations have in common?

Is it the case that intraclass correlations are appropriate for a particular type of research question, while concordance correlations are appropriate for a different type of research question? If so, why?

My curiosity in this matter flows out of this question, in which the calculation of a concordance correlation was suggested by the comments, and the calculation of an intraclass correlation was suggested in an answer. However, I see it as a separate question.

1 Answers

Carl 11/18/2016.

The modern definition of intraclass correlation (ICC) is a biased estimate of the fraction of the total variance that is due to variation between groups as pertains to the framework of analysis of variance (ANOVA), and random effects models.

What would we use this for? An intraclass correlation (ICC) can be a useful estimate of inter-rater reliability on quantitative data because it is highly flexible. A Pearson correlation can be a valid estimator of interrater reliability, but only when you have meaningful pairings between two and only two raters. What if you have more? What if your raters differ by ratee? This is where ICC comes in (note that if you have qualitative data, e.g. categorical data or ranks, you would not use ICC).

Lin's concordance correlation coefficient (CCC) measures agreement between two variables as a departure from perfect linearity of the $y=x$ type.

$\rho_c = 1 - \frac{{\rm Expected\ orthogonal\ squared\ distance\ from\ the\ diagonal\ }x=y} {{\rm Expected\ orthogonal\ squared\ distance\ from\ the\ diagonal\ }x=y{\rm \ assuming\ independence}}$

CCC is also an inter-rater measurement called an "agreement concordance" rather than an inter-rater "reliability". However, numerically, ICC and CCC can be quite close, sometimes differing in the third decimal place.

One notable difference between ICC and CCC is that CCC can also be used in ordinal (whole number) or nominal scales (named categories), and ICC cannot. However, ICC can be used for more than two raters, and CCC cannot.

Related questions

Hot questions


Popular Tags