Finn coefficient for oneway and twoway models

.

Input

Required variables to run this test

This test requires a table containing one rating per column. To format the data please see ?plyr

 > library(irr) # library call, remember to install the package irr if you haven't done so. see ?install.packages()
 > data(video)
 > video 
   rater1 rater2 rater3 rater4
   1       4      4      3      4
   2       4      4      4      5
   3       4      4      5      5
   4       4      4      4      4
   5       4      3      2      4
   6       4      4      3      4
   7       4      3      2      5
   8       4      4      3      4
   9       4      3      3      4
   10      4      3      3      4

How to describe this test in your Methods section

"We used the Finn coefficient to measure concordance between raters."

Output

Annotated output from function (example from http://goo.gl/MVxDt )

 > library(irr) # library call, remember to install the package irr if you haven't done so. see ?install.packages()
 > data(video) #calling the data
 > finn(video, 6, model="twoway")
     Finn-Coefficient (Model=twoway)

     Subjects = 20 #total number of subjects
     Raters = 4 #total number of raters. in order to establish different types of comparisons you will have to be set the data set structure in different ways
        Finn = 0.925 # coefficient of interrater reliability.

    F(Inf,60) = 13.3 # F statistic and number of degrees of freedom
    p-value = 1.74e-23 #p values < 0.05 indicate that the two measures cannot be proven to be the same. Informally, that there is a statistical difference between the two ratings or that they are different.

Annotated references

1. Original article at http://goo.gl/A3yZt