Skip to content
/ iaa Public

command line stuff to calculate inter annotator agreement

Notifications You must be signed in to change notification settings

nilsreiter/iaa

Repository files navigation

Inter-Annotator-Agreement

This repository contains code to calculate inter-annotator-agreement (Fleiss' Kappa at the moment) on the command line using awk.

Fleiss' Kappa

Calculates Fleiss' kappa

$ awk -f kappa.awk FILENAME

Testing

$ awk -f kappa.awk test.csv
0.209931

test.csv contains the same data as on the Wikipedia page as an example.

Accuracy

$ awk -f accuracy.awk FILENAME

Testing

$ awk -f accuracy.awk test-accuracy.tsv
0.528571

About

command line stuff to calculate inter annotator agreement

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published