krippendorffs-alpha

Here are 4 public repositories matching this topic...

Fast computation of the Krippendorff's alpha agreement measure in Python.

Multi-label inter rater agreement using fleiss kappa, krippendorff's alpha and the MASI similarity measure for set simmilarity. Written in R Quarto.

Calculating Krippendorff's Alpha in R, with bootstrapping, citations, and notes.

bootstrap r reliability content-analysis krippendorffs-alpha

LLM evaluation infrastructure — IAA workbench, LLM-as-a-judge harness, output drift detection, multi-model cost routing. Powers chat.raweval.com.

python ai-safety iaa krippendorffs-alpha cohen-kappa llm-evaluation

Add a description, image, and links to the krippendorffs-alpha topic page so that developers can more easily learn about it.

To associate your repository with the krippendorffs-alpha topic, visit your repo's landing page and select "manage topics."