grassr - Context-Conditioned Reporting for Binary Rater Reliability
Generates a Report Card for rater reliability on binary
outcomes from an N x k subject-by-rater rating matrix, on both
the inter-rater and intra-rater axes. Each panel coefficient
(PABAK, Gwet's AC1, Fleiss' kappa, and observed intraclass
correlation) is positioned on a simulation-calibrated reference
surface conditioned on the study's rater count, sample size,
and prevalence, yielding a surface-position percentile with a
bootstrap confidence qualifier. A cross-coefficient discordance
diagnostic (delta-hat), with per-design thresholds calibrated
to fixed false-positive rates, flags panels for which no single
coefficient is a stable summary; for such divergent panels the
report routes to a pairwise PABAK matrix and per-rater
sensitivity and specificity recovered from a Dawid-Skene
latent-class fit (Hui-Walter bounds at k = 2).