calculate_human_reliability

calculate_human_reliability(
    codebook_path,
    coder_csvs,
    output_dir=None,
    id_column=DEFAULT_ID_COLUMN,
    assignment_csv=None,
)

Validate human coder CSVs and calculate inter-coder reliability metrics.