HumanReliabilityResult

HumanReliabilityResult(
    validation_issues,
    pairwise_icr,
    multirater_icr,
    disagreements,
    summary_text,
    output_dir,
)

Result returned by calculate_human_reliability.

Attributes

Name	Type	Description
validation_issues	pd.DataFrame	DataFrame of coder-file and label validation issues.
pairwise_icr	pd.DataFrame	Pairwise inter-coder reliability metrics.
multirater_icr	pd.DataFrame	Multi-rater reliability metrics.
disagreements	pd.DataFrame	Item/field rows where coders supplied different labels.
summary_text	str	Markdown summary of validation, reliability, and disagreements.
output_dir	Path | None	Directory where outputs were written, or None if no output directory was requested.