Utilities
Registry mapping metric keys to coefficient implementations.
METRIC_REGISTRY = {'cohen': CohenKappa, 'fleiss': FleissKappa, 'ac1': GwetAC1, 'ac2': GwetAC2, 'kendall': KendallW, 'krippendorff': KrippendorffAlpha, 'scott': ScottPi, 'percent_agreement': PercentAgreement, 'jaccard': JaccardSimilarity, 'masi': MasiSimilarity}
module-attribute
¶
Maps string keys used in interrater.compute() to their corresponding
AgreementCoefficient class implementations.
| Metric key | Class | Supported measurement levels |
|---|---|---|
"cohen" |
CohenKappa |
Nominal, Ordinal |
"fleiss" |
FleissKappa |
Nominal |
"ac1" |
GwetAC1 |
Nominal |
"ac2" |
GwetAC2 |
Ordinal, Interval, Ratio |
"kendall" |
KendallW |
Ordinal |
"krippendorff" |
KrippendorffAlpha |
Nominal, Ordinal, Interval, Ratio |
"scott" |
ScottPi |
Nominal |
"percent_agreement" |
PercentAgreement |
Nominal |
"jaccard" |
JaccardSimilarity |
Set |
"masi" |
MasiSimilarity |
Set |
Examples:
>>> from interrater.registry import METRIC_REGISTRY
>>> list(METRIC_REGISTRY.keys())
['cohen', 'fleiss', 'ac1', 'ac2', 'kendall', 'krippendorff', 'scott', 'percent_agreement', 'jaccard', 'masi']
:::