mnli

mnli

MNLIEval(split: str = 'validation_matched')

Bases: RolloutEvaluation

MNLI evaluation using validation_matched split.

max_new_tokens(inference: Any) -> int

Need ~3 tokens for entailment/neutral/contradiction.