mtob

mtob

MTOBEval()

Bases: RolloutEvaluation

MTOB Grammar-Book translation evaluation (Kalamang -> English).

Uses the test split with ground truth translations.

score(ys: list[str], y_hats: list[str]) -> float

Use exact match for simplicity; chrF could be added later.