clutrr

clutrr

CLUTRR(split: str = 'train', config: str | None = 'gen_train234_test2to10')

Bases: ChatTemplateDataset

CLUTRR relational reasoning benchmark (Facebook Research).

Given a semi-synthetic story about a hypothetical family, infer the kinship relation between two specified family members. The config parameter selects the subset (default "gen_train234_test2to10").