fever

fever

FEVEREval(split: str = 'dev')

Bases: RolloutEvaluation

FEVER fact verification evaluation using dev split.

max_new_tokens(inference: Any) -> int

Need ~5 tokens for SUPPORTS/REFUTES/NOT ENOUGH INFO.

get_wikipedia_summary(article_title: str) -> str | None

Fetch Wikipedia summary for an article title like 'Oliver_Reed'.