pg19

pg19

PG-19 (Gutenberg) perplexity evaluation.

Measures language model perplexity on Gutenberg books. Returns 1/perplexity (higher is better).

PG19Eval(num_samples: int = 100)

Bases: PerplexityEvaluation

Perplexity evaluation on Project Gutenberg books.