pile_injected

pile_injected

Injected sequence memorization evaluation.

Measures how well the model has memorized the 100 injected sequences from the pile_injected training dataset. Uses perplexity on the injected texts — lower perplexity (higher 1/ppl score) indicates stronger memorization.

PileInjectedEval()

Bases: PerplexityEvaluation

Perplexity evaluation on injected sequences.

Returns 1/perplexity (higher is better) — a perfectly memorized sequence would have very low perplexity and thus high score.