tinystories

tinystories

TinyStories perplexity evaluation.

Measures language model perplexity on the TinyStories validation set. Returns 1/perplexity (higher is better).

TinyStoriesEval(num_samples: int = 500)

Bases: PerplexityEvaluation

Perplexity evaluation on TinyStories validation stories.

Loads from roneneldan/TinyStories on HuggingFace.