TinyStories GPT — JAX / Flax NNX

A ~20M-parameter decoder-only transformer trained on TinyStories, built from scratch with JAX and Flax NNX. Source: llm-with-Jax.

0.1 1.5
10 128
Examples
Story prompt Temperature Max new tokens Seed