carved_gpt

GPT over a carved topology (n_repeats = 1).

ln_1 and ln_2 belong to the sublayer they precede, ln_f is applied in unembed, no softcap. With every sublayer alive and no skip edges this is GPT.