block

block

Your most very basic indeed transformer Block

Block

Bases: Module

measure(residual: jax.Array, after_attention: jax.Array, output: jax.Array, kwargs: Dict[str, Any]) -> None

Measure each sublayer's write to its receiving residual.