Skip to content

projection

projection

ProjectionAnalysis(spec: ExecutionSpec)

Bases: BaseTrainer[ProjectionAnalysisConfig, GPT]

Analyze whether boundary attention projects toward a repeat endpoint.

capture(module: Any, method: str) -> bool staticmethod

Capture embeddings plus complete-block and attention outputs.

measure(params: Any, batch: Any) -> Dict[str, jax.Array]

Measure one validation microbatch with the trained output head.

projection_fraction(update: jax.Array, direction: jax.Array) -> jax.Array

Per-token fraction of a target displacement supplied by an update.

distance_progress(update: jax.Array, direction: jax.Array) -> jax.Array

Per-token fractional reduction in RMS distance to a target state.