projection
projection
¶
ProjectionAnalysis(spec: ExecutionSpec)
¶
Bases: BaseTrainer[ProjectionAnalysisConfig, GPT]
Analyze whether boundary attention projects toward a repeat endpoint.
projection_fraction(update: jax.Array, direction: jax.Array) -> jax.Array
¶
Per-token fraction of a target displacement supplied by an update.
distance_progress(update: jax.Array, direction: jax.Array) -> jax.Array
¶
Per-token fractional reduction in RMS distance to a target state.