forking

forking

Attention module with forking support for Thoughtbubbles. Extends RopeAttention with cumulative scores and token index tracking.

ForkingAttention

Bases: RopeAttention

Self-attention with forking support, extending RopeAttention.