Skip to content

Mistral: use fork-capable attention bridge (enable hook_attn_in / set_use_attn_in)#1497

Open
almogtavor wants to merge 1 commit into
TransformerLensOrg:devfrom
almogtavor:feat/bridge-attn-in-hook
Open

Mistral: use fork-capable attention bridge (enable hook_attn_in / set_use_attn_in)#1497
almogtavor wants to merge 1 commit into
TransformerLensOrg:devfrom
almogtavor:feat/bridge-attn-in-hook

Mistral: use fork-capable PositionEmbeddingsAttentionBridge

9b2fc0c
Select commit
Loading
Failed to load commit list.
Sign in for the full log view