Skip to content

Add flex_attention (score_mod / mask_mod) on the generic flash-attention kernel - #931

Draft
RichardChamberlain1 wants to merge 22 commits into
mainfrom
rchamber/flex_attention
Draft

Add flex_attention (score_mod / mask_mod) on the generic flash-attention kernel#931
RichardChamberlain1 wants to merge 22 commits into
mainfrom
rchamber/flex_attention

Refactor flex mods into FlexMod class hierarchy + expand test coverage

95a1bcb
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar