Add heads_per_tile (multi-head-per-tile) support to Ulysses ring attention - #444
Open
edgexyz wants to merge 1 commit into
Open
Add heads_per_tile (multi-head-per-tile) support to Ulysses ring attention#444edgexyz wants to merge 1 commit into
heads_per_tile (multi-head-per-tile) support to Ulysses ring attention#444edgexyz wants to merge 1 commit into