Skip to content

Flydsl attn res #4610

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
anhminhnguyenhoang wants to merge 11 commits into
base: main
Choose a base branch
from
+992 −0
Draft

Flydsl attn res #4610

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
67d05d3
Add PyTorch reference for Kimi-K3 AttnRes.
anhminhnguyenhoang Aug 4, 2026
b605076
Add FlyDSL AttnRes mix-only kernel for Kimi-K3 prefill.
anhminhnguyenhoang Aug 5, 2026
f4bc3aa
Extend FlyDSL AttnRes with all-on append path.
anhminhnguyenhoang Aug 6, 2026
c35424c
Merge origin/main into flydsl-attn-res
anhminhnguyenhoang Aug 6, 2026
a6a10e8
Open AttnRes flag combinations and align delta reference rounding.
anhminhnguyenhoang Aug 7, 2026
b277075
Merge origin/main into flydsl-attn-res.
anhminhnguyenhoang Aug 7, 2026
4537433
Accept padded input rows in FlyDSL AttnRes.
anhminhnguyenhoang Aug 7, 2026
493526e
Merge origin/main into flydsl-attn-res.
anhminhnguyenhoang Aug 7, 2026
43fa535
Support expanded AttnRes hidden sizes with per-D block sizing.
anhminhnguyenhoang Aug 7, 2026
bbb5745
Fix AttnRes Python style checks.
anhminhnguyenhoang Aug 7, 2026
8a3583c
Fix remaining AttnRes CI style errors.
anhminhnguyenhoang Aug 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions aiter/ops/flydsl/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,7 @@

from .fmha_kernels import flydsl_flash_attn_func
from .gemm_kernels import flydsl_hgemm, flydsl_preshuffle_gemm_a8
from .kernels.attn_res import flydsl_attn_res
from .kernels.fp8_mqa_logits import (
DEFAULT_VARIANT as FP8_MQA_LOGITS_DEFAULT_VARIANT,
)
Expand Down Expand Up @@ -66,6 +67,7 @@
"FP8_MQA_LOGITS_DEFAULT_VARIANT",
"FP8_MQA_LOGITS_VARIANTS",
"compute_varqlen_windows",
"flydsl_attn_res",
"flydsl_flash_attn_func",
"flydsl_fp8_mqa_logits",
"flydsl_hgemm",
Expand Down
Loading
Loading