[Refactor][Ops] read dtype at forward instead of taking it in op constructors - #1826

Open

lcy-seso wants to merge 11 commits into

mainfrom

design/ops/ctor-dtype

Commits on Aug 4, 2026

[Docs][Ops] Dtype is read at forward, never taken by an op constructor
lcy-seso
committed
33d7662
[Refactor][Ops] Read dtype at forward for the reduction and norm families
lcy-seso
committed
8f17e4a
[Refactor][Attention] Drop is_hopper and the non-Hopper branches it gated
lcy-seso
committed
b54e145
[Refactor][Manifest] Declare the output dtype GQA prefill was selecting undeclared
lcy-seso
committed
d90e300
[Refactor][MoE] Read dtype at forward for the MoE family
lcy-seso
committed
2a3c48d
[Refactor][Ops] Read dtype at forward for the top-level ops
lcy-seso
committed
9108aaa
[Refactor][Attention] Read dtype at forward for the backward and decode ops
lcy-seso
committed
68e0c48
[Refactor][Attention] Read dtype at forward for the varlen, sliding-window and DeepSeek ops
lcy-seso
committed
61222aa
[Refactor][Attention] Select the decode kernel at forward instead of at construction
lcy-seso
committed
40021ef
[Refactor][Ops] Route every compile-dispatch instance through one registry
lcy-seso
committed
40182d5
[Refactor][Manifest] Drop the engram dtype params and compare dtype defaults as dtypes
lcy-seso
committed
9680783