Fix saveloadstate ov - #309

Draft

cavusmustafa wants to merge 16 commits into

ravi9:dev_backend_openvinofrom

cavusmustafa:fix_saveloadstate_ov

Commits on Sep 2, 2026

exclude GPU/NPU failing POOL_2D case

mostafafaheem
authored and
ravi9
committed
cc78b9b
Fix pool case

mostafafaheem
authored and
ravi9
committed
1dc77f6
ggml-openvino: fix stateful decode for Gemma-4 per-layer-type head sizes

cavusmustafa
authored and
ravi9
committed
eb10c12
ggml-openvino: fix MSVC narrowing error in permute

cavusmustafa
authored and
ravi9
committed
4ef6be1
ggml-openvino: classify sliding-window layers structurally on interleaved-SWA models

cavusmustafa
authored and
ravi9
committed
16d1c91
ggml-openvino: add GGML_OPENVINO_REQUANT_KQUANT to select a 4-bit requant target

cavusmustafa
authored and
ravi9
committed
5a1a131
ggml-openvino: add GGML_OPENVINO_SPILL_DIR to spill weight buffers to disk

cavusmustafa
authored and
ravi9
committed
3b89dc2
Stateful Performance: Added pass::KVStateSeqAxis to change KV layout

cavusmustafa
authored and
ravi9
committed
7dd49dc
ggml-openvino: fix stateful decode past the sliding-window size

cavusmustafa
authored and
ravi9
committed
b61592a
ggml-openvino: refuse stateful decode that cannot resume from the KV state

cavusmustafa
authored and
ravi9
committed
fb28a15
ggml-openvino: use the per-layer KV head count for the stateful KV state

cavusmustafa
authored and
ravi9
committed
c5f754a
ggml-openvino: apply the KV state relayout to any KV head count

cavusmustafa
authored and
ravi9
committed
fd9bc04