Skip to content

perf(attention): run up to 8 query rows per request in the triton decode kernel - #900

Merged
jason-fxz merged 2 commits into
mainfrom
feat/decode-multi-row
Nov 13, 2026
Merged

jason-fxz merged 2 commits into
mainfrom
feat/decode-multi-row

fix(attention): keep multi-row triton decode free of register spills …

7e353d1
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings and 1 notice
label
succeeded Nov 13, 2026 in 5s