Repository navigation
README: GLM-5.3-Flash Jammed XSFP4 NZ5 in Pick a model - #2981
Conversation
|
Thanks @Bizuayeu. The row and the recipe sentence match the card at CI is green on
|
Added to the Receipt, taken on |
ashhart#2894 reads NVFP4_NZ5 checkpoints on CUDA. The row lists the one that uses it, after Jammed XSFP4, with its serve at TP=2 and its card's closeness, and the GLM recipe's opening names it beside Jammed XSFP4.
f048007 to
5811c01
Compare
|
Thank you @Bizuayeu. This is merged into main with your commits under your own name, so you're listed as a TensorFold contributor. It ships in the next release, credited to you in the changelog and the release notes. |
What this changes
One row in the README's Pick a model, after GLM-5.3-Flash Jammed XSFP4, and one sentence in the GLM CUDA recipe's opening. #2894 reads
NVFP4_NZ5checkpoints, and Jammed XSFP4 NZ5 is the checkpoint in that form. The row says "on main after 1.2.7", which holds once #2894 is in, so this one lands after it. The row is shorter than its neighbours and leaves the numbers to the card it links.main(000b534a28). Needs glm cuda: NVFP4_NZ5 checkpoints, block 32's experts with E2M1's code 0b1000 read as +5 #2894 merged first: until then, the row and the recipe sentence describe code that is not onmain. With glm cuda: NVFP4_NZ5 checkpoints, block 32's experts with E2M1's code 0b1000 read as +5 #2894's head, this merges clean.atc overlap --json:complete: false(otherPullRequestsLimit,pullFilesUnavailable,timeLimit). Of the pull requests it read, flint: serve Recursive Flint (40B-A2.5B MoE) natively on Metal #1177, lfm3: serve LFM3-1.7B on CUDA: NVFP4 and FP8 weight-only, MLX 4-bit (stacked on #1513, #1492 and #1503) #1508, lfm3 CUDA: serve the block FP8 export weight-only and the MLX 4-bit export as stored (stacked on #1508) #1634, Implement GLP control vectors with a fused Metal kernel for Qwen3.8-27B #1835, glm cuda: TF_GLM_GRAPHS=1 replays verify windows as CUDA graphs (#1490) #2279 and cuda: a shared engine for dense decoders, with dots.mocr's text decoder on it #2673 share a file with this one. flint: serve Recursive Flint (40B-A2.5B MoE) natively on Metal #1177, Implement GLP control vectors with a fused Metal kernel for Qwen3.8-27B #1835, glm cuda: TF_GLM_GRAPHS=1 replays verify windows as CUDA graphs (#1490) #2279 and cuda: a shared engine for dense decoders, with dots.mocr's text decoder on it #2673 merge clean; lfm3: serve LFM3-1.7B on CUDA: NVFP4 and FP8 weight-only, MLX 4-bit (stacked on #1513, #1492 and #1503) #1508 and lfm3 CUDA: serve the block FP8 export weight-only and the MLX 4-bit export as stored (stacked on #1508) #1634 already conflict withmaininREADME.md.Checks on this head
f048007945python3 tools/zig/lean_check.py, on the base and on this head: n/a, the diff isREADME.mdanddocs/recipes/glm-5.3-flash-cuda.md, no source.python3 tools/pr_check.py --base origin/main: 2 changed files, lean 345 vs 345, 0 new, 0 errors and 0 warnings.fmt,zig,zig-windows,zig-macos-dev-tools,pytest,release-paths, bothbenchmark-clients,desktop,desktop-linux,appimage-linuxandmobile);host-nightly-linuxandhost-nightly-macoswere skipped, as they are on pull requests.Receipt
mainatfde40f638band glm cuda: NVFP4_NZ5 checkpoints, block 32's experts with E2M1's code 0b1000 read as +5 #2894's change, a 40,960-token window, one stream and vision off: rank 0's model 83.53 GiB, and three fixed prompts of 512 greedy tokens each gave the sametoken_sha256drafted and with"draft": false. glm cuda: NVFP4_NZ5 checkpoints, block 32's experts with E2M1's code 0b1000 read as +5 #2894's own receipts were taken on its head.mainwith glm cuda: NVFP4_NZ5 checkpoints, block 32's experts with E2M1's code 0b1000 read as +5 #2894: as glm cuda: NVFP4_NZ5 checkpoints, block 32's experts with E2M1's code 0b1000 read as +5 #2894 is not in yet,mainat3885dceb2bwith glm cuda: NVFP4_NZ5 checkpoints, block 32's experts with E2M1's code 0b1000 read as +5 #2894's head39abe29739merged into it (no conflicts), built with an empty global cache, Zig 0.17.0 and nvcc 13.3 for sm_121. Two GB10s over a direct link (driver 580.178.04),Bizuayeu/GLM-5.3-Flash-Jammed-XSFP4-NZ5@1c900ea0from a local copy of the same bytes, a 40,960-token window, one stream and vision off. The first serve after the page cache was dropped, with the checkpoint's digest read in full (0 of 132 files cached):loaded in 109.7sand rank 0'smodel 83.53 GiB. The same three fixed prompts, 512 greedy tokens each, gave the sametoken_sha256drafted and with"draft": false,8644311e2865,c573bfb5a552and72bbf00e4cb0, as on glm cuda: NVFP4_NZ5 checkpoints, block 32's experts with E2M1's code 0b1000 read as +5 #2894'sb4ced9901e. Once glm cuda: NVFP4_NZ5 checkpoints, block 32's experts with E2M1's code 0b1000 read as +5 #2894 is in, I will serve it again onmainand replace these if anything differs.0a22bb46).Checklist
f048007945, one commit onmainat000b534a28.)@Bizuayeu, as the rows already do.)