Commit Graph
42 Commits
Author SHA1 Message Date
Ho-Ren (Jack) ChuangandXiaoyu Zhang 5100f8d11d [DSA] Q8KV8 FP8 Sparse Prefill on GLM-5.3-Flash with BF16 KV Cache (#41790)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-13 20:30:13 +08:00
Baizhou Zhang 450837e770 [Docs] Update GLM-5.3-Flash playground: B300 default, CP8, EP and PD (#43802) 2026-10-12 01:38:12 -07:00
Mohammad Miadh AngkadandMohammad Angkad 166b4ae7fc [Fix] Adapt to transformers 5.18 / 5.19 changes (#43688)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-11 23:24:57 -07:00
Baizhou Zhang 33bffcd490 [CP] GLM-5.3-Flash Prefill CP implemented on layer boundaries (#42044) 2026-10-08 20:42:11 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 7b6b6ee25e [Docs] Cookbook: interactive SemiAnalysis InferenceX AgentX launches for GLM-5.2, DeepSeek-V4 and DeepSeek-V4.1 (#42726)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 09:33:40 +08:00
Kevin MiandClaude Opus 5.5 79ef49cb6b [Docs] GLM-5.3-Flash: measured MI355X MXFP4 agentic recipe (#43015)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 15:49:49 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 f2f0be731c [Docs] GLM-5.2: move GB300 AgentX recipe to the agentic HiCache section and drop no-op settings (#42167)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 09:40:30 +08:00
Baizhou Zhang fccc61c1c5 [CP] Support DP x TP x CP for attention with interleave CP strategy (#42038) 2026-10-03 20:57:36 -07:00
Zhang, Jiejing cbe070b6bf [Docs][AMD] Update GLM-5.2 MI355X daily image to 20260930 (#42278) 2026-10-02 15:39:07 -07:00
f17f7705a5 [AMD] [GLM-5.3-Flash] Enable FP8 and MXFP4 serving on gfx950 (#39273)
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: long10024070 <long10024070@users.noreply.github.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: sunxxuns <126995791+sunxxuns@users.noreply.github.com>
Co-authored-by: Long Luong <long.luong2+personal@onemount.com>
2026-10-01 15:59:44 -07:00
Mohammad Miadh AngkadandMohammad Angkad 40e1bb0f36 [Docs] Add NVIDIA NVFP4 checkpoint to GLM-5.3-Flash cookbook (#41986)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-01 12:15:30 +08:00
Cheng Wan a9c97c9f69 [Feature] Add --attn-dp-size and deprecate --enable-dp-attention (#41818) 2026-09-30 13:34:18 -07:00
Zhang, Jiejing 26d7539799 [Docs][AMD] Update GLM-5.2 MI355X daily image (#41597) 2026-09-28 15:42:54 -07:00
Liangsheng Yin f337f01b80 [Test] Remove dead eval modules and point GSM8K/MMLU docs to sgl-eval (#41215) 2026-09-25 12:50:31 -07:00
Liangsheng Yin 78980a3b0b [misc] Remove deprecated endpoints, env vars and aliases past two releases (#40795) 2026-09-22 18:14:45 -07:00
Brayden ZhongandXinyuan Tong a0781f2714 [Docs] GLM-5.3/5.3-Flash cookbooks: enable reasoning/tool-call parsers by default via auto (#40497)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-09-22 13:54:08 +08:00
Zhang, Jiejing 66f19f5c46 [AMD] Enable HiCache for GLM-5.2 MI355X throughput recipe (#40570) 2026-09-21 15:28:27 -07:00
ChangLiu0709 45938a24ae [AMD] GLM-5.2 MI355X MXFP4: bump image to 20260916, use HIP Top-K (#40148) 2026-09-18 23:21:58 +08:00
Khoa Pham b98a2d1096 [Docs] GLM-5.3-Flash cookbook: temporarily remove the DCP option (#40036) 2026-09-17 16:17:25 -07:00
ChangLiu0709 242d8a70c0 [AMD] GLM-5.2 MI355X MXFP4: bump image to 20260913, enable TOPK_V2 (#39406) 2026-09-14 21:50:52 +08:00
Zhang, Jiejing 288627e400 [AMD] Document GLM-5.2 MXFP4 recipe update on MI355X (#39230) 2026-09-12 15:57:15 -07:00
Xinyuan Tong b5a2aebc7e [Docs] GLM-5.3-Flash cookbook: fixed MTP 5/1/6, EP1 + flashinfer_trtllm on Blackwell (#39213) 2026-09-12 12:56:57 -07:00
Zhang, Jiejing d7c284b894 [AMD] Use the triton DSA backend for GLM-5.2 MXFP4 on MI355X (#39106) 2026-09-11 11:48:50 -07:00
William Hu 0084030179 Add Opt-In for GLM-5.3 Flash breakable prefill CUDA graphs (#38522) 2026-09-09 17:02:08 -07:00
Baizhou Zhang e54ff1efb9 [CP V1 Deprecation 5/5] Update prefill CP documentation (#36230) 2026-09-08 19:27:49 -07:00
92a4d8b5ee Clean logging under --weight-loader-prefetch-checkpoints (#33930)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-09-04 20:05:53 -07:00
Faradawn Yang 9c70d22721 Update GLM-5.2 NVFP4 B200/B300 for AgentX HiCache (#35368) 2026-09-02 14:39:09 -07:00
zijiexiaandClaude Opus 5 dc1ae02684 [Cookbook] Add the DFlash2 speculative option to GLM-5.3 (#37392)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-01 09:08:28 +00:00
zijiexia 6c72b49a57 Revert "[AMD] Add GLM-5.3-Flash recipes for MI300X, MI325X, and MI355X (#36608)" (#37380) 2026-09-01 01:25:13 -07:00
Xinyuan Tong 60548501bb [Docs] Add NVFP4 section to GLM-5.3-Flash cookbook (#37109) 2026-09-01 14:14:30 +08:00
395c2258c3 [Docs] Add GLM-5.3 cookbook (#36827)
Co-authored-by: JustinTong0323 <xinyuantong.cs@gmail.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Mohammad Angkad <176301910+mmangkad@users.noreply.github.com>
2026-08-28 14:56:06 +00:00
zijiexiaandClaude Opus 5 6ccfeb59bc cookbook: add a Speculative card to the GLM-5.3-Flash playground (#36740)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 16:03:59 -07:00
Xinyuan Tong d1f14431fd GLM-5.3-Flash cookbook: HiCache for LL, fusion-flag drop, EAGLE, default-cell numbers, DCP4 overlay (#36544) 2026-08-28 03:18:25 +08:00
zijiexiaandClaude Opus 5 46a544e0a0 [Docs] GLM-5.3-Flash: point at compute-mamba-ratio for the KDA/KV pool split (#36719)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 12:16:35 -07:00
zijiexia 636a6f7dba cookbook: fix GLM-5.3-Flash speculative flag, size Hopper memory, record GSM8K (#36660) 2026-08-27 02:19:47 -07:00
andyluo7 0f7b5b8b2a [AMD] Add GLM-5.3-Flash recipes for MI300X, MI325X, and MI355X (#36608) 2026-08-27 05:19:57 +00:00
Xinyuan Tong e27a7fac77 GLM-5.3-Flash cookbook: default Blackwell recipes to FP8 KV + TRT-LLM DSA (#36519) 2026-08-27 00:51:05 +08:00
Xinyuan Tong dfc40e0efe Add GLM-5.3-Flash cookbook (#36440) 2026-08-26 07:00:16 -07:00
zijiexiaandClaude Opus 5 fe8f9d7457 [Docs] Add --prerelease=allow to cookbook uv install commands (#35920)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-21 15:51:48 -07:00
Han-Yin ChangandClaude Fable 5 22dde1dd5b [Docs] Fill GLM-5.2 H200 FP8 speed cells (low-latency, balanced); fix MTP notation (#31554)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-14 13:56:55 -07:00
ajith-sirra-amdandgiovanniguastiamd b5d1453ed2 [AMD] GLM 5.2 MXFP4 SGLANG COOKBOOK (#34379)
Signed-off-by: Sirra <asirra@amd.com>
Co-authored-by: giovanniguastiamd <giovanni.guasti@amd.com>
2026-08-12 03:39:25 -07:00
zijiexiaandClaude Opus 4.8 b819d2fb5b [Docs] Rename docs_new/ to docs/ (#32123)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-08-03 16:51:00 -07:00