Commit Graph
20653 Commits
Author SHA1 Message Date
81841d6bdc [Fix] hicache: Fail fast on a null pointer from the Mooncake host allocator (#40565)
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
2026-10-22 20:12:25 +08:00
Jzz1943 8a6770d566 [Fix] NIXL: Preserve explicit UCX network device selection (#45722) 2026-10-22 20:07:27 +08:00
weireweireandweireweire 96f013b452 [Doc] Cookbook: update GB300 DSV4.1 disagg AgentX launches from InferenceX #4303 (#45495)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-10-22 19:18:55 +08:00
Alex NailsandClaude Opus 5.5 d0a7565436 [Fix] diffusion: Drop stale mismatch_msg from FLUX 3 video VAE gate call (#45778)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 01:31:54 -07:00
Liangsheng Yin 3f6c313389 [Fix] diffusion: Restore the kernel registry import after #41894 (#45775) 2026-10-22 01:25:13 -07:00
ashwini rathi 5c2cb60790 [Fix] [Intel] diffusion: Restore copy offload for FLUX.2-dev nightly (#45725) 2026-10-22 16:24:41 +08:00
Michael 0a87f163dc [Test] [AMD] deepseek-v4.1: Fix the HIP breakable-graph unit tests for the default prefill context limit and the DSpark draft ring (#45507) 2026-10-22 01:14:14 -07:00
kangwangamd 1c967f5043 [Fix] [AMD] test: Recalibrate MiniMax-M2.7 GSM8K threshold 0.93->0.91 for MI300 runners (#34241) 2026-10-22 01:08:54 -07:00
jacky.cheng b5137693a5 [Fix] [AMD] diffusion: Enable --quantization fp8 on gfx1250 (torch.compile lowering + per-channel weight scales) (#45304) 2026-10-22 01:05:36 -07:00
WenhaoZhangandMick Qian 24e45961c6 [Perf] diffusion: fuse QKV norm + RoPE, cached RoPE tables for FLUX 3 video VAE (#41894)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-22 15:44:54 +08:00
James XuandCursor c64886f9e3 [Perf] diffusion: fuse Wan VAE DupUp3D shortcut add (#32860)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-10-22 15:38:51 +08:00
Ankit DhallandAnkit Dhall f727076ed0 [Feat] diffusion: support wan-animate-2 distilled model (#44085)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
2026-10-22 15:37:08 +08:00
Shuwen Wang 9d5386fd13 [Perf] dsv41: Fuse request-window layout construction (#45726) 2026-10-22 00:13:33 -07:00
shun8686 33a0734ca1 [CI] [NPU] precise-test: collect multimodal_gen coverage per test case (#45553) 2026-10-22 15:11:47 +08:00
黄孝君 569dda1e61 [CI] [NPU] npu: Update SGLang kernel tag to 2026.9.0.post10 (#45288) 2026-10-22 14:55:56 +08:00
Baizhou Zhang 779adb4b82 [Perf] cuda-graph: Raise MLA prefill capture default to chunked size capped at 8192 (#45565) 2026-10-21 23:49:25 -07:00
f68e82e7bc [Fix] epd: Accept tokens-in requests on scheduler-side transfer backends (#41376)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 14:45:38 +08:00
Liangsheng Yin 82f7249ce6 [Perf] dsv4: Gather V4.1 index-K slots once per prefill graph replay (#45741) 2026-10-21 23:34:17 -07:00
Ziyi XuandClaude Opus 5.5 a56024c267 [CI] flash-mla: Add the sgl-flash-mla release workflow (#45651)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-21 23:34:14 -07:00
Shangming Cai 9569a36561 [Feat] scheduler: Gate --prefill-decode-interval on running batch size (#44001) 2026-10-22 14:30:12 +08:00
Richard Wang ce66b3ab59 [Feat] systemone: serve Kev pointer head decision models (#45413) 2026-10-22 14:16:52 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 12370da115 [Doc] cookbook: Refresh SemiAnalysis AgentX launches with five open InferenceX PRs (#45749)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 14:15:19 +08:00
Shangming Cai a6a6beffac [Refactor] disaggregation: Share the flag all-reduce and host-destination predicate in the decode transfer queue (#45641) 2026-10-22 13:42:55 +08:00
WenhaoZhangandMick d9ce511646 [Feat] diffusion: support FastH3 Omni (Ref2VA 8-step PDD) (#45530)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-22 13:07:13 +08:00
MickandMick Qian 3472e16f96 [Refactor] diffusion: remove the deprecated kitchen_int8 alias (#45706)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-22 13:06:07 +08:00
Shuwen Wang 80263b5580 [Fix] sgl-router: Do not abort forwarded requests on reqwest's default 30 s TCP_USER_TIMEOUT (#45696) 2026-10-22 12:43:54 +08:00
zijieandZijie Chen f91b81b82a [Doc] [AMD] cookbook: Add Muse Spark Open MI355X AgentX recipe (#45689)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
2026-10-21 21:12:52 -07:00
ApeiriaandRain Jiang 8d7df07a56 [Feat] rust-server: Add HiCache storage management endpoints (#44726)
Signed-off-by: 0130w <1157374677@qq.com>
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
2026-10-22 04:01:35 +00:00
Liangsheng Yin 17babd67b4 [Fix] dsv4: Never read attention metadata for idle SWA stores (#45699) 2026-10-21 20:56:40 -07:00
WenhaoZhang 45de4adde9 [Feat] diffusion: Add worker-side ComfyUI compatibility patches (#44841) 2026-10-21 20:41:51 -07:00
Thomas Wang 9ee9858805 [Doc] [AMD] dsv41: Update amd cookbook 1021 (#45693) 2026-10-21 20:33:34 -07:00
Khoa Pham f1e26dc658 [Perf] logits: Write lm_head logits straight into the fp32 logits buffer (#45631) 2026-10-21 20:32:16 -07:00
WenhaoZhang 1962cbeebe [Perf] diffusion: convrot_int8 comfy_kitchen issues one GEMM per layer by default (#44179) 2026-10-22 11:30:32 +08:00
Viraat ChandraandClaude Opus 5.5 5f62e23d30 [Doc] cookbook: Add Muse Spark Open GB300 Dynamo + SGLang deployments measured with AA AgentPerf (#45629)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 11:24:58 +08:00
Shuwen Wang 6929afb528 [Fix] hisparse: Keep PD destination host pages until the decode KV release (#45108) 2026-10-22 11:19:21 +08:00
8dc7f98005 [Perf] pd: Send prefill KV chunks without a host sync on the scheduler thread (#45492)
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
2026-10-21 20:11:16 -07:00
3468a65b51 [CI] labeler: Add a mooncake PR label (#45578)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Teng Ma <stmatengss@users.noreply.github.com>
2026-10-22 11:09:48 +08:00
MickandMick Qian 780a5b1acc [Doc] diffusion: document prompt enhancer tasks and link Cosmos recipes (#45705)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-22 10:28:58 +08:00
Tamir BaydasovandClaude Opus 5.5 b057d5b3f1 [Fix] [NPU] mla-pool: DCP allocator page and index-K bound, short-pool warning (#42976)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 05:24:14 +03:00
b453996b7d [Doc] diffusion/minimax-h3: Refresh VDN-H3 B200 benchmarks, fix 8-step bench presets and popular-models snippet (#45267)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-22 10:09:13 +08:00
em-dreyerandClaude Opus 5.5 3d508d614f [CI] [NVIDIA] gb300: Run DSV4.1-Flash tests on 2 GPUs with engram host tables (#45294)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-21 18:53:24 -07:00
wutao 67bbfcee3c [Perf] [NPU] scheduler: Remove blocking seq_lens D2H from graph replay (#45170) 2026-10-22 09:50:04 +08:00
Liangsheng Yin d61f618276 [Perf] spec: Let DSPARK prefill publish read-done by placing its draft KV inject before the target forward (#45682) 2026-10-21 18:40:44 -07:00
4049941a82 [Fix] [NPU] scope: fix dtype error in sampling backend ascend (#39609)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Артем Савкин <58187114+OrangeRedeng@users.noreply.github.com>
2026-10-22 04:34:29 +03:00
Khoa PhamandClaude Opus 5.5 aa10927271 [Perf] dsv41: Mega-mHC and the wo_a einsum write MXFP8 for wqkv_a and wo_b (#45632)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-21 18:27:21 -07:00
Baizhou Zhang 59149553b9 [Refactor] attention: centralize linear and draft TP group selection (#45684) 2026-10-21 18:25:40 -07:00
Rohan VarmaandYangmin Li 9ec74a53cc [Fix] [NVIDIA] docker: Build sgl-deep-gemm 0.2.3 for cu134 to match the sglang pin (#45521)
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
2026-10-22 09:01:05 +08:00
Jimmy Shong 9301ca37a0 [Fix] modelopt: Correct NVFP4 TRT-LLM clamps for untied gate/up scales (#45386) 2026-10-21 17:37:07 -07:00
Michael 5fff58a169 [CI] [AMD] miles: Fix the ROCm 10 nightly suites that never finish (#45469) 2026-10-21 17:24:51 -07:00
eacd0a07d7 [Feat] bench: support --tokenize-prompt for generated-shared-prefix (#40900)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
Co-authored-by: chaoyujiang <chaoyujiang@hygon.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-10-22 08:17:15 +08:00