Commit Graph

Select branches

Hide Pull Requests

dsv41-pd

main

Mono Color

• 63845a1bb2 [router] Resolve a wire protocol per worker at registration (#39004) 3 people 2026-09-15 16:54:37 -07:00
• 0dabef3d30 [misc] Fix tool-call index, graph padded-row count, and prefill-graph input_embeds refresh (#39574) Liangsheng Yin 2026-09-15 16:37:22 -07:00
• fb91baedab [Router] Real-GPU e2e coverage for storage-tier-aware cache routing (3/4) (#39110) 3 people 2026-09-15 15:48:51 -07:00
• b803cfa0c4 Add external multimodal processors to the Rust frontend (#39329) Lianmin Zheng 2026-09-15 15:38:47 -07:00
• 2929a39927 Use a shared byte budget for unified hybrid-SWA memory (#36729) 3 people 2026-09-15 15:27:00 -07:00
• 4da5599e93 Fix first-token metadata and reused attention-layer indexing (#39328) 3 people 2026-09-15 15:22:26 -07:00
• 08b1922405 fix(gemma4): set lm_head_is_tied for Gemma4UnifiedForConditionalGeneration (#35809) 3 people 2026-09-16 03:46:39 +05:30
• 87c9f78e99 [Fix][PD] Give prefill and decode their own RDMA NICs in disaggregation tests (#39584) Liangsheng Yin 2026-09-15 15:07:42 -07:00
• 406c9c71d8 [Feature] Support BF16 and batch-invariant inference with DeepEP v2 (#38160) Cheng Wan 2026-09-15 14:30:50 -07:00
• d58342deab [Fix] Release NCCL on scheduler exit and let the ASGI server own shutdown (#39560) Liangsheng Yin 2026-09-15 13:39:15 -07:00
• 3c48c1e967 [Router] Expose the KV storage-tier stream and tree occupancy on /metrics (2/4) (#39109) 3 people 2026-09-15 13:30:05 -07:00
• 24874f90a3 [Test] Fix DeepGEMM batch invariance test output dtype (#39636) YAMY 2026-09-15 12:40:28 -07:00
• 073fdf97cc Generalize auxiliary outputs (#39164) jasonjk-parkandjasonjk 2026-09-15 12:05:13 -07:00
• 49f540f3c0 [HiCache] Optimize buffer-mode storage existence bookkeeping (#39480) Zhiqiang Xie 2026-09-15 10:49:58 -07:00
• 7f5dd19256 [HiCache] Rework the buffer-mode storage prefetch pipeline and retry bookkeeping (#39283) Zhiqiang Xie 2026-09-15 10:48:49 -07:00
• 03ea13a545 [AMD][CI] Consolidate AMD workflows and retire ROCm 7.0 CI (#38632) Bingxu Chen 2026-09-15 23:45:22 +08:00
• 47a157f257 [CI][Disaggregation] Fix EADDRINUSE flake in test_disaggregation_dwdp_gpt_oss (#39611) Shangming CaiandClaude Opus 5 2026-09-15 23:05:05 +08:00
• 1aeeb25e86 [NPU][CI] Scope NPU nightly artifact dirs by image; fix stale glm5_2 case (#39585) pllimax 2026-09-15 22:55:53 +08:00
• 832ec39cc0 [Intra-node PD][DSV4] Pack all layers into one batch for INTRA_NODE_NVLINK path (#38984) Siyuan ChenandBJWang-ant 2026-09-15 21:08:33 +08:00
• a2a261963f [CI] Fix SWA decode radix cache NIXL import (#39600) Po-Han Huang (NVIDIA) 2026-09-15 21:01:05 +08:00
• 1895cabfa8 Fix mooncake scale joiner groups (#38503) Yoray ZackandPo-Han Huang 2026-09-15 14:07:25 +03:00
• fb01a079a6 [NPU] [CI] Fix multimodal_gen filter leakage and add daily scheduled run (#39411) Elizaveta Martirosianandronnie_zheng 2026-09-15 15:03:11 +04:00
• 17ba2c2e7c Support non-strict GLM47 tool calls with EBNF constraints (#38890) Yuxuan ZhangandXinyuan Tong 2026-09-15 16:41:48 +08:00
• 2c0a70960c [qwen 3.8 next] reuse old cuda stream instead of endlessly creating streams (#39474) Qiaolin Yu 2026-09-15 01:36:14 -07:00
• 8565b11003 [misc] Trim redundant variants from the 8-gpu-h20 disaggregation test suite (#39544) Liangsheng Yin 2026-09-15 01:24:46 -07:00
• 4f52c9948b keeping router GEMM in fp32 for deterministic inference (DeepSeek V3/V4) (#38176) 3 people 2026-09-15 04:16:09 -04:00
• 37ebacb50f [EPLB] Drop defensive getattr for ep_dispatch_algorithm (#31804) Beihao ZhouandBrayden Zhong 2026-09-15 01:14:41 -07:00
• df254b0a11 [profiler] Label draft-runner steps DRAFT and target verify VERIFY in step spans (#38630) Bi XueandLianmin Zheng 2026-09-15 00:57:05 -07:00
• 0e9b6bf8d8 [Router] Extract worker selection into policies::selection (no behavior change) (#39322) 3 people 2026-09-15 00:49:31 -07:00
• e4a6b090f4 [CI] Run test_unified_radix_cache_kl_dcp on cutedsl_mla with bf16 KV cache (#39553) Khoa Pham 2026-09-15 00:35:01 -07:00
• 8a20062652 [NPU][Bugfix] Disable pinned memory to fix DeepSeek-V2 DP-attention hang (#39423) iridiumine 2026-09-15 14:59:31 +08:00
• 575163ff32 [NPU] [DOC] delete unsupported models in npu docs (#39555) amote-i 2026-09-15 14:55:17 +08:00
• 06992c92ad [Fix] Aggregate all IPC weight update responses (#39534) 3 people 2026-09-14 23:25:46 -07:00
• 860fa83a9f [CI] Wait for a killed test server's GPU memory before the next launch (#39545) Liangsheng Yin 2026-09-14 23:24:37 -07:00
• e687b8d6af [CPU] Implement fused QK Norm and RoPE kernels (#37748) Cui Lily 2026-09-15 14:17:57 +08:00
• 2c37b90ad6 [Fix][DCP] Localize widened KV ids in MLA retraction CPU backup/restore (#39487) Khoa PhamandClaude Fable 5.1 2026-09-14 22:33:41 -07:00
• ddd4600197 [Fix] HiCache startup ImportError on the pinned kernel wheel (#39516) 4 people 2026-09-15 13:31:19 +08:00
• 5298d85218 fix: stop shadowing the DSpark shared-experts fusion guard (#39366) Shuwen Wang 2026-09-15 13:24:49 +08:00
• b510881157 [Fix][Qwen-VL] Normalize <image> sentinel on artifact fast path (#39278) ashwini rathiandClaude Opus 4.7 2026-09-15 10:49:59 +05:30
• 6c514ab025 Force reasoning mode for GLM-5.3 chat templates (#39227) 5 people 2026-09-15 13:16:26 +08:00
• ebd37705e4 [PD][LoRA] Gate decode admission on adapter slots (#39332) Yanbin Jiang 2026-09-14 22:11:04 -07:00
• 3f871a246c feat(agent sessions): attribute stored KV cache blocks to sessions (#37482) ishandhanani 2026-09-14 21:34:49 -07:00
• c9fbe5f655 [MM] Add flag to force Kimi image preprocessing onto CPU (#39148) Byron HsuandByron Hsu 2026-09-14 21:19:39 -07:00
• 45b511b2ef [Router] Honor KV-event storage tiers in the cache-aware tree (1/4) (#39108) 3 people 2026-09-14 21:18:15 -07:00
• 4b186cfea5 [CI][PD] Skip the flaky decode HiCache file-backend disaggregation test (#39368) Shangming Cai 2026-09-15 11:19:03 +08:00
• bdf8886ad3 [NPU] [DOC] Rename NPU hardware to Ascend A2/A3 Series product (#39389) amote-i 2026-09-15 10:33:14 +08:00
• 5dde6e8f02 Fix MegaMoE buffer allocation and caching for effective SM budgets (#39223) Aurick QiaoandAurick Qiao 2026-09-14 19:24:02 -07:00
• 99060191e7 [KDA] Support ReplaySSM ring-write in the fused chain-verify kernel (#36821) Yuan Luoandluoyuan.luo 2026-09-14 19:22:41 -07:00
• a23fd557ed [Kernel] Add OOT dispatch for clamp position (#38687) JoeandXiaoyu Zhang 2026-09-14 22:22:21 -04:00
• e89d8facab [sgl-router] Prepare dynamo-render dependencies (#39457) Kan WuandClaude Fable 5.1 2026-09-14 19:08:16 -07:00
• a25f213bc4 [diffusion] docs: give the RTX 5090 its own H3 recipe, measured on a physical desktop (#39373) 3 people 2026-09-15 09:15:13 +08:00
• fc4193a63c [HiCache] Remove duplicate benchmark result fields (#38097) Charles xu 2026-09-15 08:56:26 +08:00
• 07e1918924 [Rust] Use Dynamo native renderers when chat templates are missing (#38939) Kan Wu 2026-09-14 17:29:10 -07:00
• 8874c51a96 [Benchmark] Add an opt-out for the token-capacity check (#39284) Xingyu Liu 2026-09-14 17:17:12 -07:00
• c0b8725f5a Fix /model_info serialization when a config value is a class (#39237) raghothamandLianmin Zheng 2026-09-14 17:10:44 -07:00
• 276663a79d [model-loader] Split weight loading from postprocessing (#34981) Yang Liuandyangliu991 2026-09-14 17:10:19 -07:00
• a2b4e8888f Allow CUDA VMM feature transport with the Rust frontend (#39347) Lianmin Zheng 2026-09-14 17:09:49 -07:00
• 6e755e4114 [Logging] Downgrade missing TokenizerManager request state log to warning (#36625) faceless void 2026-09-15 07:18:56 +08:00
• 0163f8ff74 [AMD] Fix registered HiCache host pointer aliases (#35233) AMD-yanfeiwang 2026-09-15 06:49:05 +08:00
• 2fca6d69aa bumping sgl-deep-gemm to 0.2.0 (#39371) Baizhou Zhang 2026-09-14 15:30:31 -07:00
• 710a044caf [dLLM] Add rwang5203 as code owner and grant CI permissions (#39483) Richard WangandRichard Wang 2026-09-14 15:27:15 -07:00
• dad8c074e7 Scope prefetch cache state to the request attempt (#39318) cctry 2026-09-14 15:03:03 -07:00
• d72e59508b Reland fix(qsa): clamp the compress gather to the rows (#38346) (#39446) Qiaolin Yuandehuaa 2026-09-14 14:05:41 -07:00
• 9128d57966 [Spec] Allow speculative workers to stage prefill shared reads (#38554) paulzhang-tm 2026-09-14 17:03:27 -04:00
• 5c2de3f355 [PD] Preserve the prefill rank during rebootstrap (#39357) Byron HsuandByron Hsu 2026-09-14 09:20:37 -07:00
• 7465e42b7a [NPU][CI] Add CANN 9.1.0 and Ascend a5 nightly suites (#38833) pllimax 2026-09-14 22:39:42 +08:00
• 433c999dd0 [NPU][CI] Fix sglang.test.ascend import failure in multi-node e2e pods (#39403) pllimax 2026-09-14 22:23:47 +08:00
• 242d8a70c0 [AMD] GLM-5.2 MI355X MXFP4: bump image to 20260913, enable TOPK_V2 (#39406) ChangLiu0709 2026-09-14 14:50:52 +01:00
• d5f1c593c1 [NPU] Remove temperature/top_p from Qwen3.5-397B-A17B perf test (#39047) pllimax 2026-09-14 21:48:50 +08:00
• f81fbc749a [Fix] Merge adjacent KV-row frees so a mid-page split under DCP cannot double-free (#38941) Kurt Shuster 2026-09-14 09:44:32 -04:00
• 2123aca87e [Fix] Wait for PDL before reading DeepSeek V4 K cache locations (#38409) Aurick QiaoandAurick Qiao 2026-09-14 06:04:28 -07:00
• 87db743021 [NPU] Fix device mismatch in SWA mask for DSpark verify graph capture (#39353) iridiumine 2026-09-14 19:36:33 +08:00
• 66c7bc838e [misc] Revert #38346, #33426, #39061 and #39219 (#39405) Liangsheng Yin 2026-09-14 03:04:07 -07:00
• 5aa9b8fb3e [AMD][DSV4] feat: enable fp8 two-pool unified_kv on gfx950 (#37413) amd-danli103 2026-09-14 17:49:11 +08:00
• 95140a7b0c [docs] DeepSeek-V4: MI355X PD disaggregation recipes for all three strategies (#39396) Theresa Shan 2026-09-14 17:11:51 +08:00
• 5200508b0f [AMD][gfx95] Fill the chunked-prefill compute budget exactly (#32888) Jacob0226andThomas Wang 2026-09-14 15:35:15 +08:00
• 3eeb7d37f9 [AMD] gfx950 assembly attention: length-aware split-KV for dynamic workload (#39172) 3 people 2026-09-13 23:48:03 -07:00
• a4781c9fe5 [NPU] Fix error due to missing parameter quant_linear passing (#37384) ZeyuanChen2000 2026-09-14 14:37:44 +08:00
• ce66ba2844 [AMD] Fix AITER FP8-Q unified-attention Test (#39360) YC Yen-Ching Tseng 2026-09-14 08:35:24 +02:00
• edf9584be9 [AMD][CI] Disable Wave attention test file on ROCm 10 (#39356) Bingxu Chen 2026-09-14 14:34:18 +08:00
• 0d95a9c1ff [HiCache] Keep the file backend temp file name within NAME_MAX (#38925) Shuwen Wang 2026-09-14 13:12:28 +08:00
• 2f5cc8e33e [AMD] Align Qwen3.5 MI355X cookbook with AttnFP8-V2 and HiCache direct / page_first_direct (#39358) jacky.cheng 2026-09-14 12:46:17 +08:00
• 2fd835b9c1 [Fix] Don't write conv state from the fused KDA verify kernel (#39219) Mohammad Miadh Angkadandmmangkad 2026-09-14 12:26:57 +08:00
• 60f6f03409 Fix MUSA detection in compiled prefill path (#39061) Jan Bernlöhr 2026-09-14 06:23:51 +02:00
• f2111715cd [fa] Make the FlashAttention backend extensible by subclasses (#33426) Kurt ShusterandBaizhou Zhang 2026-09-14 00:21:25 -04:00
• 39e147443b [Session] Fix image append positions and parent metadata (#39145) 3 people 2026-09-13 21:06:47 -07:00
• 5a132c061b [Perf] trtllm_mla: reuse the fused fp8 KV/Q prepare on target verify (#39232) Jackey Hua 2026-09-13 23:59:00 -04:00
• 42b5af8c62 [diffusion] docs: refresh the VDN-H3 on b200 numbers in cookbook (#39244) 4 people 2026-09-13 20:50:40 -07:00
• 96a95171c7 chore: bump sglang-kernel version to 0.4.7 (#39346) sglang-botandsglang-bot 2026-09-13 20:49:37 -07:00
• 3480112a9c [diffusion] fix: serve requests that turn cfg off on a cfg-parallel server (#39303) MickandMick Qian 2026-09-14 11:26:37 +08:00
• 4c71d14fba [HiCache][LoRA] Simplify decode offload hash inputs (#39162) 3 people 2026-09-13 20:23:31 -07:00
• f539c1fc65 [sgl-router] Stream outcome observability for 2xx SSE streams (#38737) Kan Wu 2026-09-13 19:46:44 -07:00
• bf9773e1da HiCache: Add @rank_consensus to various functions (#37425) Chao ShiandZhangheng 2026-09-14 10:44:21 +08:00
• ca8ecc6a6f [NPU] Support DSV4 host memory cache management (#37382) Cheng Xin 2026-09-14 10:38:50 +08:00
• 7b4972a9cb chore: add hzh0425 and xiezhq-hermann as Rust tree and HiSparse code owners (#39337) Shuwen Wang 2026-09-14 10:34:55 +08:00
• 6410800af9 [unified-memory] Enable prefill cuda-graph capture (#37418) Cheng Wan 2026-09-13 19:17:19 -07:00
• 2ec4bbcbd4 [unified-memory] PD disaggregation for every unified pool shape (#37506) Cheng Wan 2026-09-13 19:16:43 -07:00
• 6388b6cfb1 [feat] Add base NpuSRTPlatform implementation (#36472) Kurkur 2026-09-14 09:32:24 +08:00
• 4358a1617c chore: bump sgl-kernel version to 0.4.7 (#39324) sglang-botandsglang-bot 2026-09-13 15:48:50 -07:00
• 5ebb16005d [DeepSeek-V4.1] Bump FlashMLA to the fork's rebase head (v4.1 kernels) (#39171) Baizhou ZhangandChunan Zeng 2026-09-13 15:43:19 -07:00