Commit Graph

Select branches

Hide Pull Requests

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• fddfc1fb5e [GDN] Support FlashInfer GDN prefill with extra-buffer radix cache (#29735) YAMY 2026-07-29 09:47:35 -07:00
• 50029f05a3 [HiCache] Merge HiCache event checks to reduce decode overhead (#30511) huangtingweiandalphabetc1 2026-07-29 23:48:48 +08:00
• bfc450248e [AMD] Replace MI325 with MI300 CI Runners (#31409) Bingxu Chen 2026-07-29 23:18:07 +08:00
• e1f2f9d1fa Disable extra NCCL CUDA event synchronization with symm mem (#27089) Nicolas Castet 2026-07-29 09:39:36 -05:00
• 3763d3fa8c Add decode-lock skip to compute-mamba-ratio (#32789) Ke Bao 2026-07-29 22:38:34 +08:00
• 1c6a0e91e1 fix mqa preshuffle layout issue for deepseek v4 (#31563) Wu Jiangming 2026-07-29 22:36:48 +08:00
• 22151edca1 [diffusion] optimization: accelerate CUDA video output finalization (#32784) Mick 2026-07-29 22:04:20 +08:00
• 0ebbe43dbb fix(diffusion): size VSA top-k from padded blocks (#32695) Xiaoyu Zhang 2026-07-29 21:58:41 +08:00
• 4f5b50c576 perf(diffusion): decode Wan VAE in BF16 (#32697) Xiaoyu Zhang 2026-07-29 21:57:50 +08:00
• 917e900d4d feat(diffusion): add regional torch compile (#32696) Xiaoyu Zhang 2026-07-29 21:57:05 +08:00
• 50b029257f Skip mamba lock during decoding (#32228) Ke Bao 2026-07-29 21:53:28 +08:00
• d004a15a3e Fix GLM4-7B-Flash accuracy test configuration, tune Qwen3.6-27B/35B performance test parameters, and harden Ascend NPU multi-node E2E test utilities against pod name format errors. (#32371) pllimax 2026-07-29 21:44:17 +08:00
• 977f04aafe [PD] NIXL connector: shard by destination (#32025) Ilia Yastrebov 2026-07-29 15:02:13 +02:00
• 67c2258906 [diffusion] fix: fix dual-DiT models crash with (1,)-placeholder weights after compile-time offload (#32743) MickandClaude Sonnet 5 2026-07-29 20:44:13 +08:00
• ca6e0ff2c8 [NPU] fix dsv4 mtp condition on NPU graph (#32711) JiaruiChang5268 2026-07-29 20:13:31 +08:00
• d254ec9ff8 Add LFM2.5 embedding model support (#28691) Yi (Vincent) Zhong 2026-07-29 04:58:47 -07:00
• 4c82bb3252 Add Mooncake tenant id support (#30256) LZW 2026-07-29 18:17:41 +08:00
• 8742a1a0f8 Add a benchmark script for the HPC-Ops bf16xfp32 router GEMM (#32642) Xiaoyu ZhangandClaude Fable 5 2026-07-29 18:17:08 +08:00
• c151080d28 Add compute-mamba-ratio skill (#32763) Ke Bao 2026-07-29 18:15:48 +08:00
• d12ea3e9ba docker: add Kimi K3 images (#32760) Baizhou Zhang 2026-07-29 03:02:28 -07:00
• 983e4aa18d Eliminate redundant DSA state transfers (Mooncake) (#32620) hunhokimandHun-ho Kim 2026-07-29 18:58:48 +09:00
• f5bcd00e16 [AMD] DSv4: bring HIP compress-state pool into the memory_saver KV_CACHE region (#31747) Xinyu JiangandZhiyao Jiang 2026-07-29 02:41:08 -07:00
• c32c4ef79c [Kernel] Move sgl-kernel under sglang.kernels.aot (#32648) Xiaoyu Zhang 2026-07-29 17:25:00 +08:00
• 1b9dfa14e6 Fix FlashInfer MNNVL workspace size check (#32318) Mohammad Miadh Angkad 2026-07-29 17:12:18 +08:00
• 9ab88380c1 👥 chore(codeowners): Update codeowners for NPU quantization (#31917) Junlin Wu 2026-07-29 17:10:01 +08:00
• 227dadd79a [diffusion] feat: support resident layers for DiT (#31538) Yihao Wang 2026-07-29 01:52:55 -07:00
• 0caf0fc01d [Diffusion][Docs] Ascend A2, A3 add basic usage and benchmark results in diffusion cookbook (#30614) Andrew KuksaandANDREW_K 2026-07-29 11:50:15 +03:00
• 7dcebca255 Fix nightly CI: NVFP4 cuda-graph crash, NVILA batching, CuTe paged-KV zero-size, Kimi-VL OOM (#32118) Brayden ZhongandBrayden Zhong 2026-07-29 01:39:55 -07:00
• cce5873513 [CI] Fail lint when a registered file's TestCase classes never run (#32735) Liangsheng Yin 2026-07-29 00:45:01 -07:00
• f05c92fb6d ✨ [llm][npu][quant] Add W8A8 MXFP8 quantization for Qwen3 MoE on Ascend NPU (#30768) 3 people 2026-07-29 15:39:36 +08:00
• da5528db30 fix(vlm): materialize Qwen3-VL features on the vision device (#31596) Mick 2026-07-29 15:25:04 +08:00
• bd47ec97ff [EAGLE] Handle NaNs in fused top-k=1 (#32396) weireweireandweireweire 2026-07-29 15:07:42 +08:00
• 7c248dde7f [diffusion] fix: don't self-kill diffusion worker when PID 1 is the real parent (#31361) Jyothirmai KottuandMick 2026-07-28 23:35:56 -07:00
• 9bdbb180b1 [Disagg][NIXL] Fix heterogeneous attn-TP KV transfer for replicated GQA heads (NIXL_ERR_NOT_FOUND) (#31968) siweil 2026-07-28 23:13:23 -07:00
• ef6c07008b Support DCP for Kimi Linear model (#32612) 3 people 2026-07-28 22:59:58 -07:00
• c4fc241fd3 [Perf] Free KV pages by segment in the paged allocator without a device sync (#32701) Liangsheng Yin 2026-07-28 22:24:16 -07:00
• bf6e80718a [Elastic EP] fix previously flaky test of test_mooncake_ep_small.py (#31706) Xun Sun 2026-07-29 13:14:12 +08:00
• f01a0c7f97 Fixing MXFP8 online quantization pipeline (#31510) Brayden Zhong 2026-07-28 21:26:13 -07:00
• 68673fe6c5 [AMD] add Gemma3RMSNorm.forward_hip to unbreak ROCm (#32613) YC Yen-Ching Tseng 2026-07-29 12:19:17 +08:00
• 9a03bebf13 docs(kimi-k3): clarify VLM compatibility (#32661) Mick 2026-07-29 11:53:04 +08:00
• 1af0167493 [EPD][VLM] Fix Kimi-VL 2D encoder grids (#32104) Xiaojun(Robin) Zhang 2026-07-28 20:46:17 -07:00
• d6fcfe02d6 🐛 [llm][npu][quant] Fix ModelSlim MXFP4 packed weight loading (#32013) Junlin Wu 2026-07-29 11:34:41 +08:00
• 9ea964a535 [diffusion] fix: per-shard FP8 scale shape for single-GPU fused linears (#32157) Yihao Wang 2026-07-28 20:28:01 -07:00
• b21cc8eb9b [misc] Update CodeOwner (#32717) Baizhou Zhang 2026-07-28 19:55:14 -07:00
• 14bd315d6e [Refactor] Remove dead allocator backup_state / restore_state (#32709) Liangsheng Yin 2026-07-28 19:49:47 -07:00
• dac4325c0e sgl-kernel-npu tag update to 2026.7.27 (#32596) monkeyLoveding 2026-07-29 10:22:13 +08:00
• 339bef7fad [MLX] Fix overlap-loop request bookkeeping and graceful shutdown (#32447) 4 people 2026-07-29 10:04:53 +08:00
• 580b1acbe6 [MLX] Move fused swiglu tests to test/registered so CI collects them (#32448) 3 people 2026-07-29 10:04:24 +08:00
• ee678910f7 [Kernel] Skip KV writes to reserved padding slots (#32477) Leon GaoandAndrew Gu 2026-07-28 18:58:18 -07:00
• d86492fea0 [NPU] adapt dflash v2 on npu (#31739) gjsheu 2026-07-29 09:39:19 +08:00
• cb12a1547b [NPU] [DOC] update supported features on ascend npu (#32647) amote-i 2026-07-29 09:05:21 +08:00
• 16a52bff23 [Refactor] Move sampling tokenizer validation helper (#32694) Lianmin Zheng 2026-07-28 16:48:03 -07:00
• 86ee545388 docs(cookbook): update Kimi-K3 GB200 recipes from measured 4x4 runs (#32592) YAMYandLee Nau 2026-07-28 16:26:40 -07:00
• 9ca4023b13 [Core] Clean up array-like msgspec structs (#32688) Lianmin Zheng 2026-07-28 16:25:22 -07:00
• 70ea37e7e0 vlm: reject moss vision metadata mismatches (#31957) Mick 2026-07-29 07:09:54 +08:00
• c9947b087b Enable multimodal prefill BCG for VL and audio models (#30872) Xiaoyu Zhang 2026-07-29 06:47:40 +08:00
• 85618cc798 docs: update sglang cookbook (#32654) Liangsheng Yin 2026-07-28 15:33:24 -07:00
• 7778dd23ea [diffusion] refactor: remove stale kernels and dead code (#32651) Xiaoyu Zhang 2026-07-29 06:23:23 +08:00
• 7f438a6031 feat: SM120 (Blackwell Desktop) support for GLM-5.1 inference (#26928) Void 2026-07-29 05:52:34 +08:00
• 9c0dbf508f [cookbook] add inkling dspark command (#32465) Qiaolin YuandZijie Xia 2026-07-28 14:33:38 -07:00
• 0a49226d19 [LoRA] 1/n Per-rank tensor serialization for load_lora_adapter_from_tensors under dp_size > 1 (#32580) Ethan (Yusheng) Su 2026-07-28 14:28:56 -07:00
• d943636a48 support regex that compatible with python re lib however apply more l… (#32676) Rain Jiang 2026-07-28 14:25:31 -07:00
• dd67452b4f [Cleanup] Move mamba-max-states-per-path validation into _handle_mamba_backend (#32502) YAMY 2026-07-28 14:21:21 -07:00
• b8b9f3c8f5 [misc] update CI_PERMISSIONS.json (#32679) Qiaolin Yu 2026-07-28 14:12:29 -07:00
• 4e5a05148a [FullCG] Support chunked cached-prefix prefill (#30825) paulzhang-tmandClaude Fable 5 2026-07-28 14:20:25 -04:00
• 1eee8fbdcc [PD] Drain NIXL completion notifications before enforcing the WaitingForInput timeout (#32267) IvanShan177andClaude Opus 4.8 2026-07-29 00:20:03 +08:00
• ee236086db Fix invalid escape warnings in tool parsers (#28370) Xinyuan TongandFAN YUCHEN 2026-07-28 23:31:47 +08:00
• 84cdfde5b2 [diffusion] fix: fix diffusion output stability on mps (#30017) Mick 2026-07-28 21:55:03 +08:00
• 32c30c0f96 Return 400 instead of 500 for unfetchable or unparseable multimodal inputs (#31417) 3 people 2026-07-28 05:23:42 -07:00
• 161fffedfc docs: clarify diffusion stage reuse guidance (#32639) Mick 2026-07-28 19:52:52 +08:00
• 75017c3fa0 [diffusion] fix: keep fused qk-norm-rope out of dynamo tracing (#31849) Mick 2026-07-28 19:51:00 +08:00
• a24906a091 [diffusion] feat: add dynamic cuDNN SDPA attention backend (#30090) Mick 2026-07-28 19:50:24 +08:00
• 5558dbad00 [NPU] Optimize DeepSeek-V4 performance (#31931) Talantan1102 2026-07-28 19:45:46 +08:00
• 51397af885 Pack aux hidden states into a preallocated buffer (#28956) James LiuandClaude Opus 4.8 2026-07-28 04:37:18 -07:00
• 4fe8f5218d [AMD] Add Kimi K3 ROCm 7.2 nightly image (#32643) 3 people 2026-07-28 18:45:23 +08:00
• 9cffc2ba52 [Kernel] Remove unused implementations and stale registry entries (#32636) Xiaoyu Zhang 2026-07-28 18:12:10 +08:00
• dde03d7c4a [JIT] Restore the previous division behavior in per-token group quantization (#32616) hjzhangandhjzhang 2026-07-28 17:56:36 +08:00
• 2b6e01c673 [AMD] Run AITER Scout on Saturdays (#32632) YC Yen-Ching Tsengandbingxche 2026-07-28 16:56:51 +08:00
• 60d6914f17 [UnifiedTree]: move /mem_cache/unifed_cache_component dir to /mem_cache/unified_cache (#32484) Zhangheng 2026-07-28 16:28:21 +08:00
• fc8b328f5c [Model] Support standalone text-only Qwen3.5 checkpoints (#32401) Xinyuan Tongandliyucheng09 2026-07-28 14:08:39 +08:00
• ec4a7fa2b7 codeowners update (#32608) Alex Nails 2026-07-27 21:21:20 -07:00
• d9cf7b0a8b [MTP] Cut spec-v2 host-seam overhead in hybrid-linear MTP decode (#32219) Yuan Luoandluoyuan.luo 2026-07-28 11:38:33 +08:00
• b79388f338 docs(cookbook): mark every Kimi-K3 cell in-progress; land Playground "Switch base" on the configurator (#32586) zijiexiaandClaude Opus 5 2026-07-27 18:59:57 -07:00
• 356c11d5d9 [Fix] --mm-process-config crash when video config contains (#30260) longxin9715 2026-07-28 09:24:40 +08:00
• edc0e5489f docs: sync LMSYS SGLang blog cards (#32590) sglang-botandsglang-bot 2026-07-27 18:00:29 -07:00
• c19a333944 [mm] Handle per-item embeddings in cache misses (#32498) Lianmin Zhengandcctry 2026-07-27 17:16:17 -07:00
• 5a46e16f01 [Fix] Enable graph capture and MSCCL++ for attention TP groups (#31629) Caio RochaandCheng Wan 2026-07-27 15:56:41 -07:00
• 3005af0941 Fix compressed-tensors NVFP4 MoE W13 layout (#32430) Mohammad Miadh Angkad 2026-07-28 05:56:42 +08:00
• 8a311d1c88 [diffusion] fix: preserve tensor stride when offloading rollout weights to pinned host memory (#32420) Kangrui Du 2026-07-27 12:05:13 -07:00
• 1da062f018 [Inkling] Add minimal DFLASH support (#31840) James Liu 2026-07-27 12:01:13 -07:00
• 7cae831e41 Update mi35x ROCm image to k3-20260727 (#32559) Yuhao Yang 2026-07-28 01:52:41 +08:00
• 3ebb7c2d07 docs: point Kimi-K3 references to public branch (#32547) Mohammad Miadh AngkadandXinyuan Tong 2026-07-28 00:23:43 +08:00
• 7dafacca49 docs(cookbook): add the Kimi-K3 serving cookbook (#32542) 8 people 2026-07-27 08:37:30 -07:00
• 8d6549bc40 [Attention Backend] Extend hpc_ops dynamic-scheduled decode to bf16 (#32304) 3 people 2026-07-27 21:31:04 +08:00
• 5656de2d9a [PD] pool decode bootstrap HTTP sessions (#31543) inkcherry 2026-07-27 21:07:23 +08:00
• db9143ee08 [NPU] Fix MTP IndexShare warm-up for attention DP and prefill CP (#32210) Peng Xingchen 2026-07-27 19:19:38 +08:00
• 34454c06b8 [Refactor] Tidy server_args.py section grouping and drop unused alias (#32496) Lianmin Zheng 2026-07-27 04:09:09 -07:00
• 1d350aaad3 fix(reasoning): let --enable-strict-thinking works for DeepSeek-V4 (#32400) 3 people 2026-07-27 18:15:47 +08:00
• 08af5aea57 optimize: optimize EmbeddingGemma prefill performance (#32383) Mick 2026-07-27 17:34:29 +08:00
• 9a0bd24bed model: serve bare Qwen3Model backbone natively as an embedding model (#32457) Jackey HuaandClaude Opus 5 2026-07-27 00:49:58 -07:00