Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• a0f3361023 Update (#19351) HAI 2026-02-25 11:37:07 -08:00
• b2c46fc60b [AMD] Support Qwen3-Coder-Next on AMD platform (#18355) jacky.chengandyichiche@amd.com 2026-02-26 03:06:22 +08:00
• cc1ca61c81 fix: add --cuda-graph-max-bs to DSV3 FA3 FP8 KV cache test (#19307) Alison Shao 2026-02-25 10:27:31 -08:00
• 0217e82a08 [diffusion] Clean code (#19325) Makcum888e 2026-02-25 21:16:03 +03:00
• 2fb239450e Revert "bugfix: prioritize init_npu_backend to fix various initialization bugs" (#19343) Even Zhou 2026-02-25 23:04:30 +08:00
• c7c4a1cbbd refactor linear attention backend (#18622) Yuhao Yangandyizhang2077 2026-02-25 23:02:44 +08:00
• 471acd98b9 [diffusion] logging: improve logging (#19312) Mick 2026-02-25 23:00:35 +08:00
• 56891e46bc [Ascend ] Add qwen3.5 122B/35B/27B deployment examples on doc (#19339) Hexq0210andsglang-npu-bot 2026-02-25 21:09:22 +08:00
• 59b9d1e86d [diffusion] improve: improve fuse_scale_shift_kernel with non-blocking op (#18710) Qingfu WenandMick 2026-02-25 21:04:20 +08:00
• c144e55462 Fix HybridAttnBackend forward for linear attention (#19006) akhilg-nv 2026-02-25 05:02:37 -08:00
• d38c0e537d fix(dense): fix Qwen3.5 dense model precision bug in TP_SIZE>1 (#19070) Zheng Li 2026-02-25 20:54:42 +08:00
• cdc411160b [NPU] Fix a corner case where FusedMoE.top_k is not explicitly declared (#19287) Even Zhou 2026-02-25 20:49:59 +08:00
• 9840cd3f68 [diffusion] chore: enable sequence shard for wan by default (#19311) Mick 2026-02-25 18:21:44 +08:00
• 307a2b73ed [AMD] add testcases for Qwen3 235b Instruct 2507 models (#18805) mqhc2020andbingxche 2026-02-25 18:17:52 +08:00
• 60eeef7370 [AMD][with CI Fix] support two batch overlapping for mori ep (#19216) 5 people 2026-02-25 18:14:08 +08:00
• c4ef33862b [diffusion] fix: fix bugs to let LTX-2 pipeline support latest Sglang Args pipelines (#19295) GMI Xiao Jin 2026-02-25 01:30:36 -08:00
• 671b595570 Fix trtllm_mha fp8 SWA KV index translation (#19107) Mohammad Miadh Angkad 2026-02-25 17:02:17 +08:00
• a55f658835 [Misc] Normalize --host parameter to use plain hostname without scheme (#19309) 4 people 2026-02-25 16:37:24 +08:00
• f75abb4521 [Fix][Qwen3.5] Fix KV cache slice transfer for GQA models with replicated KV heads (#19086) YAMYandShangming Cai 2026-02-25 00:26:44 -08:00
• d40cb2f725 [HiCache] Support heterogeneous tp for hicache storage (#18541) huangtingweiandhzh0425 2026-02-25 16:13:57 +08:00
• 3d879c69e9 refactor: extract device-to-backend mapping into get_default_distributed_backend (#19202) 5 people 2026-02-25 15:50:26 +08:00
• d0bb140034 [NPU] bugfix for model Qwen3-Coder-Next at weight shape transpose for npu. (#18700) Hexq0210andMcZyWu 2026-02-25 15:46:20 +08:00
• a1b39c1c26 Perf/fuse mamba state scatter mtp verify (#18088) xutizhou 2026-02-25 15:40:55 +08:00
• ab7071b545 [SKILL] Better claude skills for sgl-kernel and jit-kernel (#19302) Xiaoyu Zhang 2026-02-25 15:26:55 +08:00
• 4a3a787f1e [Fix] Kimi K2.5 support pp (#18434) 4 people 2026-02-25 15:22:11 +08:00
• 8d9ee6669e Fix comment for tp_rank calculation in dp_attention (#19306) Shangming Cai 2026-02-25 15:19:10 +08:00
• 17b0affbdf [AMD] Support --enable-aiter-allreduce-fusion on AMD GPUs (#13747) Hubert Luandyctseng0211 2026-02-24 23:11:55 -08:00
• 73fe389dd1 [Qwen3.5] Raise Exception when radix_cache and extra_buffer are enabled at the same time (#19169) YAMY 2026-02-24 23:04:37 -08:00
• 4dba73087e [CI] grant ci permissions to sglang-npu-bot (#19308) Even Zhou 2026-02-25 14:55:23 +08:00
• 76d5410e01 [Disagg] Fix decode querying unregistered dp_rank when prefill dp_size is 1 (#19305) Liangsheng YinandYangmin Li 2026-02-24 22:52:39 -08:00
• 8bd644765f [AMD] Enable ROCm kvcache JIT path and add AMD CI coverage. (#18992) Hubert LuandCursor 2026-02-24 22:15:05 -08:00
• aff2f130ec [diffusion] CI: fix pr-test workflow file to include changes in jit kernels (#19285) Mick 2026-02-25 14:08:55 +08:00
• ca09d71cf0 Fix nightly grok failure on rotary embedding import (#19192) Michaelandmichaelzhang-ai 2026-02-24 21:25:16 -08:00
• 3fe93b5493 Updated benchmark guide (#19243) nvjullin 2026-02-25 13:11:17 +08:00
• e138f7960a [AMD] Fix accuracy while using --enable-dp-attention (#19247) jacky.chengandyichiche@amd.com 2026-02-25 12:50:28 +08:00
• ab0f608788 [PD-Disagg] Fix bootstrap server race condition when prefill workers not yet registered (#19288) Liangsheng YinandCursor 2026-02-24 20:22:16 -08:00
• 539f772f54 [PD-Disagg] Fully support external DP dispatch w/ PD-disaggregation mode. (#19268) Liangsheng YinandRatish P 2026-02-24 19:58:01 -08:00
• 241ee90164 [diffusion] chore: tiny fix pyproject.toml (#19256) Mick 2026-02-25 11:57:53 +08:00
• 694924b878 Update .gitignore to remove '.claude/' (#19296) Xiaoyu Zhang 2026-02-25 11:51:50 +08:00
• 23adb50751 [AMD] [GLM-5 Day 0] Add GLM-5 nightly test (#18911) Michael 2026-02-24 19:39:17 -08:00
• 1dae3e32b9 update code owners for observability (#19294) Feng Su 2026-02-25 11:26:41 +08:00
• f862214c67 ci: temporarily disable GB200 test stage (#19289) Alison Shao 2026-02-24 19:04:23 -08:00
• 0fac2796b6 [PD-Disagg] Improve KVManager init across all backends (#19240) Shangming Cai 2026-02-25 10:37:09 +08:00
• c0fdfd4b92 Delete mm.feature after decode phase (#17324) siyu 2026-02-25 10:13:03 +08:00
• 9dff933164 [Kernel Slimming] Remove sgl-kernel AOT marlin kernels (#19241) Xiaoyu Zhang 2026-02-25 10:08:22 +08:00
• 3b89302277 Refactor: observability code cleanup (#17862) Feng Su 2026-02-25 10:07:29 +08:00
• 245430eaac Encoder Global Cache Manager (#16137) 3 people 2026-02-25 10:05:43 +08:00
• b7af58b9af Support replication axis in dump comparator (#19282) fzyzcjy 2026-02-25 09:48:43 +08:00
• 2e2b18e870 Support context parallel zigzag reordering in dump comparator (#19281) fzyzcjy 2026-02-25 09:46:17 +08:00
• 0de1f4b07b Support multi axis unsharding in dump comparator (#19280) fzyzcjy 2026-02-25 09:44:07 +08:00
• 4bb678f28a Full test coverage in dump comparator (#19279) fzyzcjy 2026-02-25 09:43:29 +08:00
• 94ca2ac5d7 Support TP unification and enhance tests in dump comparator (#19278) fzyzcjy 2026-02-25 09:42:56 +08:00
• 39ba9b5ab5 Support simple unsharding in dumper comparator (#19277) fzyzcjy 2026-02-25 09:42:21 +08:00
• 02ca107b2c Support dims annotation and enhance dump loader in dumper (#19276) fzyzcjy 2026-02-25 09:41:48 +08:00
• 8b1ab4aaf9 Support agent-friendly output formats in dump comparator (#19275) fzyzcjy 2026-02-25 09:40:33 +08:00
• d7578ce279 Implement simplest dump comparator v2 (#19274) fzyzcjy 2026-02-25 09:37:21 +08:00
• 9cec98b445 [diffusion] fix: shard timestep_proj in sequence-sharded ti2v (#19237) wxy 2026-02-25 09:33:45 +08:00
• 0ede5c54a8 [diffusion] logging: improve request and component load logs (#19253) Mick 2026-02-25 09:32:36 +08:00
• 15f2e36fb9 [NPU] forward_npu uses native impl by default in MultiPlatformOp (#18545) silencejade 2026-02-25 09:16:09 +08:00
• b9cf1563de [ROCm] Optimize Deepseek R1 on MI300X (#18242) Chen, ZhentaoandChen, Todd 2026-02-25 09:01:14 +08:00
• f1088beb6a [NPU]Optimization of forward_npu for UnquantizedFusedMoEMethod (#13158) Vladimir221 2026-02-25 03:55:20 +03:00
• d7a03c7ebf [MoE Refactor] Refactor FlashInferFusedMoE into FusedMoE and flashinfer_trtllm.py (#19266) Jonah Bernard 2026-02-24 19:47:53 -05:00
• 750ecf4a45 Add server CUDA graph warmup CI step for cold H200 nodes (#19201) Alison Shao 2026-02-24 16:07:01 -08:00
• c193a52fa2 [AMD] DSR1/V3 use fp8 bmm in MLA for MI300X (#18624) Chen, ZhentaoandChen, Todd 2026-02-25 07:33:33 +08:00
• 152560d1b9 [PCG] add pcg CI test for gpt-oss model (#18961) Kaiqi Jin 2026-02-24 15:32:34 -08:00
• ae6f6e1495 [Refactor] Benchmark: Add typed DatasetArgs/Loader registry and CPU dataset unit tests (#19147) Ratish PandLiangsheng Yin 2026-02-25 01:52:01 +05:30
• 65de904130 feature: adding image retag workflow (#19265) Douglas Yang 2026-02-24 11:33:05 -08:00
• 0c224c3c62 docs: Embed release lookup tool into Sphinx documentation site (#19264) shuwenn 2026-02-25 03:11:27 +08:00
• 38f25e802d Fix/deepseek readme link (#19258) Alec Leng 2026-02-24 13:46:56 -05:00
• a06425184f [Fix] remove redundant +1 when getting tail_str for Req (#18584) Glen Liu 2026-02-24 13:35:26 -05:00
• 9bce3b040c [diffusion] [NPU] Update perf baselines (#19227) Makcum888e 2026-02-24 21:15:16 +03:00
• e6ad58e5da [diffusion] fix: webui not return data (#19244) Zihao Wang 2026-02-24 23:39:06 +08:00
• 1efc33c640 [diffusion] refactor: remove enums and unify attention backends (#19149) Adarsh Shirawalmath 2026-02-24 18:51:23 +05:30
• ea1bc1c578 [diffusion] feat: optimize all_to_all (#19157) triple-mu 2026-02-24 21:20:10 +08:00
• e3a234478c [NPU][Docs] Add Commonly Used Environment Variables for on NPU (#18556) husf 2026-02-24 20:05:33 +08:00
• 31c7dc9d99 [VLM] Introduce FlashInfer CUDNN Prefill as ViT Backend (#19003) Yuan Luoandluoyuan.luo 2026-02-24 19:49:22 +08:00
• 1a83b2c15d fix: fix the bug blocking completion template application (#17010) 4 people 2026-02-24 18:50:08 +08:00
• 6e54361608 Refactor CUDA graph input buffers with shared buffer pool (#19180) Cheng Wan 2026-02-24 02:24:40 -08:00
• 94946764a4 bugfix: The default value of the environment virable is None, so that… (#18309) 3 people 2026-02-24 18:10:21 +08:00
• fcfd964d7d [diffusion] model: LTX-2 Support PR3 (#19151) GMI Xiao Jin 2026-02-24 00:55:28 -08:00
• b2166a2f33 fix(gateway): pin internal crate dependencies to exact versions (#19224) Simo Lin 2026-02-23 22:35:47 -08:00
• 88a7e48108 fix(grpc): handle embedding requests in _handle_batch_output (#19221) Simo Lin 2026-02-23 22:32:16 -08:00
• 2e053d6eb6 [diffusion] quant: support quant for all dits (#19156) Mickandzyzshishui 2026-02-24 14:20:54 +08:00
• 4f25a48d7a support xverse_moe on npu fyandsglang-npu-bot 2026-02-24 14:11:20 +08:00
• 5e80027ac7 [PD-Disagg] Support FAKE transfer backend for more cases (#19215) Liangsheng Yin 2026-02-23 20:50:43 -08:00
• 02a646ba4e [CI]: add CI permission (#19214) Ratish P 2026-02-24 10:07:55 +05:30
• d8ef33a551 bugfix: prioritize init_npu_backend to fix various initialization bugs (#17652) jianzhao-xu 2026-02-24 12:25:20 +08:00
• 59e7ea99c5 fix: release docker worker wrong args (#19207) Douglas Yang 2026-02-23 19:51:06 -08:00
• feb041f4e5 [PD-Disagg] Improve type hints across all conn.py (#19208) Liangsheng Yin 2026-02-23 19:44:23 -08:00
• edba96b98a fix(docker): migrate ROCm Dockerfiles from setuptools-rust to maturin (#19210) Simo Lin 2026-02-23 19:00:05 -08:00
• ea7ef63e6d [PD-Disagg] Deduplicate common KVManager methods into CommonKVManager (#19205) Liangsheng YinandShangming Cai 2026-02-23 18:34:21 -08:00
• 8aeb16f3fc fix: add missing blank line after docstring in serving_transcription.py (#19206) Kangyan-ZhouandClaude Opus 4.6 2026-02-23 18:29:38 -08:00
• 581bf53e03 Whisper model support & /v1/audio/transcriptions endpoint & benchmark (#16983) 3 people 2026-02-23 20:28:37 -05:00
• 3a11e7dad9 fix: patch docker image fixes (#19100) Douglas Yang 2026-02-23 16:34:29 -08:00
• d160c5b9bb [PD-Disagg] Unify prefill info data transition flow, all with PrefillServerInfo (#19195) Liangsheng Yin 2026-02-23 16:15:20 -08:00
• 9fac90d85d [CI] Tiny enhance the dp attention load blance benchmark (#19194) Liangsheng Yin 2026-02-23 14:33:32 -08:00
• 672b666057 add new ci user (#19133) narutolhy 2026-02-23 12:48:04 -08:00
• 2aa3fe394e [CI] fix the teardown output of disaggregation test (#19193) Liangsheng Yinandgemini-code-assist[bot] 2026-02-23 12:41:03 -08:00
• 2274bfebb1 [PD-Disagg] Support query dp rank from bootstrap server. (#19168) Liangsheng YinandChang Huaixin 2026-02-23 10:59:30 -08:00
• 2cdde5d4ab [Kernel Slimming] Migrate AWQ marlin repack kernel to JIT (#18949) Linyu WuandXiaoyu Zhang 2026-02-23 22:05:27 +08:00