Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• a3d9a21882 Revert "[Perf] fuse q, k norm for Flux2Attention (#17241)" (#17332) Xiaoyu Zhang 2026-01-19 15:24:11 +08:00
• fb88fb672e fix(ci): rate limit and permission errors in trace publishing (#17238) Alison Shao 2026-01-18 23:20:22 -08:00
• 2d72e168fd [CI] Add partition to stage-b-test-large-1-gpu (11->12) (#17245) Alison Shao 2026-01-18 23:19:39 -08:00
• 64946679b5 [Perf] fuse q, k norm for Flux2Attention (#17241) Minglei ZhuandMinglei Zhu 2026-01-18 22:33:34 -08:00
• 5836324c55 KV Cache Events with Attention DP bug fix (#16030) (#16412) Kartik Ramesh 2026-01-19 00:13:48 -06:00
• 9fe56cd0fb Fix kernel selection in biased_grouped_topk_gpu (#17325) yudian0504 2026-01-19 14:06:11 +08:00
• 858a4d659b support new qwen3_coder_detector (#16744) Gaoji Liuandliugaoji.lgj 2026-01-19 13:16:27 +08:00
• e619f53113 [Auto Sync] Update tokenizer_manager.py (20260119) (#17317) Lianmin Zhengandgithub-actions[bot] 2026-01-18 20:32:19 -08:00
• fc4b932f4e Update code sync scripts (#17319) Lianmin Zheng 2026-01-18 19:57:28 -08:00
• d2105d4abd [DeepSeek v3.2] Opt MTP decode cuda batch sizes and nsa implementation (#16961) Yongfei Xu 2026-01-19 11:54:11 +08:00
• 84c8390514 Use dsv3 optimized routing fused_topk_deepseek instead of moe_fused_gate (#15347) Lee Nau 2026-01-18 19:50:16 -08:00
• ea879c7739 [Minor] Correct sglang version when installing from source (#17315) Baizhou Zhang 2026-01-19 11:36:16 +08:00
• 0227db8926 [PD] Optimize MHA models pp util calculation logic (#17306) Shangming Cai 2026-01-19 11:23:15 +08:00
• ad1b4e4728 [Feature] overlap LoRA weight loading with compute (#15512) Glen Liu 2026-01-18 21:43:17 -05:00
• 51f147ada3 Update CODEOWNERS for multimodal_gen (#17308) MickandXiaoyu Zhang 2026-01-19 08:39:20 +08:00
• d3eafc7357 [GLM 4.7] Add RTX 6000 Pro aka sm120 (#17235) Koushik Duttaandroot 2026-01-18 13:33:19 -08:00
• e00b43442d [jit-kernel] Add CuTe DSL GDN Decode Kernel (#15631) Jinyan ChenandJinyan Chen 2026-01-19 04:54:36 +08:00
• 733de6be31 [NPU]Support GPT-OSS for NPU (#14197) Todobe 2026-01-19 04:13:41 +08:00
• 93433726eb [Refactor] Split out deepseek v2 weight loader function into mixin (#16649) Jerry Ji 2026-01-18 08:41:59 -08:00
• 330605cc88 [Diffusion] Apply jit qk_norm to flux1 (#17296) Xiaoyu Zhang 2026-01-19 00:28:36 +08:00
• bb6055b43c [Bugfix] Fix PD accuracy when MTP is not configured on the prefill node (#17212) Ch3ngY1andShangming Cai 2026-01-18 23:37:58 +08:00
• 4df74eb576 [Refactor] Add -fp4-gemm-backend to replace SGLANG_FLASHINFER_FP4_GEMM_BACKEND (#16534) b8zhongandVincent Zhong 2026-01-18 07:25:46 -08:00
• f3a7c7dcd9 Move radix cache related tests (#17295) Ke Bao 2026-01-18 17:47:32 +08:00
• 2069050d3f fix: Handle multiple named chat templates in HuggingFace tokenizers (#17236) Xinyuan Tong 2026-01-18 09:20:04 +00:00
• 1fe0c82f67 Add kl test for swa radix cache (#17281) Ke Bao 2026-01-18 16:19:57 +08:00
• a45e0e5df4 [SPEC_V2] Enable cudagraph draft_extend for trtllm_mla_backend and Acclen Fix for DP under cudagraph mode (#16974) YAMY 2026-01-17 23:56:21 -08:00
• f78201f3a9 Tiny fix comment typo (#17287) Ke Bao 2026-01-18 15:06:33 +08:00
• 8fd3399880 [diffusion] fix: set guidance_scale default to None (#17182) Changyi Yang 2026-01-18 02:04:11 -05:00
• 088758c1c1 [Tiny] Improve docs (#17264) Mohammad Miadh Angkad 2026-01-18 14:57:01 +08:00
• 6d29d8ab16 [VLM][Reland] Refactor load_mm_data to improve performance (#16152) Yuan Luoandluoyuan.luo 2026-01-18 14:11:17 +08:00
• e499258e97 Use swa radix cache and memory pool for gpt-oss model (#17261) Ke Bao 2026-01-18 13:47:07 +08:00
• 09491a9bcd cli: support sglang version (#17250) Mick 2026-01-18 13:20:24 +08:00
• 7edb06158e Add runner utilization report workflow (#17234) Alison Shao 2026-01-17 19:28:05 -08:00
• e486a4dac1 [diffusion] feat: support default 4-step inference for Flux2-Klein distilled models (#17225) Lancer 2026-01-18 10:15:50 +08:00
• 90399cbc07 fix(ci): recover from corrupted MMMU parquet cache (#17256) Hudson Xing 2026-01-18 09:32:01 +08:00
• 53609e5e5b Revert "[Diffusion] Move diffusion time embedding to jit kernel" (#17257) Michael 2026-01-17 05:29:22 -08:00
• 9c2530642c Change routing policy API to be async to support more policies (#17048) fzyzcjy 2026-01-17 17:12:51 +08:00
• d2c863878c [DLLM] Implement initial dynamic batching for diffusion LLM (#14883) Zehuan Li 2026-01-17 16:48:15 +08:00
• 737a1183d6 [BUGFIX] fix radix cache memory consumption to avoid OOM (#17191) Yi ZhangandLiangsheng Yin 2026-01-17 16:47:37 +08:00
• dc743fe4ba [diffusion] chore: clean srt imports (#17252) Mick 2026-01-17 15:47:49 +08:00
• dd99f818e0 fix: fix regression and unclear pattern (#16561) Nan Jiang 2026-01-17 15:21:42 +08:00
• 8ce64aa155 fix(ci): skip offline mode for LoRA scenarios (#17248) Hudson Xing 2026-01-17 15:06:20 +08:00
• eb768189ee [diffusion] doc: add instruction for adding performance baseline of new model (#17249) Mick 2026-01-17 12:24:59 +08:00
• 2cdd4370bc [Diffusion] Move diffusion time embedding to jit kernel (#16879) Xiaoyu Zhang 2026-01-17 12:21:22 +08:00
• a7b5f75d88 Support integration tests with Redis binary (#17045) fzyzcjy 2026-01-17 11:59:04 +08:00
• 305c1a575a Tiny remove unused code (#17047) fzyzcjy 2026-01-17 11:58:43 +08:00
• c824ddd581 Fix imbalancedness for manual policy min group mode for requests without routing id (#17044) fzyzcjy 2026-01-17 11:58:35 +08:00
• e18e0057a4 Add an env var to allow transferring small metadata via TCP for PD (#16951) siyu 2026-01-17 10:32:22 +08:00
• 166396ca4c [Docs] minor update on ep docs (#17242) zijiexia 2026-01-16 18:20:47 -08:00
• 43779f27b7 Disable PCG for draft worker (#16354) Stefan He 2026-01-16 17:56:56 -08:00
• 8b9e9357fe [2/n] deepseek_v2.py Refactor: Migrate MHA forward method in deepseek_v2.py (#16817) Baizhou Zhang 2026-01-17 09:36:25 +08:00
• d36f6f043c [Fix] flashinfer_trtllm intermediate_size assertion with Qwen3 + TP=8 (#16824) b8zhong 2026-01-16 17:24:05 -08:00
• b0701f02b3 Fix benchmark import for should_use_tensor_core (#17232) Mohammad Miadh Angkad 2026-01-17 06:48:36 +08:00
• 4229de3b13 [model-gateway] Refine TokenizerRegisty.load() to handle duplication (#17230) Chang Su 2026-01-16 13:53:21 -08:00
• 2e14407983 Increase 5090 test parallelism from 4 to 8 (#17233) Alison Shao 2026-01-16 13:52:56 -08:00
• d2ec128bbf fix: ci failure monitor reorganization (#17165) Douglas Yang 2026-01-16 13:25:13 -08:00
• 7f8353aff3 [BugFix]: Fix sglang.bench_one_batch (#16925) Lingjun WenandXinyuan Tong 2026-01-16 13:15:34 -08:00
• a7f5677abe refactor: unify registration through tokenizer_registration workflow (#17187) Chang Su 2026-01-16 10:53:36 -08:00
• 3e968ab369 [Refactor] [CI] Remove redundant CI test runs (#17217) Makcum888e 2026-01-16 20:52:06 +03:00
• b4fce9955a Add CI Coverage Overview workflow with detailed test listings (#16842) Alison Shao 2026-01-16 09:42:50 -08:00
• ec9b48ea96 Add olmo3 in supported docs (#13672) Yi Zhong 2026-01-16 12:18:16 -05:00
• a04675892e Update flashinfer to 0.6.1 (#15551) Baizhou Zhang 2026-01-17 00:48:30 +08:00
• 82a1b645ba [DeepSeek V3.1/V3.2] Optimize fused moe configs for H20 & H20-3E based on swapab (#17133) Yongfei Xu 2026-01-17 00:10:52 +08:00
• 6f10e17b4a [bugfix] fix qwen3-next alt_stream none issue (#17016) billishyahao 2026-01-16 22:40:25 +08:00
• c771933dc5 [Doc] Tiny docs update for CUDA 13 (#17200) Mohammad Miadh Angkad 2026-01-16 20:53:36 +08:00
• 9d8bbd4223 Add clear error message when OOM with symmetric memory (#17038) Nicolas Castet 2026-01-16 06:44:37 -06:00
• daea51385d Add AFMoE model implementation (#13216) Raghav Ravishankar 2026-01-16 18:05:42 +05:30
• 3355b6e21b feat: add request queued timeout (#17143) 3 people 2026-01-16 17:55:09 +08:00
• a1dd3d48ac [diffusion] hardware: support diffusion (single GPU, 3/N) (#17105) R0CKSTAR 2026-01-16 17:01:09 +08:00
• d9ed80b9f1 fix AMD CI failure of NUMA binding (#17184) Zhiqiang Xie 2026-01-16 00:21:04 -08:00
• 7c39ea68f3 [diffusion] model: support flux Klein (#17173) Adarsh Shirawalmath 2026-01-16 13:46:17 +05:30
• daa4841e86 [ConfigArgumentMerger] Improve ConfigArgumentMerger compatibility with external callers (#17051) YAMY 2026-01-15 23:32:42 -08:00
• 968c4f55b1 [AMD] Enable DeepseekV3.2 test for AMD CI (#16934) YC Tseng 2026-01-16 13:58:46 +08:00
• 669d309a8b [model-gateway] Consolidate "unknown" model id usage (#17186) Chang Su 2026-01-15 21:02:40 -08:00
• 21ee597e4a ci: enable offline mode when local cache is complete to avoid HF Hub … (#16121) Hudson Xing 2026-01-16 12:15:33 +08:00
• 6ee970a365 [Diffusion] Hot fix broken output_path default value (#17180) Xiaoyu Zhang 2026-01-16 12:14:09 +08:00
• 8ec160ed46 feature: support uvicorn access log filter(disable logging /metrics) (#15513) shuwenn 2026-01-16 12:00:06 +08:00
• 2740ed1ae7 [eval] GSM8k support for run_eval (#17041) YAMY 2026-01-15 19:10:17 -08:00
• d44f09ad98 [Benchmark] Add GSM8K Platinum Eval (#14565) b8zhong 2026-01-15 19:06:14 -08:00
• e7dc85c50b Fix grammar sync across TP ranks (#17100) Lianmin ZhengandLiangsheng Yin 2026-01-15 18:38:01 -08:00
• c81bad1bf7 [diffusion] feat: add cloud storage support for API (#14579) Ratish P 2026-01-16 07:59:38 +05:30
• 0e86de7c0b Remove deepseek-r1 from THINKING_MODE_CHOICES in run_eval.py (#17178) hlu1 2026-01-15 16:53:06 -08:00
• e3a95077bc Add dpsk-r1-fp4 in nightly perf ci (#16882) Qiaolin Yu 2026-01-15 16:13:35 -08:00
• 146b5fcc84 [CI] Reorganize stage-b 1-GPU tests for 5090 compatibility (#16826) Alison Shao 2026-01-15 15:23:35 -08:00
• 8b22deef5b fix【hicache】fix the KV cache resource occupation and invalid loading from prefetch when pending requests are aborted. (#16369) PiteXChenandZhiqiang Xie 2026-01-16 07:14:38 +08:00
• 69822c7271 Disable unit-test-deepep-8-gpu (#17176) Alison Shao 2026-01-15 15:12:45 -08:00
• 8b99af9af8 [Doc] Tiny update Cuda 13 environment instructions (#17174) Baizhou Zhang 2026-01-16 06:12:26 +08:00
• 72e2f70ef7 feat(hicache): support numa detect to reduce long tail latency (#11028) JinYan SuandZhiqiang Xie 2026-01-16 06:11:49 +08:00
• 3d72944fb8 [Doc] Add tip on how to use Spec V2 (#15455) b8zhong 2026-01-15 13:30:18 -08:00
• 7dde3438e2 Show how to use cu13 image with B300 (#17170) Yi Zhong 2026-01-15 15:25:20 -05:00
• 77fc4c4a53 Add mooncake store read/write bandwidth logs (#10598) 3 people 2026-01-16 04:15:41 +08:00
• 655d2c7c2a fix: adding matrix partitioning for h200 and b200 nightly tests (#17091) Douglas Yang 2026-01-15 11:23:19 -08:00
• 3f44268fe5 [smg] release 0.3.2 (#17168) Simo Lin 2026-01-15 11:22:18 -08:00
• f7ec8174db [smg][ci] add make cmd to patch versions (#17167) Simo Lin 2026-01-15 11:00:53 -08:00
• cd23c2f0a3 [Docs] add v1/score api to native api documentation (#16568) Guy Stone 2026-01-15 17:29:40 +00:00
• d1110e1c3e docs only add kimi k2 thinking and kimi linear (#15789) Yi Zhong 2026-01-15 12:09:52 -05:00
• 9227d9f60c [Docs] sort and update server_arguments.md (#17163) shuwenn 2026-01-16 01:07:18 +08:00
• 4c59782e0f Fix hybrid attention PD Disaggregation test (#17099) Shangming Cai 2026-01-15 23:38:58 +08:00
• dda35ccbd8 Fix gid calculation in per_tensor_absmax_kernel (#17126) cctry 2026-01-15 07:21:41 -08:00
• d11e2dc6f4 [diffusion] chore: improve the output_path config and enable the server to return inference duration (#16965) wxyandXiaoyu Zhang 2026-01-15 22:31:50 +08:00