Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 0404ef9023 [AMD] Add triggering path for multimodal test in pr-test-amd (#19515) YC TsengandBingxu Chen 2026-02-28 07:46:37 +03:00
• 79b1d2bac6 [loader] support presharded fused mlp loading (#19519) Yilong Zhao 2026-02-27 20:37:24 -08:00
• 71620122c9 feat(grpc): add multimodal TensorData parsing for vision inference (#19535) Chang Su 2026-02-27 19:29:43 -08:00
• a2ea5941d5 [feat] Support nvfp4 quantized model of Qwen3-Next (#17627) Zheng Duan 2026-02-28 10:28:47 +08:00
• ac400cb7bb [CLI] Add --model-type override and keep launch_server supported (#19523) Liangsheng Yin 2026-02-27 18:16:31 -08:00
• e08ef06758 [Session] Gate streaming sessions with --enable-streaming-session and spec v2 guard (#19531) Liangsheng Yin 2026-02-27 18:14:55 -08:00
• b5a8e4179e [SGL] sync patch: Remove sync points, prefill cudagraph for DP, disable cache reset in mem check (#19190) 3 people 2026-02-27 18:11:05 -08:00
• 8c0f2d40bd [CI] Nutanix LoRA adapter removed from HuggingFace (#19533) Yuwei An 2026-02-27 17:46:24 -08:00
• 5f07ff9271 Added the prefill delayer policy: The prefill deplay range is expanded. (#17456) chenxu214andsglang-npu-bot 2026-02-28 08:56:49 +08:00
• c6cb0c9649 [Session] Add streaming mode with SessionAwareCache fast path (#19171) Aurick Qiaoandhnyls2002 2026-02-27 16:31:08 -08:00
• 2bd2b60b5c [CI] Disable test_lora_update: Nutanix LoRA adapter removed from HuggingFace (#19527) Alison ShaoandAlison Shao 2026-02-27 15:38:19 -08:00
• 9469ad089b Fix nvfp4 weight update (#18085) Ziang Li 2026-02-27 14:55:08 -08:00
• 6ca7da3e7c Fix nightly VLM accuracy: gemma3n TP fixes + removal, latency thresholds (#19401) Alison ShaoandAlison Shao 2026-02-27 14:24:02 -08:00
• e6da514c2c CI: use 'sglang serve' in CI tests (#18597) 3 people 2026-02-28 06:00:41 +08:00
• 776709efe8 [3/n] deepseek_v2.py Refactor: Migrate MLA forward method in deepseek_v2.py (#19122) Baizhou Zhang 2026-02-27 13:37:29 -08:00
• 7e46aafebb [AMD] Enable cudagraph for aiter nsa backend and add aiter impl for nsa pr… (#18526) wufann 2026-02-28 05:18:32 +08:00
• 36dc973cbf [HiCache] refactor page_first_direct io kernel (#18113) huangtingweiandhzh0425 2026-02-28 03:43:14 +08:00
• 1b75d0d1a9 Fix BatchMLAPagedAttentionWrapper query/qo_inptr mismatch for EAGLE (#15601) Shu Wang 2026-02-27 13:35:45 -06:00
• 6a1480ce45 Fix HiCacheNixl TypeError: mem_pool_host passed as file_path (#19517) ishandhanani 2026-02-27 12:59:32 -06:00
• 35ef38c61b Remove gpt-oss hybrid swa gate for trtllm_mha (#19079) Mohammad Miadh Angkad 2026-02-28 02:30:00 +08:00
• 1b79934d34 [AMD] Fix AMD CI test of TestToolChoiceLfm2Moe (#19113) 4 people 2026-02-27 10:18:15 -08:00
• 2c856c6d27 Allow PR authors to use /rerun-failed-ci on their own PRs (#19496) Alison ShaoandAlison Shao 2026-02-27 10:14:57 -08:00
• fe4bc8ebd5 [diffusion] fix: MulAdd 4D path (shift indexing) (#18673) R0CKSTAR 2026-02-28 01:52:57 +08:00
• b1249ac909 [Diffusion] [NPU] [CI] fix CI performance (#19486) Makcum888e 2026-02-27 18:23:02 +03:00
• d2885a9094 [Qwen3-Next] Support gdn fused_rms_norm_gated (#19434) Yuan Luoandluoyuan.luo 2026-02-27 23:08:08 +08:00
• ca5f2e2ed1 [diffusion] fix: Support default response_format=url in /v1/images/generations to avoid 400 errors when response_format is omitted (#19360) 3 people 2026-02-27 19:47:38 +08:00
• 98e433e305 [PD-Disagg][Fix] Remove 'test_external_dp_routing' from Rust Router constructor parameters. (#19492) Duyi-Wang 2026-02-27 18:40:01 +08:00
• 403195d59d [AMD] [MiniMax-M2.5 Day 0] Add MiniMax-M2.5 nightly accuracy test (#19443) Michael 2026-02-27 02:39:33 -08:00
• f69ca93d49 [AMD] remove redundancy H2D op in aiter attention backend (#19416) AMD-yanfeiwangandroot 2026-02-27 18:15:55 +08:00
• 07da4bed7b [cache] add conservative estimation (#19482) Yilong Zhao 2026-02-27 02:14:46 -08:00
• 9496bbd7b1 [AMD] Use tilelang as default NSA attention backend dispatch on AMD Instinct (#18319) fxmarty-amd 2026-02-27 10:43:34 +01:00
• 9b2fbf7e6a [AMD] Merge Dockerfiles for ROCm (#19203) Alan Kaoandbingxche 2026-02-27 16:53:51 +08:00
• 43fade5f69 [4/N] (Elastic EP) Back up Expert Weights in DRAM (#17374) ympcMarkandUNIDY2002 2026-02-27 15:59:13 +08:00
• eef44ec916 [NPU]kimi k2 thinking bugfix (#19387) KnightLTCandsglang-npu-bot 2026-02-27 15:36:38 +08:00
• 4f0f6cd9d0 Add torch.compile support for qwen3-next on CPU (#12444) Cao E 2026-02-27 15:28:03 +08:00
• bc9190435b llama4 npu adapt (#17123) 3 people 2026-02-27 14:52:37 +08:00
• f0c2089597 [vlm][internVL] Support processor and embedding inputs for InternVL (#19127) Ken J 2026-02-26 22:46:48 -08:00
• 8a56cc5836 [diffusion] model: Fix a performance bug in the Wan model about usp (#19340) triple-mu 2026-02-27 14:36:23 +08:00
• af3eccc9ab [Perf] Eliminate the slice op for Flashinfer trtllm_fp4_block_scale_moe (#15731) elvischenvandBrayden Zhong 2026-02-27 14:23:40 +08:00
• d566816d83 fix qwen3_vl visual module loading (#19333) wingedge777 2026-02-27 11:44:05 +08:00
• fe971b620a [Diffusion] Add SGL-D diffusion efficient kernel skills (#19473) Xiaoyu Zhang 2026-02-27 11:42:13 +08:00
• 52c8a3632a Fix missing StandardCombineInput import in BF16 flashinfer_trtllm MoE (#19400) Alison ShaoandAlison Shao 2026-02-26 18:32:08 -08:00
• c2dce06d9f Fix parallel tool call test for speculative decoding variants (#19370) 3 people 2026-02-26 18:31:20 -08:00
• 5b5c509480 [NPU][feature adapt]remote load weight feature adp npu (#17968) 3 people 2026-02-27 10:10:36 +08:00
• e567215e44 [bugfix]fix fa4 decoding (#19388) Yizhong Caoandcaoyizhong.cyz 2026-02-27 09:48:21 +08:00
• 054bd71086 [sgl-kernel slimming] remove sgl-kernel moe-wna16-marlin (#19379) Xiaoyu Zhang 2026-02-27 09:17:46 +08:00
• 5194eef88b [Fix] A followup fix for TRTLLM BF16 MoE (#15303) Sam (Kesen Li) 2026-02-27 09:14:20 +08:00
• f0d78f2e20 [AMD] Fix weight load shape mismatch for amd dsr1 0528 mxfp4 (#19425) billishyahao 2026-02-27 09:11:59 +08:00
• 4add6ec0f6 Enhance displaying and debuggability in dump comparator (#19466) fzyzcjy 2026-02-27 09:06:19 +08:00
• 23cbbd6d41 Integrate packed data context parallel in dump comparator (#19464) fzyzcjy 2026-02-27 08:28:36 +08:00
• 1a32c0db4d [Minor] Rename misleading chunked to reusing in ReqToTokenPool.alloc() (#19465) Liangsheng Yin 2026-02-26 16:24:03 -08:00
• 8293a914a6 Support token align with packed CP data in dump comparator (#19463) fzyzcjy 2026-02-27 08:12:54 +08:00
• 695e93b91f Make reorderer support packed format with CP in dump comparator (#19462) fzyzcjy 2026-02-27 08:12:18 +08:00
• e3cdf6b1a3 Support CP packed format in unsharder in dump comparator (#19461) fzyzcjy 2026-02-27 08:11:47 +08:00
• f2d1b7c4ad Support sequence parallel and trivial dims in dump comparator (#19460) fzyzcjy 2026-02-27 08:11:15 +08:00
• eb2ada3804 Support non-packed format when aligning tokens in dump comparator (#19459) fzyzcjy 2026-02-27 08:10:29 +08:00
• e1e0cfd856 Use named tensors in dump comparator (#19458) fzyzcjy 2026-02-27 08:09:55 +08:00
• eb0e905fc3 Update token layout and cleanup printer in dump comparator (#19457) fzyzcjy 2026-02-27 08:09:15 +08:00
• 8ac64e1487 Support unifying axis ordering in dump comparator (#19456) fzyzcjy 2026-02-27 08:08:32 +08:00
• 425d333ee3 Support token dim in arbitrary location in dump comparator (#19455) fzyzcjy 2026-02-27 08:07:38 +08:00
• 5172c37845 [AMD] Use fused GEMM with FP8 cast for FP8 prefill (#19422) Thomas Wang 2026-02-27 07:14:52 +08:00
• b79fa9ccd7 [CI] Add Claude skill for writing SGLang tests (#19448) sglang-bot 2026-02-26 13:37:54 -08:00
• a1ef8e2cc0 [AMD] optimize Kimi K2.5 fused_moe_triton performance by tuning (#19228) RoyWang 2026-02-27 03:50:13 +08:00
• 288300aafd [PD] Tiny code cleanup for prefill info registering (#19414) Shangming Cai 2026-02-27 01:35:26 +08:00
• e4b708d3e9 [Spec V2] Support specV2 for mamba hybrid attention (#18808) 4 people 2026-02-27 00:36:01 +08:00
• 78d6674c45 [diffusion] feat: support hybrid parallelism for diffusers backend (#19405) DefTruth 2026-02-27 00:06:08 +08:00
• 5939b8912a [MUSA][11/N] ci: add MUSA 4.3 kernel build and release pipeline (#18537) johnnycxmandximin.chen 2026-02-26 23:45:12 +08:00
• e55e65535e [Bugfix] Add rids to the batch filtering for two batch overlap (#19418) Shangming Cai 2026-02-26 22:57:25 +08:00
• 97f1fa5e6b [NPU] Fix disaggregation metadata buffer bootstrap_room_dtype for npu backend (#19423) Shangming Cai 2026-02-26 21:10:50 +08:00
• 86eb80007e [NPU] support Kimi-K2.5 on NPU (#19331) khalilzhk 2026-02-26 20:41:44 +08:00
• bdc1e46e5a [Qwen3.5] Qwen3.5-27B inference repeat bug fix (#19411) AlfredYong 2026-02-26 20:11:29 +08:00
• 74c8e7b215 refactor(jit_kernel): reduce duplication and separate test code (#19323) Xiaoyu Zhang 2026-02-26 18:30:49 +08:00
• a7152df2e3 [diffusion ] CLI: Fix typo in CLI usage doc string (#19316) Junhao Liu 2026-02-26 02:24:14 -08:00
• 27fd014726 [PD] Add kv_cache_dtype consistency check for PD Disaggregation (#19407) Shangming Cai 2026-02-26 17:15:58 +08:00
• e14fd4accb Fix nightly Mistral-Large-3 NVFP4 accuracy threshold (#19402) Alison ShaoandAlison Shao 2026-02-25 23:59:11 -08:00
• d2b3c7fb14 [Tracing] update script for converting otel tracing data to perfetto format (#19396) Feng Su 2026-02-26 14:03:22 +08:00
• de3d1e7669 [misc] use ORJSONResponse in http-server generate (#19191) Yilong Zhao 2026-02-25 21:26:25 -08:00
• 0fd44ff342 Fix NSA CP positions mismatch in eagle NextN model (#19367) Alison Shao 2026-02-25 20:14:33 -08:00
• 119c91cb8b Skip signal handler registration when not on main thread (#18752) Xinyu Zhang 2026-02-25 19:30:05 -08:00
• 88ad3b894a [sgl-kernel][Feat][B200][2/N] Support MXFP8 Grouped GEMM in Blackwell (#14640) Qi YuhangandXiaoyu Zhang 2026-02-26 11:23:37 +08:00
• b3202fe6d0 [PCG] fix piecewise cuda graph for Qwen3.5 (#19220) Minglei Zhu 2026-02-25 19:16:52 -08:00
• a0a8f1473c [Benchmark] Fix generated_shared_prefix attribute naming and remove args dependency (#19363) 3 people 2026-02-25 18:45:54 -08:00
• 6e82183f5a [Disagg] Route disagg prefill results through process_batch_result (#19364) sglang-bot 2026-02-25 18:38:39 -08:00
• 914ed34757 update jit_kernel codeowners (#19385) Xiaoyu Zhang 2026-02-26 10:36:34 +08:00
• 265eb56d44 Support multi-step alignment and pipeline integration in dump comparator (#19378) fzyzcjy 2026-02-26 10:23:22 +08:00
• 4e843f1216 [DeepSeek-V3.2][JIT-kernel] Support nsa fuse store indexer k cache (#19148) 3 people 2026-02-26 10:23:10 +08:00
• f230967e65 [AMD] Fix ROCm Docker builds, update apache-tvm-ffi (#19359) Michael 2026-02-25 18:16:28 -08:00
• f9a2f0398f Support token aligner planning and execution in dump comparator (#19377) fzyzcjy 2026-02-26 10:04:33 +08:00
• d34d5aca07 Support loading token aligner data in dump comparator (#19376) fzyzcjy 2026-02-26 10:03:56 +08:00
• e8dd14519d Add aligner entrypoint and bundle handler in dump comparator (#19375) fzyzcjy 2026-02-26 10:03:22 +08:00
• 2ad475b4ed use flashinfer.sampling (#18696) pansicheng 2026-02-26 10:02:38 +08:00
• 2739d7df62 Reorganize modules and pipeline in dump comparator (#19374) fzyzcjy 2026-02-26 10:00:13 +08:00
• 508b8e3387 Handle warnings via sink for structured output and add pair in dump comparator (#19373) fzyzcjy 2026-02-26 09:59:15 +08:00
• 46321ee70e Support dumping rid for correlation across passes in dump comparator (#19372) fzyzcjy 2026-02-26 09:57:57 +08:00
• 7c9e8e2def [Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140) 3 people 2026-02-26 09:53:57 +08:00
• beabaa8d37 [Kernel Slimming] Migrate marlin moe kernel to JIT (#19181) Linyu WuandXiaoyu Zhang 2026-02-26 09:05:13 +08:00
• 350190487b Flashinfer MOE FP8 support for Mistral Large 3. (#15422) Daniel Cámporaandelvischenv 2026-02-26 00:00:37 +01:00
• c60dcc40bb [Logging] Guard log_prefill_stats against idle batches in disagg prefill (#19361) Liangsheng Yin 2026-02-25 13:31:52 -08:00
• 08957c88ea [Logging] Fix prefill side logging in pd disagg (#19350) YAMY 2026-02-25 12:42:18 -08:00
• 306c552639 Revert "Fix HybridAttnBackend forward for linear attention" (#19356) Kangyan-Zhou 2026-02-25 11:49:50 -08:00