Commit Graph

Select branches

Hide Pull Requests

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 433429b16a diffusion: skip _save_gt_output for 3d/mesh (#32117) Yihao Wang 2026-07-23 17:14:05 -07:00
• d4a0dfbc31 [Fix] Two root causes of the H100 deepep TBO CI break: scale-tensor use-after-free + missing non-finite quant sanitization (#32188) Xiaoyu ZhangandClaude Fable 5 2026-07-24 07:29:28 +08:00
• 59ef3b15cc [Fix] Reserve the mamba pool's +1 padding slot in the memory budget solve (#32184) Liangsheng Yin 2026-07-23 14:55:35 -07:00
• 3d0c6bf57f [Fix] Fix trtllm_mla backend + fp8 kv cache without rope (#32181) Baizhou Zhang 2026-07-23 14:55:18 -07:00
• a0728ea502 [spec decoding] fix inkling multi layer mtp draft extend cuda graph (#32254) Qiaolin Yu 2026-07-23 14:52:30 -07:00
• ed26a111b2 Revert "docker: install dynamo nightly in the dev image for rapid iteration/testing" (#32257) Baizhou Zhang 2026-07-23 14:51:43 -07:00
• 20eb37a2a1 init sglang rust server project (#32256) Rain Jiang 2026-07-23 14:47:15 -07:00
• 71fe41b6b3 [DSV4] Support megamoe for CP (#29569) Siyuan Chen 2026-07-24 05:46:32 +08:00
• 378aea1385 Fix nvfp4 online scale with pcg (#32246) Qiaolin Yu 2026-07-23 14:42:37 -07:00
• 410ab4fde5 Add return_token_ids support to completions and chat completions APIs (#30917) Jimmy Shong 2026-07-23 14:41:52 -07:00
• ebe3ab29e4 [DeepSeek V4] CP decode opt: slice repeat attention weights to local TP partition (#27657) Yongfei Xu 2026-07-24 05:06:25 +08:00
• 845f6ad954 [MLX] Handle configs without quant_method in Humming (#31460) Calvin Chenandcalvin chen 2026-07-24 05:01:35 +08:00
• a2ddf92e61 [CI] Fix Mamba ServerArgs namespace (#32211) Mohammad Miadh Angkad 2026-07-24 04:15:50 +08:00
• 1f9d778d1b Skip dist_init/nccl port prechecks when the dist init method is overridden (#31410) Sam Shleifer 2026-07-23 15:40:41 -04:00
• 7fe82dd02e create rust workspace (#32014) Rain Jiang 2026-07-23 12:02:41 -07:00
• d0b9689805 [Fix] Include disagg prefill waiting queue in FPM (#32122) Hongkuan Zhou 2026-07-23 09:30:27 -07:00
• b98a577fbe Doc/update ascend quickstart (#32205) Jinyan Yi 2026-07-23 20:25:20 +08:00
• 70ac0c4b0e [UnifiedRadixCache][mamba] Fix mamba state corruption and slot leak when load_back aborts (#30986) Jialin Ouyangandhzh0425 2026-07-23 03:48:31 -07:00
• c18919f8f3 [Mamba] Add a per-path cap for cached states (#31230) YAMY 2026-07-23 02:58:36 -07:00
• 20f6a416e7 [Tiny] Skip sm120 deepgemm test temporarily (#32193) Baizhou Zhang 2026-07-23 02:54:58 -07:00
• 62aa85d9aa [Kernel] Sweep missed dedicated kernels into kernels.ops (moe/quant siblings + dspark) (RFC #29630) (#32160) Xiaoyu ZhangandClaude Opus 4.8 2026-07-23 17:07:16 +08:00
• f35411ee81 [Spec] Enable grammar overlap scheduling for STANDALONE speculative decoding (#32110) Liangsheng Yin 2026-07-23 01:47:27 -07:00
• 5387e23ecd [Tiny]Correct runner for testing deepgemm (#32174) Baizhou Zhang 2026-07-23 01:13:14 -07:00
• 9b853e6832 [Scheduler] Enable decode retraction ordering under speculative decoding (#32023) Liangsheng Yin 2026-07-23 00:42:56 -07:00
• a25164bda3 Shift nightly image build & pipeline schedule ahead by 2 hours (#32011) pllimax 2026-07-23 14:07:53 +08:00
• 235a488c87 [NPU] ascend fuseep use moe ep group (#32040) heziiop 2026-07-23 14:07:14 +08:00
• 09071be105 [NPU] [FIX] Fix performance degradation of Qwen3.5-397B-A17B (#32130) silencejade 2026-07-23 14:05:10 +08:00
• 11b0e5c5ad [Kernel] Classification cleanup: unify _jit_ naming, drop empty/model groups, add elementwise (RFC #29630) (#32148) Xiaoyu ZhangandClaude Opus 4.8 2026-07-23 13:47:02 +08:00
• 1b63155efe [Perf] Skip blocks past per-request live length in full-width Triton kernels (#32109) Liangsheng Yin 2026-07-22 22:00:25 -07:00
• eb242b6c03 Seed the GDN CuteDSL correctness test inputs to fix flakiness (#32126) Yuzhen Zhou 2026-07-22 21:30:00 -07:00
• 2d1a7be8c4 [Kernel] Reclassify kernel tests by ops group + move helpers out of the package (RFC #29630) (#32128) Xiaoyu ZhangandClaude Opus 4.8 2026-07-23 12:18:27 +08:00
• a2935ce329 [XPU][GDN] add XPU path for causal_conv1d_fn and causal_conv1d_update (#31250) jiayisunxandMa Mingfei 2026-07-23 10:50:20 +08:00
• 108182cb81 [Bugfix] [NPU] Fix w4a8 MoE performance degradation (#32113) Артем Савкин 2026-07-23 05:31:32 +03:00
• 926530b0cf [NPU]remove duplicate code (#31863) zhaozx-cn 2026-07-23 10:24:31 +08:00
• 86e1bb584d [HiCache] Add model-aware key isolation to Mooncake Store (#31920) huangtingwei 2026-07-23 10:20:13 +08:00
• 60dea26077 [sgl-kernel][CPU] add kernel for shm_allgather_into_tensor and shm_reduce_scatter_tensor (#13397) Chunyuan WU 2026-07-23 09:19:38 +08:00
• 9a7ac3ecef Fix unnecessary gather/scatter on CPU for non-contiguous Mamba statepool (#31754) YanbingJiang 2026-07-23 09:08:45 +08:00
• 9bda6fdb9a docs: sync LMSYS SGLang blog cards (#32127) sglang-botandsglang-bot 2026-07-22 17:57:01 -07:00
• 99f636a86f [Kernel] RFC #29630 finale: retire sglang.jit_kernel into sglang.kernels (#32072) Xiaoyu ZhangandClaude Opus 4.8 2026-07-23 08:35:09 +08:00
• 8ce68370b5 [AMD] Build Miles nightly ROCm images with docker/build.py and test ROCm 7.2 (#31757) Xinyu Jiang 2026-07-22 17:30:09 -07:00
• 24da0e51b6 Warn on small Mamba chunked prefill size (#30938) danielafrimiandDaniel Afrimi 2026-07-23 01:09:53 +03:00
• 0c29c8fece Bump FlashInfer to 0.6.15.post1 (#31927) Mohammad Miadh AngkadandBrayden Zhong 2026-07-23 05:21:59 +08:00
• c20c48b8fd Add 'anyOf' schema support for qwen3_coder tool call parser (#30832) 4 people 2026-07-22 14:14:47 -07:00
• e7511141ea Support CuteDSL GEMM BF16 on SM100 on by default when allowed by heuristic (#30567) Brayden Zhong 2026-07-22 14:13:12 -07:00
• 98cc8d91cf [Fix] Evict only the KV shortfall in evict_from_tree_cache (#32016) Liangsheng Yin 2026-07-22 12:41:06 -07:00
• 5c6a29b3c3 [Fix] Unify pinned host pool release on graceful shutdown (#32029) Liangsheng Yin 2026-07-22 12:29:34 -07:00
• f5dcbe8f14 Revert RuntimeContext config-namespace reads/roles (#31813–#31817) (#32100) Cheng Wan 2026-07-22 11:52:41 -07:00
• 0bdd4730af [CI] Fix failures on main (#32091) Mohammad Miadh Angkad 2026-07-23 00:11:25 +08:00
• 40ac197fb2 Fix get_server_args import lint error (#32096) Ke Bao 2026-07-23 00:09:25 +08:00
• e81b326e72 Add Inkling per-commit server test (#32095) Ke Bao 2026-07-22 23:56:18 +08:00
• 4eaa5ca651 Treat partial_json_parser AssertionError as incomplete JSON (#31975) Raghavendra Vedula 2026-07-22 08:25:25 -07:00
• a9497e8d73 Guard min_new_tokens penalizer against None eos_token_id (#31973) Raghavendra Vedula 2026-07-22 08:24:25 -07:00
• 40b2119b23 [AMD] Cache AITER expert mask across decode (#31889) Chengze Fan 2026-07-22 07:50:23 -07:00
• e8e765b9d6 [AMD] Add fused all-reduce RMSNorm per-group quant for Qwen3.5 FP8 (#24651) 4 people 2026-07-22 07:33:03 -07:00
• b855efd9e6 Fix Inkling kernel imports after migration (#32076) Mohammad Miadh Angkad 2026-07-22 22:09:01 +08:00
• 0a6d1930c3 [Attention Backend] Add HPC-Ops attention backend (#30540) 3 people 2026-07-22 22:06:22 +08:00
• 004df6b520 [FIX] Prevent Lightning Attention extra-buffer mamba state corruption (#29973) Fan Kunand范坤 2026-07-22 22:01:29 +08:00
• 21065bc862 feat: add native gRPC sidecar module launcher (#31076) ishandhananiandConnor Carpenter 2026-07-22 06:39:08 -07:00
• 74338e94f1 [Kernel] Phase 4 batch-3: migrate tangled JIT subsystems + new groups into kernels.ops (RFC #29630) (#32045) Xiaoyu ZhangandClaude Opus 4.8 2026-07-22 21:15:03 +08:00
• 71fe649d68 [AMD] Register the Helios release workflow on main (#32069) YC Yen-Ching Tsengandbingxche 2026-07-22 21:14:21 +08:00
• b13abfdedf Fix LongCat n-gram token-table crashes on padded batches (#31312) 3 people 2026-07-22 20:24:21 +08:00
• d6690de961 [CI] Fix Marlin MoE test ServerArgs initialization (#32049) Mohammad Miadh Angkad 2026-07-22 20:16:43 +08:00
• 4f88206393 [CI] Fix stale per-token group quant callers (#32047) Mohammad Miadh Angkad 2026-07-22 19:45:29 +08:00
• 977ea336cd [Kernel] Phase 4 batch-2: migrate JIT operator groups into kernels.ops (no shims) (RFC #29630) (#32015) Xiaoyu ZhangandClaude Opus 4.8 2026-07-22 17:49:51 +08:00
• 9456cef279 [NPU]fix rl update weights 'Parameter' object has no attribute 'weight_LOADER' (#31796) McZyWu 2026-07-22 16:34:59 +08:00
• 2e43b4de52 test: publish resolved config in unit fixtures for the namespace API (#31817) Cheng Wan 2026-07-22 01:19:13 -07:00
• 745b2ca45c config: read parallel config leaves via get_parallel() (#31816) Cheng Wan 2026-07-22 01:18:50 -07:00
• 602b546a4e config: load-time declarations write the config bags (#31815) Cheng Wan 2026-07-22 01:18:31 -07:00
• 11a4c2d057 config: read resolved config via namespace accessors (#31814) Cheng Wan 2026-07-22 01:18:05 -07:00
• 1d0a6ee178 runtime_context: record the publishing process role (#31813) Cheng Wan 2026-07-22 01:17:42 -07:00
• e1479cc966 config: route runtime config adjustments through the namespace bags (#31812) Cheng Wan 2026-07-22 01:17:22 -07:00
• 97e2c0c4ee config: make ServerArgs read-only with a single audited mutation entry (#31811) Cheng Wan 2026-07-22 01:16:55 -07:00
• 09688d58bc runtime_context: add resolved-config namespace bags and accessors (#31810) Cheng Wan 2026-07-22 01:16:24 -07:00
• 1a19f2b50f config: annotate ServerArgs fields with their runtime-config namespace (#31809) Cheng Wan 2026-07-22 01:15:11 -07:00
• ae2bc3321e [KDA] Fix mixed exponent bases in Triton chunk prefill (#31904) Yuan Luoandluoyuan.luo 2026-07-22 16:03:29 +08:00
• 7dcf3f7cbf [Doc] Rename A5 product name (#31998) axx-ty911 2026-07-22 15:09:05 +08:00
• ddaf430e6c [Elastic EP] Centralize Mooncake PG configuration (#31708) Xun Sun 2026-07-22 14:52:37 +08:00
• 0a3cd26b28 LoRA: Ascend: Update ascend LoRA backend to support new kernels (#15912) Vladimir Serov 2026-07-22 09:11:40 +03:00
• 88836eb38e Add OrangeRedeng and Alisehen to CI_PERMISSIONS.json (#31950) Артем Савкин 2026-07-22 09:09:10 +03:00
• fc0cbb795d [Misc] Add sm120 tests to DeepGemm release pipeline (#31841) Baizhou Zhang 2026-07-21 22:19:23 -07:00
• 297f9336c8 [Test] Enable mamba lazy extra buffer alloc edge case kl test in CI (#31991) Hanming Lu 2026-07-21 20:45:43 -07:00
• 246b3c3eaf [Kernel] Phase 3+4: move JIT infra + operator groups into sglang.kernels (RFC #29630) (#31666) Xiaoyu ZhangandClaude Opus 4.8 2026-07-22 11:28:27 +08:00
• d708969f68 [bugfix][NPU] Fix startup bug in olmoe 1b 7b (#31782) xdtbynd 2026-07-22 10:51:15 +08:00
• 394b0dd13a [NPU] Update non-vit vision part for cumulative seqlen (#31867) Jinyan Yi 2026-07-22 10:41:48 +08:00
• 93cb9a5482 [CI] Point diffusion CI writes to sgl-project/ci-data-diffusion (#31983) 4 people 2026-07-21 22:15:15 -04:00
• 3217b7e3ce fix(hicache): support staged write-back for asymmetric MHA (#30981) 3 people 2026-07-22 03:58:49 +02:00
• 4597dd4d88 Fix reward/classification models broken by load_weights v2 dispatch (#28671) (#31988) Jialin OuyangandAlex Nails 2026-07-21 18:47:49 -07:00
• 878d77929d [CPU] refactor rope kernels (#31897) Ma MingfeiandCopilot Autofix powered by AI 2026-07-22 09:12:02 +08:00
• 14c0a31829 [Bugfix] Fix Cohere2MoeConfig import crash from huggingface_hub @strict (#31769) ashwini rathi 2026-07-22 06:26:30 +05:30
• 8bb0d8d005 [JIT] Trait-driven per_token_group_quant: unify the quant kernel family (flat + masked) (#30924) DarkSharpnessandClaude Fable 5 2026-07-22 08:46:52 +08:00
• 024639a372 [Perf] Stack dspark dense draft per-layer ctx KV projection into one GEMM (#31986) Liangsheng Yin 2026-07-21 17:46:13 -07:00
• b54adced46 [Quant] Support NVFP4_AWQ checkpoints in ModelOpt FP4 path (#31825) Fardin Hoque 2026-07-21 17:46:10 -07:00
• a2c38175a4 fix(marlin_nvfp4): only apply routed_scaling_factor in moe_sum_reduce (#31762) Muqi Li 2026-07-22 08:45:42 +08:00
• 03342e7732 Delete sgl-kernel AOT router GEMM and fused A GEMM (#30280) 3 people 2026-07-21 17:44:59 -07:00
• 8ae0eb83fc [Perf] Fold dspark dense draft embedding into the draft graph via forward_embed (#31985) Liangsheng Yin 2026-07-21 17:00:42 -07:00
• 2f4f2362fb Delete sgl-kernel AOT bmm_fp8, use flashinfer.bmm_fp8 (#31202) Brayden Zhongandroot 2026-07-21 16:44:47 -07:00
• 1b4cb6b8c1 Route /rerun-test for b200 multimodal tests to the b200 pool (#31928) Alison Shao 2026-07-21 16:41:17 -07:00
• 08cb081ed0 [Perf] Skip page-table columns past kv length in DSA draft-extend metadata kernel (#31981) Liangsheng Yin 2026-07-21 16:20:14 -07:00
• 4a55fdba0b docs(cookbook): re-benchmark DeepSeek-V4 on sglang 0.5.15 (#31363) 3 people 2026-07-21 15:55:36 -07:00
• 9057db9417 Gate Mamba slot-donation debug asserts behind SGLANG_MAMBA_DEBUG_ASSERTS (#31982) Raghavendra Vedula 2026-07-21 15:28:23 -07:00