Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 18359aadc8 [CI] Lower GSM8K baselines for B200 nightly after eval unification (#22136) Kangyan-ZhouandClaude Opus 4.6 2026-04-22 22:30:54 -07:00
• 2b4eeb8343 [AMD] Restore test_zimage_turbo.py and test_int4fp8_moe.py with __main__ entry (#23455) Bingxu ChenandClaude Opus 4 2026-04-23 13:28:20 +08:00
• 9716599383 [diffusion] fix: avoid illegal memory access in qwen image (#22953) HuangJi 2026-04-23 12:41:26 +08:00
• 4d3c7e781a [diffusion] CI: do not retry consistency failures (#23517) Mick 2026-04-23 12:39:37 +08:00
• d3aa9128be Change SGLANG_SIMULATE_ACC_METHOD to 'match-expected' (#23527) maocheng23 2026-04-22 21:26:08 -07:00
• 68a8ed9b11 [Fix/Kernel] Add JIT rmsnorm_hf kernel to fix transformers backend MMLU accuracy regression (#22931) Jimmy ShongandSGLang CI 2026-04-22 23:00:31 -05:00
• 267c2c0849 test: move test_epd_disaggregation to nightly-4-gpu (#23518) Alison Shao 2026-04-22 20:59:19 -07:00
• 0f21fe924a fix ngram greedy verify kwarg (#23521) Liangsheng Yin 2026-04-22 20:49:54 -07:00
• 887d380ace [MUSA] Resolve output garbage in Context Parallel on MusaFlashAttentionBackend (#23270) oriandzhiguo.qin 2026-04-23 11:22:20 +08:00
• 6490afe36e [docs] add deprecation notice banner to legacy documentation site (#23516) zijiexia 2026-04-22 20:17:53 -07:00
• 214c35b031 [Intel GPU] Update xpu.Dockerfile to python 3.12 version (#23367) Polisetty V R K Jyothendra Varma 2026-04-23 06:53:52 +05:30
• b3e6cf60aa ci: build sgl-kernel wheels for both cu129 and cu130 (#23497) Jia Guo 2026-04-22 18:08:36 -07:00
• c689f774a4 [CI] /rerun-stage: fix workflow-run URL lookup for sgl-kernel PRs (#23510) Kangyan-ZhouandClaude Opus 4.7 2026-04-22 17:48:38 -07:00
• 0bee211335 [CI] Broaden stage-b-test-4-gpu-b200 runner pool to low-disk label (#23505) Kangyan-ZhouandClaude Opus 4.7 2026-04-22 17:14:09 -07:00
• f611dd24f1 fix retrive -> retrieve typo (#23503) Liangsheng YinandSoluMilken 2026-04-22 16:35:04 -07:00
• 917d2aa1dc [LoRA] Fix EP + per-expert MoE LoRA illegal memory access (#23178) Yanbin Jiang 2026-04-22 14:22:32 -07:00
• b9e33d6a5b Dual MoE CUDA graph capture for lora/nolora batches (#22809) Sam Shleifer 2026-04-22 17:11:11 -04:00
• 9591033179 [CI] GB200 nightly: on-demand PR/branch image build and config filter (#23086) Sahithi Chigurupati 2026-04-22 13:51:25 -07:00
• 97fc950635 [Docker] chore: update mooncake wheel version (#20731) Teng MaandShangming Cai 2026-04-23 04:36:10 +08:00
• ad0fc88810 [CPU] [Quantization] Add GPTQ/AWQ 4bits quantization support for CPU (#22685) jianan-guandMa Mingfei 2026-04-23 04:34:02 +08:00
• 0b77284587 [minor] Make DEFAULT_FORCE_STREAM_INTERVAL configurable via SGLANG_FORCE_STREAM_INTERVAL (#23215) Byron Hsu 2026-04-22 13:05:40 -07:00
• f85e3140bf Fix:fix(timeout): fix timeout not propagated (#21944) JasonHe-WQ 2026-04-23 03:48:48 +08:00
• 94fb13db92 [devcontainer] Fix build error (#23478) Chao ShiandChao Shi 2026-04-23 03:24:15 +08:00
• 9b142df334 Docs/add sglang omni redirect (#23437) zijiexia 2026-04-22 11:37:27 -07:00
• 14ac14287c [CI] /rerun-stage: auto-include wheel build when PR modifies sgl-kernel/ (#23492) Kangyan-ZhouandClaude Opus 4.7 2026-04-22 11:28:06 -07:00
• de962f3274 docs(cookbook): add Qwen3.6-27B dense variant (#23486) Xinyuan Tong 2026-04-22 18:22:46 +01:00
• 28cfd3d272 Support defer_loading field at function level for Chat Completions API (#22702) Yuxuan ZhangandXinyuan Tong 2026-04-23 01:09:54 +08:00
• 92f28e9ba8 [NPU]Fix GLM-4.7-Flash failed on NPU (#22509) Todobe 2026-04-23 01:06:58 +08:00
• 0addd185af Fix /generate endpoint crash when sampling params contain null values (#23401) cctry 2026-04-22 09:56:10 -07:00
• ac351c1f04 [diffusion] [AMD] model: allow AITER backends in Flux 2 pipeline (#22802) Aleksi Vesanto 2026-04-22 18:15:44 +03:00
• 8b78e0888c Skip mamba_pool_idx revert for session requests in _get_new_batch_prefill_raw (#23327) Shenxiu Liu 2026-04-22 07:28:06 -07:00
• 4323fce82a fix: dot-boundary match in is_layer_skipped for FP8 modules_to_not_convert (#23467) Mick 2026-04-22 22:16:22 +08:00
• 18f3310aad [NPU] [DOC] Update Ascend NPU best practice (#23459) amote-i 2026-04-22 17:51:28 +08:00
• 1c06a3d072 [CI] Move disaggregation basic CI back to 2-gpu suite (#23447) Shangming Cai 2026-04-22 17:50:33 +08:00
• 6a3c070ee3 Add 'allready' to ignore words list in .codespellrc (#23465) Lianmin Zheng 2026-04-22 02:39:04 -07:00
• 7b10f01d1c [model_runner] Label forward steps in profile traces with mode and token counts (#23419) Ming Yang 2026-04-22 02:31:18 -07:00
• 1e34cd0ba5 PD streaming: batch notify + SSE fast path (#22658) inkcherry 2026-04-22 17:21:02 +08:00
• fa85bdf4ed chore: bump mooncake version to 0.3.10.post2 (#23439) Shangming Cai 2026-04-22 15:01:47 +08:00
• 286fba2073 ci: use rerun_failed_jobs for skipped workflows in /rerun-failed-ci (#23008) Jia GuoandClaude Opus 4.6 2026-04-21 23:59:15 -07:00
• 88c9bab830 [diffusion] ci: allow using prebuilt sgl-kernel wheel for GT regeneration (#23443) Kangyan-ZhouandClaude Opus 4.7 2026-04-21 23:44:02 -07:00
• 5c245d978f [Diffusion] Add mixed-resolution benchmark support (for #20762) (#20863) 3 people 2026-04-22 14:22:19 +08:00
• e39f0f4ff3 Use libdevice tanh and support 2D-strided tensors in fused softcap kernel (#23157) cctryandgemini-code-assist[bot] 2026-04-21 22:54:37 -07:00
• c3ea2d7b92 Rename mixed_with_decode_tokens in mixed chunk prefill adder (#6506) 3 people 2026-04-21 22:48:34 -07:00
• 04b1caf75b ci: enable /rerun-test for multimodal gen PR tests (#22828) Alison Shao 2026-04-21 21:34:14 -07:00
• 7607e4d180 py-spy without --native for ARM devices (#23410) Tarushii Goel 2026-04-21 20:45:52 -07:00
• 3ebf066d13 [sgl] update specdec sampling kernel to return valid token ID (#22643) Tarushii Goel 2026-04-21 20:28:19 -07:00
• f41f1a74a4 [diffusion] chore: support custom output folder name in GT generation workflow (#23422) Yuhao Yang 2026-04-22 11:18:21 +08:00
• 2f3e6a3143 [NPU] offloading docs update (#23378) jianzhao-xuandJianzhao Xu 2026-04-22 11:01:55 +08:00
• 4befc31408 fix: pass v_head_dim to MHA KV pools and validate MiMo HiCache geometry (#23173) shuwennandClaude Opus 4.6 2026-04-22 10:48:45 +08:00
• bf5e71dcec [MUSA][19/N] Support HiCache with pin_memory allocator (#23361) MARATRIX 2026-04-22 10:45:53 +08:00
• 7c399f3c82 Update pr-test-xeon.yml cancel-in-progress config (#23420) MingxuZh 2026-04-21 19:12:36 -07:00
• 77fd86f89e [ci] split stage-c-test-4-gpu-b200 to enable a low-disk runner pool (#23417) Kangyan-ZhouandClaude Opus 4.7 2026-04-21 18:33:33 -07:00
• 6cf0b004ca [MoE] Add LFM2 MoE tuning support + tuned configs for H100/B200/MI325X (#22791) Piotr MazurekandPiotr Mazurek 2026-04-22 03:32:05 +02:00
• 0e165ffbfc ci: enable /rerun-test for nightly test suites (#22830) Alison Shao 2026-04-21 18:28:10 -07:00
• c090f71bf2 feat: enable SGLANG_PATCH_TOKENIZER by default (#23409) Byron Hsu 2026-04-21 17:53:43 -07:00
• 415f64e763 Add MambaPool kvcache offloading during retraction (#22493) hlu1 2026-04-21 17:51:03 -07:00
• 1408d97408 [Docs] Improve SGLang Diffusion docs navigation and compatibility table (#23411) zijiexia 2026-04-21 16:59:42 -07:00
• 036edf2533 Fix docker build error (#23413) kkandwunhuang 2026-04-22 07:45:33 +08:00
• c560326884 [perf] support return_routed_experts with overlap scheduling (#22911) Qiaolin YuandYuzhen Zhou 2026-04-21 14:42:49 -07:00
• 9f37c1a9b0 Docs/add specforge redirect (#23406) Mingyi 2026-04-21 14:35:38 -07:00
• 4f764dfbb8 [Lora] Support LoRA and multi-batch in bench_one_batch_server (#23047) Yanbin Jiang 2026-04-21 14:20:11 -07:00
• 6b1e3b57d0 [docs] update logo images for google, qwen, wan, and zimage (#23404) zijiexia 2026-04-21 14:12:31 -07:00
• d20ae9ceaa [docs] sync kimi-k2.6 from sgl-cookbook (#23394) zijiexia 2026-04-21 13:59:55 -07:00
• c396e4924b [bug] Fix cache salt and extra keys for prefix cache isolation (#23300) Charles Chen 2026-04-21 13:53:24 -07:00
• e3782d04d2 fix: fallback to triton for attention-sink models (flashinfer unsupported) (#23139) 3 people 2026-04-22 04:48:50 +08:00
• 6c2714f5ae guard adaptive speculative against unsupported configs (#23289) Liangsheng Yin 2026-04-21 13:47:34 -07:00
• 5273f11fd8 [PD] Resolve missing bootstrap_room problem about fake-decode in load-balance method (#18399) 3 people 2026-04-22 04:47:01 +08:00
• 4c1d07fbdd docs: add redirects for /whl and /whl/:path* to external documentatio… (#23395) Mingyi 2026-04-21 12:24:59 -07:00
• 929e00eeab [CPU] expand the interface of shared_expert without scaling factor (#22933) Ma Mingfei 2026-04-21 20:03:39 +08:00
• 48daa831ea [KDA] Fuse gate+cumsum and reuse chunk index for KDA (#23038) Yuan Luoandluoyuan.luo 2026-04-21 17:54:20 +08:00
• 8589b92a89 [AMD] Fused qk rmsnorm bf16 for amd/Kimi-K2.5-MXFP4 (#23186) Alan KaoandClaude Sonnet 4.6 2026-04-21 17:35:09 +08:00
• fa8993111d Fix: Add token heuristic increment in total_tokens load balancing (#22614) ybyang 2026-04-21 16:29:33 +08:00
• 0d69012ef8 Optimize LTX2 feed-forward tensor parallelism (#23221) Xiaoyu Zhang 2026-04-21 16:29:23 +08:00
• e22dfe8fc2 [Docs] Update installation and TPU documentation to fix the render problem (#23344) zijiexia 2026-04-21 01:12:50 -07:00
• 47c4b38257 docs: redirect /cookbook to /cookbook/intro (#23348) Mingyi 2026-04-21 01:05:47 -07:00
• 09b1d10d59 [AMD] prepare for MI300x PR runner pool: registry mirror, runner routing, threshold tuning (#23156) Bingxu Chen 2026-04-21 15:58:23 +08:00
• 74fdf9cd77 [AMD] CI - Fix the cancelled guard to AMD CI (#23338) YC Yen-Ching Tseng 2026-04-21 15:45:26 +08:00
• efa71ce5ab [HiCache]Fix hybrid model move_indices (#22940) 3 people 2026-04-21 15:15:39 +08:00
• 900aad5f72 [Docs] Sync docs_new with legacy docs and update migration redirects (#23337) zijiexiaandMingyi 2026-04-21 00:15:17 -07:00
• f63def8510 [XPU] Fix DeepSeek-OCR tests under transformers 5.x (#23044) 3 people 2026-04-21 07:57:56 +01:00
• c122d343ad [ROCm] Uniform docker to support AMD AINIC, BRCM Thor2 IBGDA NIC for MoRI-EP (#23263) 4 people 2026-04-21 14:39:19 +08:00
• 2cf3ac515b [Diffusion][CPU] Init CPU platform support for SGLang Diffusion (#20816) jianan-gu 2026-04-21 14:25:54 +08:00
• 2b2cad70d6 [Refactor] Move radix-cache utils onto RadixKey as methods (#23209) Liangsheng Yin 2026-04-20 23:11:58 -07:00
• a490632416 Opt-in strip of thinking tokens from radix cache (#23315) 3 people 2026-04-20 22:59:50 -07:00
• a8e3a534a4 [Score API] Add Multi-Item Scoring with pre-computed delimiter indices (#22544) 3 people 2026-04-20 22:50:40 -07:00
• cfd49e233c Fix formatting for ACM-VIT in README acknowledgements section (#23325) Divyam Agrawal 2026-04-21 10:58:45 +05:30
• 6d47dc8f6d [CI][MLA] Enable deterministic inference for MGSM MLA FP8 test (#23303) jsheng_Linkedin 2026-04-20 22:26:26 -07:00
• a58c7f381e [PD] Fix clip logic when state indices lens are mismatch (#23323) Shangming Cai 2026-04-21 13:22:20 +08:00
• 5595f6e988 Fix trtllm mla chunked-prefill zero-length bug (#22291) (#22688) Yuhao Yang 2026-04-21 13:10:13 +08:00
• 82beaf1748 Docs/url redirect (#23312) Mingyi 2026-04-20 21:26:18 -07:00
• 6cc2eee50d [misc] CI hygiene: enforce __main__ entry, drop silent-skipped tests, fix rerun-test protoc (#23305) Liangsheng Yin 2026-04-20 21:16:24 -07:00
• 6b19e8a452 ci: reduce scheduled PR test from 4x to 3x daily (#23313) Alison Shao 2026-04-20 20:53:13 -07:00
• 301604f953 [NPU] [DOC] Quick start doc for Ascend NPU (#23238) amote-i 2026-04-21 11:19:09 +08:00
• 0d0405273b [Fix] Solve the error lead by _commit_transfer_to_req() when using IntraNode NVLink in PD disaggregation (#23252) Lewisand百麒 2026-04-21 11:02:18 +08:00
• 50fc2c9e23 Fix hybrid swa chunked prefill oom (#23174) Ke Bao 2026-04-21 10:46:45 +08:00
• ab3ce02de9 [Hybrid-Cache]: Refactor hybrid_pool_assembler.py (#23243) Zhangheng 2026-04-21 10:45:23 +08:00
• 3c007ee5d4 fix(hicache): emit KV events for L2 host cache insertions (#22894) ishandhananiandjthomson04 2026-04-20 21:07:03 -05:00
• ac08ebed65 [AMD] Resolve Qwen3.5 MTP (speculative decoding) radix cache conflict. (#22908) ChangLiu0709 2026-04-21 02:17:11 +01:00
• c7a4ebf3c8 [Refactor] Replace page_align_keys helper with RadixKey.page_aligned method (#23107) Liangsheng Yin 2026-04-20 18:10:42 -07:00
• 712b01d875 Update CODEOWNERS to include new documentation paths for docs and doc… (#23293) Mingyi 2026-04-20 16:48:41 -07:00