Commit Graph
20367 Commits
Author SHA1 Message Date
Jialin Ouyang b77833c504 [MM] Keep scheduler padding in packed token arrays (#40357) 2026-09-22 15:12:07 -07:00
c19dc43cc7 [AMD] [GLM-5.3-Flash Day 0] Load the MXFP4 MTP draft layer (#39779)
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: CHANG <jacchang@crsuse2-slog-003.us-east2-a.compute.internal>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
2026-09-22 15:07:51 -07:00
jain-ria 01275aab6b fix(grpc): expose native response timeout as a server argument (#40644)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
2026-09-22 14:57:38 -07:00
Liangsheng Yin 9a53f75124 [mem_cache] Remove the experimental C++ radix tree (#40775) 2026-09-22 14:19:45 -07:00
Faradawn Yang d72629e4ba Add GB200/GB300 hardware to Qwen3.5 (#40770)
Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
2026-09-22 14:16:43 -07:00
sglang-botandsglang-bot c08ffef709 docs: sync LMSYS SGLang blog cards (#40655)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-09-22 21:14:07 +00:00
Xinyuan TongandZijie Xia 542c817bfa [Docs] Fix benchmark table column overflow in cookbook deployment panel (#40114)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
2026-09-22 14:07:47 -07:00
3afdde5f05 [AMD] [GLM-5.3-Flash Day 0] Enable the k-pool DSA indexer on gfx950 (#39341)
Co-authored-by: Yikai Zhang <ykzhang12@gmail.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
2026-09-22 13:14:30 -07:00
077c319914 [AMD] [GLM-5.3-Flash Day 0] Enable speculative decoding (MTP) on ROCm (#39778)
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
2026-09-22 13:10:39 -07:00
d6cc283da7 [AMD] [GLM-5.3-Flash Day 0] Enable zero-RoPE TileLang DSA on gfx950 (#38547)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-22 13:08:25 -07:00
Yuwei An 4cbf290fb9 [Fix] Handle chunked paged MQA metadata in DSV4.1 eager forwards (#40637) 2026-09-22 12:59:04 -07:00
720617bb5b [AMD] Reuse KV gather indices across ASM context prefill layers (#39901)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-09-22 12:08:05 -07:00
5c18780c31 [Router] Keep e2e workers inside the job's CUDA_VISIBLE_DEVICES allotment (#40686)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-22 11:32:12 -07:00
Cheng Wan db73f35f4a Fix the Inkling per-expert sync test and collect it in the weekly CPU run (#40725) 2026-09-22 11:22:07 -07:00
Shangming Cai 6f4c2b9b91 [HiCache] Demote internal-node mamba states on write_back eviction (#40680) 2026-09-23 02:18:58 +08:00
Cheng Wan 91c329cc86 Take the model config out of the parallel group build, and finish retiring the parallel getters (#40707) 2026-09-22 10:55:21 -07:00
Pei Li 66454d704b [Feature] Support --tokenizer-worker-num > 1 in the offline Engine API (#40260) 2026-09-22 10:50:01 -07:00
Sage b4701d672d [rust-renderer] decouple renderer sampling from protocols (#40747)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
2026-09-22 10:48:28 -07:00
Sage 8ab21c8a94 [ci] publish renderer image (#40639)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
2026-09-22 09:48:12 -07:00
Sage a7b96fdad7 [ci] run cpu ci for renderer-only changes (#40636)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
2026-09-22 09:47:48 -07:00
YAMYandzhangxiaolei 6fd98c98b9 [Qwen3.8-Next] Pipeline-parallel serving and PD-prefill MTP for Qwen4-Exp (#40501)
Co-authored-by: zhangxiaolei <zhangxiaolei.666@bytedance.com>
2026-09-22 08:46:44 -07:00
c79510cc2a [DSv4.1] Score prefill consumer index layers on candidate blocks with DeepGEMM (#40352)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
2026-09-22 22:06:06 +08:00
4a1b69abc8 [diffusion] docs: correct the resident-layer help text to match its scope (#40593)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-22 20:32:59 +08:00
pllimax 244db08d60 [NPU][CI] Constrain evalscope dependency versions (#40133) 2026-09-22 20:15:11 +08:00
Wookje Han bc3a63ebdb [Fix] Missing SWA eviction during decode preallocation (#40309) 2026-09-22 20:11:40 +08:00
Shunkangz ddebc52f23 [kv-shard 3/4] Enable Control plane (#38468) 2026-09-22 19:57:44 +08:00
2524b61f9b [diffusion] feat: allow a component use retain its layerwise resident set (#40592)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-22 19:56:21 +08:00
Shangming Cai 861b11f087 [PD] Simplify late-abort quiescent ack branch to else (#40711) 2026-09-22 19:08:47 +08:00
amote-i cb8dab06be [NPU] [DOC] Remove duplicated features in npu docs (#40714) 2026-09-22 19:04:17 +08:00
cctry 8ef6d31cb9 [PD] Preserve abort ACKs until in-flight KV transfers drain (#40645) 2026-09-22 18:46:07 +08:00
Emre AlbayrakandXiaoyu Zhang 9d58189c12 [diffusion] attention: add fp8_fa_sm120 FP8 backend for SM120 GPUs (#40175)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-09-22 17:44:37 +08:00
debbb5cde9 [AMD] Drop the redundant scale zero-fill before AITER per-tensor FP8 quant (#40557)
Co-authored-by: siliangchen-amd <{"message":"Although you appear to have the correct authorization credentials, the `amd-eng-emu` enterprise has an IP allow list enabled, and your IP address is not permitted to access this resource.","documentation_url":"https://docs.github.com/rest/users/users#get-the-authenticated-user","status":"403"}siliangchen-amd@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-09-22 17:43:31 +08:00
Michael 3f00fb7e2e [AMD] Register unified KV page-zeroing test in PR CI (#40123) 2026-09-22 02:16:31 -07:00
Zhaoyi Li 70a2bb2a30 [AMD][DI] Keep loopback in UCX_NET_DEVICES (#40641) 2026-09-22 02:15:18 -07:00
jacky.chengandchuyeh 790551c382 [AMD] Skip full-vocab softmax in EAGLE topk==1 draft on ROCm (#35872)
Co-authored-by: chuyeh <chuyeh@users.noreply.github.com>
2026-09-22 01:57:37 -07:00
chuyehandjacky.cheng c2f14bfbc4 [AMD] Use exact CU share for gfx950 segment-plan headroom (#39503)
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-09-22 01:49:59 -07:00
inkcherry 367e3700cf avoid host sync in DSpark prefill slot expansion (#40111) 2026-09-22 01:20:49 -07:00
d00adfd19c [AMD] Fix deferred Kimi-K3 forget gate in fused in-projection (#39525)
Co-authored-by: Tom Jen <tomjen12@localhost.localdomain>
Co-authored-by: HAI <hixiao@gmail.com>
2026-09-22 01:07:25 -07:00
6412ad8c64 [AMD] Pack Qwen3.5 GDN input projections on ROCm (#39902)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-09-22 00:52:40 -07:00
Po-Han Huang (NVIDIA) 771c9d782d [PD] Validate Mooncake EFA allocator compatibility (#39973) 2026-09-22 15:12:29 +08:00
Suraj 1815e490de [observability] Fix negative queue_time for retracted requests (#39312) 2026-09-22 15:08:01 +08:00
jshn9515 c948114d58 [DOC] Update quickstart guide to use sglang serve for launching the server (#40647) 2026-09-22 15:00:35 +08:00
Kevin Mi 8ac19cc19f [AMD][Kimi-K3] Fix deferred KDA gate projection and update DCP cookbook (#39066)
PR Test (Arm64) / check-changes (push) Successful in 10s
PR Test (NPU) / set-image-config (push) Successful in 1s
PR Test (NPU) / Recommend tests from coverage (push) Skipped
PR Test (NPU) / check-changes (push) Successful in 12s
PR Test (sgl-router) / gate (push) Successful in 8s
PR Test (Xeon) / check-changes (push) Successful in 9s
PR Test (XPU) / check-changes (push) Successful in 16s
pr-test-arm64.yml / pr-gate (push) Successful in 3s
PR Test (Arm64) / pr-gate (push) Successful in 3s
pr-test-npu.yml / pr-gate (push) Successful in 2s
PR Test (NPU) / pr-gate (push) Successful in 2s
PR Test (sgl-router) / tier-1 — lint (push) Failing after 33s
PR Test (sgl-router) / tier-2 — build + test (push) Skipped
PR Test (sgl-router) / tier-3 — docker (placeholder) (push) Skipped
PR Test (sgl-router) / tier-3 — k8s integration (push) Skipped
PR Test (sgl-router) / tier-3 — e2e (push) Skipped
pr-test-xpu.yml / pr-gate (push) Successful in 2s
PR Test (XPU) / pr-gate (push) Successful in 2s
pr-test-xeon.yml / pr-gate (push) Successful in 3s
PR Test (Xeon) / pr-gate (push) Successful in 3s
PR Test (sgl-router) / finish (push) Successful in 1s
Lint / lint (push) Failing after 2m51s
PR Test (NPU) / base-a-test-1-npu-a2 (push) Canceled after 0s
PR Test (NPU) / base-b-test-1-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-b-test-2-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-b-test-4-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-b-test-8-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-b-test-16-npu-a3 (push) Canceled after 0s
PR Test (NPU) / multimodal-gen-test-1-npu-a3 (0) (push) Canceled after 0s
PR Test (NPU) / multimodal-gen-test-1-npu-a3 (1) (push) Canceled after 0s
PR Test (NPU) / multimodal-gen-test-4-npu-a3 (0) (push) Canceled after 0s
PR Test (NPU) / multimodal-gen-test-4-npu-a3 (1) (push) Canceled after 0s
PR Test (NPU) / base-c-test-acc-2-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-c-test-acc-16-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-c-test-perf-2-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-c-test-perf-16-npu-a3 (push) Canceled after 0s
PR Test (NPU) / Analyze failure report (push) Canceled after 0s
PR Test (NPU) / setup-covstub (push) Canceled after 0s
PR Test (NPU) / pr-test-npu-finish (push) Canceled after 0s
pr-test-npu.yml / run (${{ fromJson(inputs.partitions).arr }}) (push) Canceled after 0s
PR Test (XPU) / finish (push) Canceled after 0s
PR Test (Arm64) / build-test (push) Canceled after 0s
PR Test (XPU) / stage-a-test-1-gpu-xpu (push) Canceled after 0s
PR Test (XPU) / multimodal-gen-test-1-gpu-xpu (push) Canceled after 0s
PR Test (Xeon) / build-test (gnr, gnr, xeon-gnr, stage-a-tp-test-cpu-intel) (push) Canceled after 0s
PR Test (Xeon) / build-test (spr1, 0, 3, spr, xeon-spr, stage-a-test-cpu-intel,stage-b-test-cpu-intel) (push) Canceled after 0s
PR Test (Xeon) / build-test (spr2, 1, 3, spr, xeon-spr, stage-a-test-cpu-intel,stage-b-test-cpu-intel) (push) Canceled after 0s
PR Test (Xeon) / build-test (spr3, 2, 3, spr, xeon-spr, stage-a-test-cpu-intel,stage-b-test-cpu-intel) (push) Canceled after 0s
2026-09-22 06:35:12 +00:00
Mohammad Miadh AngkadandMohammad Angkad 4c81cd1b09 [KDA] Fix missing beta sigmoid in PTX prefill (#40685)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-09-21 23:24:38 -07:00
Khoa Pham bc22e1de9e [DSpark] Fix draft CUDA graph stream explosion (#40658) 2026-09-21 23:05:45 -07:00
Brayden ZhongandXinyuan Tong a0781f2714 [Docs] GLM-5.3/5.3-Flash cookbooks: enable reasoning/tool-call parsers by default via auto (#40497)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-09-22 13:54:08 +08:00
Guangda LiuandGuangda Liu 04c0913434 [HiSparse] Add MHA hisparse support for MiniMax M3 (#31446)
Co-authored-by: Guangda Liu <bingps@users.noreply.github.com>
2026-09-22 13:28:03 +08:00
095e45100b [AMD] [GLM-5.3-Flash Day 0] Route mHC through AITER on gfx950 (#38545)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-21 22:24:29 -07:00
kangwangamd 264da63319 [AMD] Update ROCm AITER pin to acf8fdf9 (#39965) 2026-09-21 22:01:17 -07:00
Piotr Mazurek b01961e295 [LFM2-VL] Add DSpark speculative decoding (#40651) 2026-09-21 21:49:51 -07:00