Liangsheng Yin
|
122b59152c
|
[mem_cache] Replace is_chunk_cache / is_tree_cache with supports_prefix_sharing (#42362)
|
2026-10-03 02:07:55 -07:00 |
|
Banruo Liu
|
8293f9af54
|
[PD] Centralize drain-aware abort acknowledgements (#37077)
|
2026-10-03 16:51:11 +08:00 |
|
saatwiknagpal
|
1093c501df
|
[diffusion] optimization: route subBlock sparse attention in head chunks (#41985)
|
2026-10-03 15:54:54 +08:00 |
|
Yanbin Jiang
|
254aa41f78
|
[Fix] Guard DeepSeek NVFP4 shared-expert fusion for LoRA and FP4 backends (#42203)
|
2026-10-03 00:37:57 -07:00 |
|
Tokha233
|
ce617d410b
|
[diffusion] fix: fix native FP8 format handling for FLUX 3 row-wise linears (#42255)
|
2026-10-03 15:23:41 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
00bcc25f6c
|
[HiCache] Fix DeepSeek-V4 storage backend crash from missing storage_format_tag (#42215)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-02 22:27:57 -07:00 |
|
Jimmy Shong
|
0072e2cc08
|
[Fix] Validate per-layer rope_parameters on transformers 5.17 (Laguna-S/XS-2.1 nightly) (#42214)
|
2026-10-02 21:49:45 -07:00 |
|
 Jacob0226andThomas Wang
|
af1bef3eaf
|
[AMD] GLM-5.3-Flash: fuse shared expert and KDA projections on Quark MXFP4 (#41870)
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-10-02 20:47:47 -07:00 |
|
 Richard WangandRichard Wang
|
482b062d28
|
[Feature] serve pplx-decider decision checkpoints on /v1/systemone (#42183)
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
|
2026-10-03 10:18:53 +08:00 |
|
 WenhaoZhangandXiaoyu Zhang
|
41c6ffea89
|
[diffusion] fix: keep residual_gate_add on the JIT CUDA path for cont… (#42240)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-03 10:12:11 +08:00 |
|
Xiaoyu Zhang
|
391e665dab
|
[Perf] Optimize DeepSeek V4.1 Flash Hopper paths and Blackwell prefill selection (#41251)
|
2026-10-03 10:04:48 +08:00 |
|
 MickandMick Qian
|
65c7425a56
|
[diffusion] fix: respect explicit residency over pipeline preload hints (#41622)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-03 09:54:21 +08:00 |
|
Liangsheng Yin
|
a8b54f138e
|
[Session] Run streaming sessions only on UnifiedRadixCache; reject unverified tree caches (#42295)
|
2026-10-02 18:15:59 -07:00 |
|
 
|
8ff02f5820
|
[QSA] Enable breakable prefill CUDA graphs for text-only Qwen3.8 Flash-Next (capture-safe metadata, MTP side-channel padding) (#41729)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
|
2026-10-02 17:57:42 -07:00 |
|
 Kevin MiandClaude Opus 5
|
65f759144d
|
[HiCache] Let the MiniMax-M3 K-only host pool join a host pool group (#42166)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-02 17:00:13 -07:00 |
|
Baizhou Zhang
|
3bde8eb2d8
|
[CP 1/5] Remove the CP adapter and separate interleave transport from boundary reduction (#42036)
|
2026-10-02 16:50:20 -07:00 |
|
Zhang, Jiejing
|
cbe070b6bf
|
[Docs][AMD] Update GLM-5.2 MI355X daily image to 20260930 (#42278)
|
2026-10-02 15:39:07 -07:00 |
|
   
|
b69a5f296a
|
[AMD] Add opt-in MiniMax-M3 TP4 indexer context partitioning (#41488)
Co-authored-by: ThomasNing <thomas.ning@amd.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
|
2026-10-02 15:34:29 -07:00 |
|
 
|
fa7784d140
|
[unified-memory] Copy page envelopes in place during compaction (#42252)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: ZYHowell <ZYHowell@users.noreply.github.com>
|
2026-10-02 15:12:14 -07:00 |
|
 
|
e8fab85a02
|
[KDA] Add an opt-in decode-parity mode to the Triton multi-token recurrence (#42251)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: jiayisuse <jiayisuse@users.noreply.github.com>
|
2026-10-02 14:59:56 -07:00 |
|
 
|
19794f5743
|
[sgl-router] Add SGLang's /v1/classify (#42258)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-03 05:56:16 +08:00 |
|
Liangsheng Yin
|
8a328e867b
|
[mem_cache] Rename the tree's request-level insert_req to checkpoint (#42202)
|
2026-10-02 14:42:35 -07:00 |
|
 
|
2ec9e3b11d
|
[eplb] Warm default-group NCCL P2P transports before KV-cache sizing (#42026)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: luccafong <luccafong@users.noreply.github.com>
|
2026-10-02 14:34:55 -07:00 |
|
 
|
ebf161cea4
|
[sgl-router] Add SGLang's /v1/rerank (#42205)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-03 05:33:40 +08:00 |
|
 Kan WuandKan Wu
|
8c9030ce3f
|
[sgl-router] Unify reorg session and cache affinity modes (#41990)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-03 05:21:22 +08:00 |
|
Yuhao Wang
|
0098b9d29d
|
[Spec] Fix Qwen3.5 text model EAGLE3/DFLASH aux-layer capture (#42002)
|
2026-10-02 14:05:01 -07:00 |
|
raghotham
|
a64725d407
|
[HiCache] Fall back to host memory when no cgroup fs is mounted (#42120)
|
2026-10-02 13:59:40 -07:00 |
|
 
|
7dd93b01a5
|
[PD] Make the prebuilt last-token H2D copy non-blocking under overlap (#42113)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: bbus <bbus@users.noreply.github.com>
|
2026-10-02 13:48:39 -07:00 |
|
Liangsheng Yin
|
07e1a4f082
|
[mem_cache] Skip the release-time insert on optimistic prefill requeue; make refresh_fill_ids public (#42194)
|
2026-10-02 13:46:32 -07:00 |
|
 
|
354ed2a7b6
|
Size the VMM graph-input exchange by the widest input across ranks (#42125)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: oulgen <oulgen@users.noreply.github.com>
|
2026-10-02 13:45:32 -07:00 |
|
 
|
4a4dad1cf1
|
[Metrics] Label scheduler stage wall time by sampled forward overlap (#42025)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-02 13:43:53 -07:00 |
|
 ChangLiu0709andNikolai Protasov
|
f6fcda8827
|
[AMD][ROCm] Keep cos_sin_cache fp32 on HIP for fused QSA indexer kernel (#41282)
Co-authored-by: Nikolai Protasov <289648307+amd-nprotaso@users.noreply.github.com>
|
2026-10-02 11:57:03 -07:00 |
|
Shuwen Wang
|
89f21671bb
|
fix: preserve QSA indexer state through HiCache (#39893)
|
2026-10-02 23:49:38 +08:00 |
|
 kkandwunhuang
|
a74f259f38
|
[AMD][V4.1][*/N] Fuse MXFP8 activation quant into producer kernels on gfx950 (#42055)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-02 08:34:44 -07:00 |
|
 Alex O. P.andPo-Han Huang
|
e667ab10d5
|
[diffusion] quantization: ConvRot INT8 online W8A8 for DiTs (sgl-kernel + convrot_int8_customkernel) (#38040)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-02 23:26:28 +08:00 |
|
Xiaoyu Zhang
|
1a2eb6c426
|
[Kernel] Use Cake softmax for qualified SM103 sampling workloads (#42004)
|
2026-10-02 23:06:43 +08:00 |
|
 
|
bb9a820f09
|
[diffusion] chore: make perf dump one writer per replica with no first-request NCCL setup (#41711)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 21:44:10 +08:00 |
|
Michael
|
2cd92d10b9
|
[AMD] Skip the AITER #6042/#5967 patches on gfx1250 (#42219)
|
2026-10-02 21:10:01 +08:00 |
|
 
|
edee4308bc
|
[sgl-router] Add OpenAI /v1/embeddings (#42191)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 20:18:24 +08:00 |
|
 
|
1330e437e1
|
[sgl-router] Add native /generate endpoint (#42147)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 20:09:04 +08:00 |
|
Michael
|
e020b389b6
|
[AMD][CI] Partition stage-b-test-1-gpu-small-amd-mi35x to stop the 30-min timeout (#41973)
|
2026-10-02 19:29:20 +08:00 |
|
 MickandMick Qian
|
0f71ec8656
|
[diffusion] UX: deduplicate SM120 FP8 fallback warnings across layers (#41542)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-02 19:25:15 +08:00 |
|
Michael
|
544e46c080
|
[AMD][CI] Fix VLM MMMU nightly max_tokens for CoT prompt (#41979)
|
2026-10-02 18:59:05 +08:00 |
|
 YAMYandPo-Han Huang
|
895525f062
|
[Mamba] Warm cache COW kernel before serving (#36266)
Signed-off-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-02 18:52:37 +08:00 |
|
Alex
|
1db33bc367
|
[PD][NIXL] Fix prepared dlists for KV entries of different lengths (DeepSeek-V4) (#42005)
|
2026-10-02 17:59:31 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
41bd213c5f
|
[Test] Add get_swa_key_page_size to the Q8KV8 sparse-prefill fake KV pool (#42211)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 16:00:15 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
d954c88a4f
|
[Fix] Update stale source-patch match in dumper comparator e2e test (#42179)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-02 00:37:37 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
e7d9c0299b
|
[Docs] Keep the last CUDA 12 image tag fixed during install version bumps (#42201)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-02 00:17:13 -07:00 |
|
 sglang-botandsglang-bot
|
d61a9c28ba
|
chore: bump docs install version to 0.5.21 (#42013)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-10-01 23:16:26 -07:00 |
|
Liangsheng Yin
|
50be533d09
|
[mem_cache] Rename cache_unfinished_req to checkpoint_req and count cache hits only when a request finishes (#41520)
|
2026-10-01 21:41:45 -07:00 |
|