 Bob ChenandZhiqiang Xie
|
7cd55c6818
|
[HiCache] Optimize L2 mem allocation when cache miss in L3 (#19320)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-07-16 15:00:53 -07:00 |
|
|
Liangsheng Yin
|
9a4d640244
|
[Perf] Cache uniform ragged-verify layout for DSpark verify-all compact (#31434)
|
2026-07-16 15:00:41 -07:00 |
|
|
Liangsheng Yin
|
fc1e3797b7
|
[Spec] Split the capture width from num_tokens_per_req and gate replay on it (#31255)
|
2026-07-16 14:59:11 -07:00 |
|
|
Alison Shao
|
059ac7efe8
|
Don't fail server startup when psutil can't parse /proc/meminfo (GB300 ShadowCallStack) (#31098)
|
2026-07-16 14:57:34 -07:00 |
|
|
yuyu5333andzekai
|
bff489284b
|
[Feature] Support DeepSeek-V4 Wint4Abf16 and Win4Afp8. (#25763)
Co-authored-by: zekai <zekai01@antgroup.com>
|
2026-07-16 14:24:34 -07:00 |
|
|
Liangsheng Yin
|
44f4ea917c
|
fa3: sync-free eagle spec via fixed-window draft-extend metadata (#31364)
|
2026-07-16 12:31:50 -07:00 |
|
|
Serge Panev
|
1f34911de7
|
[NemotronH] Load shared embed_tokens/lm_head in MTP draft weights (#30456)
|
2026-07-16 17:20:38 +00:00 |
|
|
Elizaveta Martirosianandronnie_zheng
|
3bc7c54111
|
[NPU] Updated baselines for GLM-Image (#31467)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-07-16 20:16:07 +03:00 |
|
|
pllimax
|
4ad418d2c3
|
Push test case scripts from test repo to main upstream community repository (#31114)
|
2026-07-16 21:24:01 +08:00 |
|
|
Mick
|
7d0fd5101d
|
optimization: shard kimi dp image feature transport and misc optimizations (#31227)
|
2026-07-16 20:31:42 +08:00 |
|
|
jojoandhzh0425
|
b296e1a503
|
[hicache]: add mamba concurrency io transfer kernel (#30535)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-07-16 18:13:02 +08:00 |
|
|
Wang, FangYuan
|
e2d021d4ab
|
[AMD] Support two batch overlap with MTP on DeepSeekV4 (#30238)
|
2026-07-16 02:34:04 -07:00 |
|
|
|
e5f9804e26
|
Refining fused A GEMM dispatch (#31241)
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-16 16:57:01 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
a798a2aeea
|
[GDN/KDA] Fuse SM100 CuteDSL prefill state I/O into the chunk h kernel (#30169)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-07-16 16:40:33 +08:00 |
|
|
|
db7e6807de
|
[BugFix] Preserve tokenizer worker fanout when skip_tokenizer_init is enabled (#30682)
Co-authored-by: hjzhang <zhanghjzzz@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-07-16 01:29:46 -07:00 |
|
|
zhengyao
|
01b003255a
|
[AMD]Reuse fused FP8 KV cache write on standard aiter prefill/decode (#26852)
|
2026-07-16 01:05:04 -07:00 |
|
|
Liangsheng Yin
|
b55228cfdb
|
[Spec] Consolidate the verify step into eagle_worker_common.run_eagle_verify (#31380)
|
2026-07-16 00:56:54 -07:00 |
|
|
|
5cbea10e2f
|
Fix LongCat n-gram embedding in PD-disaggregated scheduler loops (#31134)
Co-authored-by: whn09 <whn09@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-16 15:42:51 +08:00 |
|
|
|
095a817612
|
[Bugfix][HiCache] measure load-back duration with CUDA events (#26411)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: vuuihc <vuuihc@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-07-16 00:11:04 -07:00 |
|
|
kangwangamd
|
f8eac995aa
|
[diffusion] test: fix GLM-Image AR model-path to resolve local snapshot subfolder (#31313)
|
2026-07-15 23:57:34 -07:00 |
|
|
|
0a64139c94
|
Fix --moe-a2a-backend silently ignored for LongCat-2.0 (moe_topk missing from gate) (#30975)
Co-authored-by: whn09 <whn09@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-16 14:40:01 +08:00 |
|
|
Ryan Zzzandzhujunyu
|
5af65d8542
|
[DeepSeek-V4] Support BF16 Compress State for Online C128 (#29609)
Co-authored-by: zhujunyu <zhujunyu.666@bytedance.com>
|
2026-07-15 23:17:29 -07:00 |
|
|
Khoa PhamandClaude Fable 5
|
dc60f65661
|
chore: bump tokenspeed_mla to 0.1.8 (#31385)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-15 22:37:54 -07:00 |
|
|
weireweireandweireweire
|
ac4fa6496c
|
Skip no-op EAGLE sampling renormalization (#31294)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-07-15 22:37:10 -07:00 |
|
|
Liangsheng Yin
|
b871a509e6
|
[Fix] Wire the detokenizer soft watchdog into the multi-http-worker event loop (#31392)
|
2026-07-15 21:55:46 -07:00 |
|
|
guzekai01
|
dee91c51cf
|
perf(deepseek_v4): enable SGLANG_OPT_FP8_WO_A_GEMM on sm90 (Hopper) (#28983)
|
2026-07-16 11:16:32 +08:00 |
|
|
guzekai01
|
7f9a902cd9
|
fix(humming): handle missing quant_method (#31185)
|
2026-07-16 11:15:52 +08:00 |
|
|
Swift.Sun
|
f28ce5c420
|
[XPU]REPO cache dtype xpu align with cuda (#31140)
|
2026-07-16 10:30:01 +08:00 |
|
|
|
3a8ddd3fd0
|
[XPU] Route topk_sigmoid and topk_softmax to AOT sgl-kernel-xpu symbols (#31038)
Co-authored-by: vshekhawat-hlab <vshekhawat@habana.ai>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-07-16 10:29:19 +08:00 |
|
|
YC Yen-Ching Tseng
|
14095ef78a
|
[AMD] Disable CUDA IPC multimodal transport on ROCm in MMMU VLM tests (#31342)
|
2026-07-15 18:42:30 -07:00 |
|
|
Mick
|
d9003dd452
|
fix: skip unsafe automatic prefill graph capture (#31204)
|
2026-07-16 09:27:38 +08:00 |
|
|
Serge Panev
|
1c4892d7bb
|
[Mamba] Fix spec-v2 + extra_buffer crash (guard None mamba_next_track_idx) (#27998)
|
2026-07-15 18:23:14 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
7647a9d260
|
Fuse the preprocess kernels of trtllm-gen attention (#29690)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
|
2026-07-15 18:21:34 -07:00 |
|
|
McZyWu
|
871c648203
|
[NPU]revert add scoring func for GLM 4.7 Flash (#31388)
|
2026-07-16 09:16:57 +08:00 |
|
|
Brayden ZhongandBrayden Zhong
|
edb2059139
|
Support Flashinfer one-sided A2A + CuteDSL MoE for Nemotron Ultra (#28309)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-15 18:14:20 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
ac23be8d09
|
Skip MXFP8 autotune on dense GEMM, which causes IMA (#29669)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
|
2026-07-15 18:06:55 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
0b04e9da83
|
Use fused A GEMM for fc1_latent_proj in NemotronH (#29692)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-15 18:05:22 -07:00 |
|
|
Liangsheng Yin
|
1cc9493747
|
[Spec] Converge DP-attention spec width scaling onto num_tokens_per_req (#31244)
|
2026-07-15 17:57:08 -07:00 |
|
|
Po-Han Huang (NVIDIA)
|
5d004a20c5
|
Fix FlashInfer A2A top-k ID dtype (#29929)
|
2026-07-15 17:56:11 -07:00 |
|
|
Liangsheng Yin
|
b0b2dfbda1
|
[Spec] Extract the shared draft() tail into build_eagle_verify_input (#31375)
|
2026-07-15 15:59:31 -07:00 |
|
|
|
7a973c03a0
|
[Bugfix] Stamp capture-time num_tokens_per_req in multi-layer EAGLE; close jit_kernel CI filter gaps (#31367)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-07-15 15:24:32 -07:00 |
|
|
Lewisand百麒
|
3101c1258c
|
[DSv4] Use BF16 instead of FP32 for indexer score computation (#30012)
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
|
2026-07-15 15:06:55 -07:00 |
|
|
Jorge António
|
26cb0fcdda
|
Empty _REQ_TYPES_WITH_OPAQUE_FIELDS on the msgpack IPC path (#29465 Task 4) (#30182)
|
2026-07-15 14:55:06 -07:00 |
|
|
karverma-amd
|
ec32590025
|
feat(moriep): add fp4 combine dtype (SGLANG_MORI_COMBINE_DTYPE=fp4) (#30706)
|
2026-07-15 14:21:41 -07:00 |
|
|
jacky.cheng
|
e78051a419
|
[AMD] [Fix] Fix --attention-backend triton work for DeepSeek MLA on MI355 (null-K + decode dispatch + RoPE) (#30355)
|
2026-07-15 14:19:23 -07:00 |
|
|
Yuhao Yang
|
5abec3fbf8
|
Fix MiMo-V2 on Blackwell: FA3 fallback and TP-aware audio weight loading (#31343)
|
2026-07-15 13:26:27 -07:00 |
|
|
Shaun Kotek
|
ab627e5d75
|
fix: load the right mtp lm head quantization (#30976)
|
2026-07-15 12:12:04 -07:00 |
|
|
Xuwei
|
7e7129acd7
|
[Bugfix] Release Mamba cache after PP dynamic chunk profiling (#31321)
|
2026-07-16 02:32:07 +08:00 |
|
|
YAMYandXuwei Li
|
2d00e20a52
|
[Disagg][Qwen3.5] Fix heterogeneous attn-TP scatter transfer: GDN conv sub-block slice + GQA replicated-KV head map (#30997)
Co-authored-by: Xuwei Li <lixuwei.xy@gmail.com>
|
2026-07-16 02:31:37 +08:00 |
|
|
AuFlowandAuFlow
|
9d147fdca1
|
[Multimodal] Support n>1 outputs for GLM-Image generation (#31027)
Co-authored-by: AuFlow <AuFlow@users.noreply.github.com>
|
2026-07-15 20:55:19 +03:00 |
|