 jiayisunx
|
27ea5ed070
|
[XPU] Fix dtype mismatch in MRotaryEmbedding.forward_xpu by calling _… (#31441)
|
2026-07-17 09:14:25 +08:00 |
|
|
Kaixi
|
dc0b3eb68f
|
[2/3] [EAGLE] perf: Fuse TP vocab-parallel embedding (#30948)
|
2026-07-16 15:57:51 -07:00 |
|
|
Kaixi
|
d539bf2cda
|
[1/3] [EAGLE] perf: Fuse topk=1 draft postprocess (#30947)
|
2026-07-16 15:57:27 -07:00 |
|
|
Yoray Zack
|
77d23a796e
|
[1/N] elastic-ep: Add runtime EP scale-up (#30164)
|
2026-07-16 15:53:44 -07:00 |
|
|
cctryandZhiqiang Xie
|
d28e35b1a1
|
Fix num_running_reqs gauge on disagg prefill servers (#31495)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-07-16 15:43:06 -07:00 |
|
|
Liangsheng Yin
|
640101da13
|
[Fix] Deflake score engine determinism tests (#31494)
|
2026-07-16 15:42:47 -07:00 |
|
|
Bob ChenandZhiqiang Xie
|
7cd55c6818
|
[HiCache] Optimize L2 mem allocation when cache miss in L3 (#19320)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-07-16 15:00:53 -07:00 |
|
|
Liangsheng Yin
|
9a4d640244
|
[Perf] Cache uniform ragged-verify layout for DSpark verify-all compact (#31434)
|
2026-07-16 15:00:41 -07:00 |
|
|
Liangsheng Yin
|
fc1e3797b7
|
[Spec] Split the capture width from num_tokens_per_req and gate replay on it (#31255)
|
2026-07-16 14:59:11 -07:00 |
|
|
Alison Shao
|
059ac7efe8
|
Don't fail server startup when psutil can't parse /proc/meminfo (GB300 ShadowCallStack) (#31098)
|
2026-07-16 14:57:34 -07:00 |
|
|
yuyu5333andzekai
|
bff489284b
|
[Feature] Support DeepSeek-V4 Wint4Abf16 and Win4Afp8. (#25763)
Co-authored-by: zekai <zekai01@antgroup.com>
|
2026-07-16 14:24:34 -07:00 |
|
|
zijiexiaandClaude Fable 5
|
68f4de162d
|
[Docs] Remove Inkling H200 LoRA BF16 cookbook command (#31489)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-16 19:57:37 +00:00 |
|
|
ChangLiu0709
|
8c9833f9a9
|
cookbook(qwen3.5): bump AMD ROCm docker images to v0.5.15.post1 (#31454)
|
2026-07-16 12:41:24 -07:00 |
|
|
Liangsheng Yin
|
44f4ea917c
|
fa3: sync-free eagle spec via fixed-window draft-extend metadata (#31364)
|
2026-07-16 12:31:50 -07:00 |
|
|
Serge Panev
|
1f34911de7
|
[NemotronH] Load shared embed_tokens/lm_head in MTP draft weights (#30456)
|
2026-07-16 17:20:38 +00:00 |
|
|
Elizaveta Martirosianandronnie_zheng
|
3bc7c54111
|
[NPU] Updated baselines for GLM-Image (#31467)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-07-16 20:16:07 +03:00 |
|
|
pllimax
|
4ad418d2c3
|
Push test case scripts from test repo to main upstream community repository (#31114)
|
2026-07-16 21:24:01 +08:00 |
|
|
Mick
|
7d0fd5101d
|
optimization: shard kimi dp image feature transport and misc optimizations (#31227)
|
2026-07-16 20:31:42 +08:00 |
|
|
jojoandhzh0425
|
b296e1a503
|
[hicache]: add mamba concurrency io transfer kernel (#30535)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-07-16 18:13:02 +08:00 |
|
|
Wang, FangYuan
|
e2d021d4ab
|
[AMD] Support two batch overlap with MTP on DeepSeekV4 (#30238)
|
2026-07-16 02:34:04 -07:00 |
|
|
|
e5f9804e26
|
Refining fused A GEMM dispatch (#31241)
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-16 16:57:01 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
a798a2aeea
|
[GDN/KDA] Fuse SM100 CuteDSL prefill state I/O into the chunk h kernel (#30169)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-07-16 16:40:33 +08:00 |
|
|
|
db7e6807de
|
[BugFix] Preserve tokenizer worker fanout when skip_tokenizer_init is enabled (#30682)
Co-authored-by: hjzhang <zhanghjzzz@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-07-16 01:29:46 -07:00 |
|
|
YC Yen-Ching Tsengandbingxche
|
4d60c4540c
|
[AMD] Skip AMD nightly local registry push (#31436)
Co-authored-by: bingxche <bingxche@amd.com>
|
2026-07-16 16:15:05 +08:00 |
|
|
seungrokjandClaude Opus 4.6
|
3264477a07
|
[Docs] Add AMD-specific HiCache config for DeepSeek V4 playground (#31122)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-07-16 01:12:29 -07:00 |
|
|
zijiexia
|
1b9f228838
|
[Docs] Playground: migrate CP knob to canonical prefill-CP flags, align gating with runtime semantics (#31411)
|
2026-07-16 01:07:34 -07:00 |
|
|
zhengyao
|
01b003255a
|
[AMD]Reuse fused FP8 KV cache write on standard aiter prefill/decode (#26852)
|
2026-07-16 01:05:04 -07:00 |
|
|
Liangsheng Yin
|
b55228cfdb
|
[Spec] Consolidate the verify step into eagle_worker_common.run_eagle_verify (#31380)
|
2026-07-16 00:56:54 -07:00 |
|
|
|
5cbea10e2f
|
Fix LongCat n-gram embedding in PD-disaggregated scheduler loops (#31134)
Co-authored-by: whn09 <whn09@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-16 15:42:51 +08:00 |
|
|
Cameron Quilici
|
a614821341
|
[Docs] Align B200 DeepSeek-V4-Pro balanced recipe with MegaMoE (#31373)
|
2026-07-16 00:24:02 -07:00 |
|
|
|
095a817612
|
[Bugfix][HiCache] measure load-back duration with CUDA events (#26411)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: vuuihc <vuuihc@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-07-16 00:11:04 -07:00 |
|
|
kangwangamd
|
f8eac995aa
|
[diffusion] test: fix GLM-Image AR model-path to resolve local snapshot subfolder (#31313)
|
2026-07-15 23:57:34 -07:00 |
|
|
amote-i
|
6275114548
|
[NPU] [DOC] Update model names supported on Ascend NPU (#31316)
|
2026-07-16 14:45:59 +08:00 |
|
|
Xiaoyu Zhang
|
e73f323464
|
[JIT] Reduce MoE fused gate CI test sweep (#31400)
|
2026-07-16 14:42:45 +08:00 |
|
|
YC Yen-Ching Tseng
|
8c5e0cee18
|
[AMD] Bump MoRI to f7e6ac6 to fix ROCm install_dependency build break (#31406)
|
2026-07-15 23:40:18 -07:00 |
|
|
|
0a64139c94
|
Fix --moe-a2a-backend silently ignored for LongCat-2.0 (moe_topk missing from gate) (#30975)
Co-authored-by: whn09 <whn09@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-16 14:40:01 +08:00 |
|
|
Ryan Zzzandzhujunyu
|
5af65d8542
|
[DeepSeek-V4] Support BF16 Compress State for Online C128 (#29609)
Co-authored-by: zhujunyu <zhujunyu.666@bytedance.com>
|
2026-07-15 23:17:29 -07:00 |
|
|
Khoa PhamandClaude Fable 5
|
dc60f65661
|
chore: bump tokenspeed_mla to 0.1.8 (#31385)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-15 22:37:54 -07:00 |
|
|
weireweireandweireweire
|
ac4fa6496c
|
Skip no-op EAGLE sampling renormalization (#31294)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-07-15 22:37:10 -07:00 |
|
|
Yanbin Jiang
|
40517b593b
|
[docs] Inkling cookbook: LoRA cells require --disable-prefill-cuda-graph (#31418)
|
2026-07-16 05:19:49 +00:00 |
|
|
Liangsheng Yin
|
0b372d03de
|
[CI] Guard partition consumers against failed check-changes and degenerate fits (#31416)
|
2026-07-15 22:09:40 -07:00 |
|
|
Alison Shao
|
238448f4c8
|
ci: fix runner utilization report undercounting busy time ~25x (#31396)
|
2026-07-15 22:02:38 -07:00 |
|
|
Liangsheng Yin
|
b871a509e6
|
[Fix] Wire the detokenizer soft watchdog into the multi-http-worker event loop (#31392)
|
2026-07-15 21:55:46 -07:00 |
|
|
Zaili Wangandzijiexia
|
bc525dcf90
|
[Cookbook][CPU]Update CPU model support info in Cookbook (#30520)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-07-16 03:42:09 +00:00 |
|
|
guzekai01
|
dee91c51cf
|
perf(deepseek_v4): enable SGLANG_OPT_FP8_WO_A_GEMM on sm90 (Hopper) (#28983)
|
2026-07-16 11:16:32 +08:00 |
|
|
guzekai01
|
7f9a902cd9
|
fix(humming): handle missing quant_method (#31185)
|
2026-07-16 11:15:52 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
22453ca63c
|
docker: build HPC-Ops into the GPU image (#31390)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-16 11:07:01 +08:00 |
|
|
Swift.Sun
|
f28ce5c420
|
[XPU]REPO cache dtype xpu align with cuda (#31140)
|
2026-07-16 10:30:01 +08:00 |
|
|
|
3a8ddd3fd0
|
[XPU] Route topk_sigmoid and topk_softmax to AOT sgl-kernel-xpu symbols (#31038)
Co-authored-by: vshekhawat-hlab <vshekhawat@habana.ai>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-07-16 10:29:19 +08:00 |
|
|
YC Yen-Ching Tseng
|
14095ef78a
|
[AMD] Disable CUDA IPC multimodal transport on ROCm in MMMU VLM tests (#31342)
|
2026-07-15 18:42:30 -07:00 |
|