 ChangLiu0709
|
8c9833f9a9
|
cookbook(qwen3.5): bump AMD ROCm docker images to v0.5.15.post1 (#31454)
|
2026-07-16 12:41:24 -07:00 |
|
|
Liangsheng Yin
|
44f4ea917c
|
fa3: sync-free eagle spec via fixed-window draft-extend metadata (#31364)
|
2026-07-16 12:31:50 -07:00 |
|
|
Serge Panev
|
1f34911de7
|
[NemotronH] Load shared embed_tokens/lm_head in MTP draft weights (#30456)
|
2026-07-16 17:20:38 +00:00 |
|
|
Elizaveta Martirosianandronnie_zheng
|
3bc7c54111
|
[NPU] Updated baselines for GLM-Image (#31467)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-07-16 20:16:07 +03:00 |
|
|
pllimax
|
4ad418d2c3
|
Push test case scripts from test repo to main upstream community repository (#31114)
|
2026-07-16 21:24:01 +08:00 |
|
|
Mick
|
7d0fd5101d
|
optimization: shard kimi dp image feature transport and misc optimizations (#31227)
|
2026-07-16 20:31:42 +08:00 |
|
|
jojoandhzh0425
|
b296e1a503
|
[hicache]: add mamba concurrency io transfer kernel (#30535)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-07-16 18:13:02 +08:00 |
|
|
Wang, FangYuan
|
e2d021d4ab
|
[AMD] Support two batch overlap with MTP on DeepSeekV4 (#30238)
|
2026-07-16 02:34:04 -07:00 |
|
|
|
e5f9804e26
|
Refining fused A GEMM dispatch (#31241)
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-16 16:57:01 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
a798a2aeea
|
[GDN/KDA] Fuse SM100 CuteDSL prefill state I/O into the chunk h kernel (#30169)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-07-16 16:40:33 +08:00 |
|
|
|
db7e6807de
|
[BugFix] Preserve tokenizer worker fanout when skip_tokenizer_init is enabled (#30682)
Co-authored-by: hjzhang <zhanghjzzz@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-07-16 01:29:46 -07:00 |
|
|
YC Yen-Ching Tsengandbingxche
|
4d60c4540c
|
[AMD] Skip AMD nightly local registry push (#31436)
Co-authored-by: bingxche <bingxche@amd.com>
|
2026-07-16 16:15:05 +08:00 |
|
|
seungrokjandClaude Opus 4.6
|
3264477a07
|
[Docs] Add AMD-specific HiCache config for DeepSeek V4 playground (#31122)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-07-16 01:12:29 -07:00 |
|
|
zijiexia
|
1b9f228838
|
[Docs] Playground: migrate CP knob to canonical prefill-CP flags, align gating with runtime semantics (#31411)
|
2026-07-16 01:07:34 -07:00 |
|
|
zhengyao
|
01b003255a
|
[AMD]Reuse fused FP8 KV cache write on standard aiter prefill/decode (#26852)
|
2026-07-16 01:05:04 -07:00 |
|
|
Liangsheng Yin
|
b55228cfdb
|
[Spec] Consolidate the verify step into eagle_worker_common.run_eagle_verify (#31380)
|
2026-07-16 00:56:54 -07:00 |
|
|
|
5cbea10e2f
|
Fix LongCat n-gram embedding in PD-disaggregated scheduler loops (#31134)
Co-authored-by: whn09 <whn09@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-16 15:42:51 +08:00 |
|
|
Cameron Quilici
|
a614821341
|
[Docs] Align B200 DeepSeek-V4-Pro balanced recipe with MegaMoE (#31373)
|
2026-07-16 00:24:02 -07:00 |
|
|
|
095a817612
|
[Bugfix][HiCache] measure load-back duration with CUDA events (#26411)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
Co-authored-by: vuuihc <vuuihc@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-07-16 00:11:04 -07:00 |
|
|
kangwangamd
|
f8eac995aa
|
[diffusion] test: fix GLM-Image AR model-path to resolve local snapshot subfolder (#31313)
|
2026-07-15 23:57:34 -07:00 |
|
|
amote-i
|
6275114548
|
[NPU] [DOC] Update model names supported on Ascend NPU (#31316)
|
2026-07-16 14:45:59 +08:00 |
|
|
Xiaoyu Zhang
|
e73f323464
|
[JIT] Reduce MoE fused gate CI test sweep (#31400)
|
2026-07-16 14:42:45 +08:00 |
|
|
YC Yen-Ching Tseng
|
8c5e0cee18
|
[AMD] Bump MoRI to f7e6ac6 to fix ROCm install_dependency build break (#31406)
|
2026-07-15 23:40:18 -07:00 |
|
|
|
0a64139c94
|
Fix --moe-a2a-backend silently ignored for LongCat-2.0 (moe_topk missing from gate) (#30975)
Co-authored-by: whn09 <whn09@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-16 14:40:01 +08:00 |
|
|
Ryan Zzzandzhujunyu
|
5af65d8542
|
[DeepSeek-V4] Support BF16 Compress State for Online C128 (#29609)
Co-authored-by: zhujunyu <zhujunyu.666@bytedance.com>
|
2026-07-15 23:17:29 -07:00 |
|
|
Khoa PhamandClaude Fable 5
|
dc60f65661
|
chore: bump tokenspeed_mla to 0.1.8 (#31385)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-15 22:37:54 -07:00 |
|
|
weireweireandweireweire
|
ac4fa6496c
|
Skip no-op EAGLE sampling renormalization (#31294)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
|
2026-07-15 22:37:10 -07:00 |
|
|
Yanbin Jiang
|
40517b593b
|
[docs] Inkling cookbook: LoRA cells require --disable-prefill-cuda-graph (#31418)
|
2026-07-16 05:19:49 +00:00 |
|
|
Liangsheng Yin
|
0b372d03de
|
[CI] Guard partition consumers against failed check-changes and degenerate fits (#31416)
|
2026-07-15 22:09:40 -07:00 |
|
|
Alison Shao
|
238448f4c8
|
ci: fix runner utilization report undercounting busy time ~25x (#31396)
|
2026-07-15 22:02:38 -07:00 |
|
|
Liangsheng Yin
|
b871a509e6
|
[Fix] Wire the detokenizer soft watchdog into the multi-http-worker event loop (#31392)
|
2026-07-15 21:55:46 -07:00 |
|
|
Zaili Wangandzijiexia
|
bc525dcf90
|
[Cookbook][CPU]Update CPU model support info in Cookbook (#30520)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-07-16 03:42:09 +00:00 |
|
|
guzekai01
|
dee91c51cf
|
perf(deepseek_v4): enable SGLANG_OPT_FP8_WO_A_GEMM on sm90 (Hopper) (#28983)
|
2026-07-16 11:16:32 +08:00 |
|
|
guzekai01
|
7f9a902cd9
|
fix(humming): handle missing quant_method (#31185)
|
2026-07-16 11:15:52 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
22453ca63c
|
docker: build HPC-Ops into the GPU image (#31390)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-16 11:07:01 +08:00 |
|
|
Swift.Sun
|
f28ce5c420
|
[XPU]REPO cache dtype xpu align with cuda (#31140)
|
2026-07-16 10:30:01 +08:00 |
|
|
|
3a8ddd3fd0
|
[XPU] Route topk_sigmoid and topk_softmax to AOT sgl-kernel-xpu symbols (#31038)
Co-authored-by: vshekhawat-hlab <vshekhawat@habana.ai>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-07-16 10:29:19 +08:00 |
|
|
YC Yen-Ching Tseng
|
14095ef78a
|
[AMD] Disable CUDA IPC multimodal transport on ROCm in MMMU VLM tests (#31342)
|
2026-07-15 18:42:30 -07:00 |
|
|
Mick
|
d9003dd452
|
fix: skip unsafe automatic prefill graph capture (#31204)
|
2026-07-16 09:27:38 +08:00 |
|
|
Serge Panev
|
1c4892d7bb
|
[Mamba] Fix spec-v2 + extra_buffer crash (guard None mamba_next_track_idx) (#27998)
|
2026-07-15 18:23:14 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
7647a9d260
|
Fuse the preprocess kernels of trtllm-gen attention (#29690)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
|
2026-07-15 18:21:34 -07:00 |
|
|
McZyWu
|
871c648203
|
[NPU]revert add scoring func for GLM 4.7 Flash (#31388)
|
2026-07-16 09:16:57 +08:00 |
|
|
Brayden ZhongandBrayden Zhong
|
edb2059139
|
Support Flashinfer one-sided A2A + CuteDSL MoE for Nemotron Ultra (#28309)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-15 18:14:20 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
ac23be8d09
|
Skip MXFP8 autotune on dense GEMM, which causes IMA (#29669)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
|
2026-07-15 18:06:55 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
0b04e9da83
|
Use fused A GEMM for fc1_latent_proj in NemotronH (#29692)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-15 18:05:22 -07:00 |
|
|
Liangsheng Yin
|
1cc9493747
|
[Spec] Converge DP-attention spec width scaling onto num_tokens_per_req (#31244)
|
2026-07-15 17:57:08 -07:00 |
|
|
Po-Han Huang (NVIDIA)
|
5d004a20c5
|
Fix FlashInfer A2A top-k ID dtype (#29929)
|
2026-07-15 17:56:11 -07:00 |
|
|
sglang-botandsglang-bot
|
34f5691ea1
|
docs: sync LMSYS SGLang blog cards (#31386)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-07-16 00:53:19 +00:00 |
|
|
Liangsheng Yin
|
b0b2dfbda1
|
[Spec] Extract the shared draft() tail into build_eagle_verify_input (#31375)
|
2026-07-15 15:59:31 -07:00 |
|
|
|
7a973c03a0
|
[Bugfix] Stamp capture-time num_tokens_per_req in multi-layer EAGLE; close jit_kernel CI filter gaps (#31367)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-07-15 15:24:32 -07:00 |
|