 
|
d511e6bd1d
|
[sgl-router] Parse tool calls when serving chat through /generate (#42999)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 21:07:30 +08:00 |
|
 
|
67d063f63b
|
[diffusion] feat: allow per-role attention backend override (#35310)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 20:57:29 +08:00 |
|
  
|
348689da40
|
[PP+PD] Fix #38206 Reduce bootstrap consensus latency (#38959)
Co-authored-by: inkcherry <mingzhi.liu@amd.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 20:53:48 +08:00 |
|
 
|
f1e0472fcc
|
[diffusion] model: support Wan-Animate-2 (#42941)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 20:46:23 +08:00 |
|
Shuwen Wang
|
0955169ed2
|
[mem_cache] Bound FlexKV checkpoint stores and restore DSPARK cache checks (#35694)
|
2026-10-09 20:25:33 +08:00 |
|
  
|
59eb71a831
|
[diffusion] fix: align SGLD CFG combine formula with diffusers Z-Image (#23772)
Co-authored-by: SGLang CI <ci@sglang.ai>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-09 19:47:03 +08:00 |
|
Shuwen Wang
|
f48ed2127e
|
test: allow bounded checkpoint lag in Mamba HiCache tests (#42523)
|
2026-10-09 19:24:39 +08:00 |
|
  
|
3805d78796
|
[sgl-router] Serve /v1/chat/completions through /generate, with reasoning parsing (#42998)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-09 19:17:52 +08:00 |
|
Xiaoyu Zhang
|
0eb24e7d5b
|
[Performance] Optimize Qwen3.8-Flash-Next BF16 decode on Blackwell (#42175)
|
2026-10-09 18:46:12 +08:00 |
|
 
|
516fd1c1b5
|
[diffusion] perf: tile MiniMax-H3's indexed modulation kernels by 2048 columns (#43267)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 18:23:52 +08:00 |
|
Xinyuan Tong
|
91b3692a4c
|
docs: add thinking budget guide (#41601)
|
2026-10-09 17:50:34 +08:00 |
|
BingjiaWang
|
888de24cc8
|
Add BJWang-ant to CI_Permission (#43321)
|
2026-10-09 02:31:38 -07:00 |
|
黄孝君
|
e1c6ddca1d
|
[NPU] Bump SGLANG_KERNEL_NPU_TAG to 2026.9.0.post9 (#43340)
|
2026-10-09 17:30:38 +08:00 |
|
 vOvandXiaoyu Zhang
|
7cfecbef56
|
[diffusion][model] Add native SANA-Video 2.0 support (#41492)
Signed-off-by: cr-gao <gaochenrui@sjtu.edu.cn>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-09 17:28:03 +08:00 |
|
DevashishLal-CB
|
4debae7534
|
Add blackwell dual gemm fusion support for MLP (#41887)
Signed-off-by: Devashish Lal <devcode@meta.com>
|
2026-10-09 17:26:33 +08:00 |
|
Thomas Wang
|
5eca4d8caf
|
[AMD] Set maxseq length limit for DSV4.1 BCG metadata buffers (#42570)
|
2026-10-09 02:15:43 -07:00 |
|
Xinyi Song
|
23f890613e
|
[AMD] Patch aiter's group32 MXFP8 GEMM masked-scale fix (#43319)
|
2026-10-09 02:08:44 -07:00 |
|
Jimmy Shong
|
14e3414513
|
[Docs] Add Clef cookbook with selectable Clef Flash variant (#43235)
|
2026-10-09 01:56:45 -07:00 |
|
amote-i
|
ff146fa20c
|
[NPU] [DOC] remove --enable-torch-compile from Ascend support matrix (#43336)
|
2026-10-09 16:55:39 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
7578432c21
|
[LoRA][Test] Use the 0.9 ROUGE-L tolerance for the CUDA multi-LoRA batch test (#43297)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-09 01:51:01 -07:00 |
|
 Avaya AggarwalandMick Qian
|
d677848968
|
[diffusion] fix: fix CFG normalization to use per-sample norm instead of batch-flattened norm (#41706)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:43:18 +08:00 |
|
 Murthy LandClaude Opus 5
|
3ab142adc4
|
[diffusion] feat: enable breakable CUDA graphs for FLUX.2 Klein (#36470)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-09 16:40:09 +08:00 |
|
 
|
b922f5ca20
|
[diffusion] fix: share the IPC all-to-all transport between AllToAll4D and USP (#43269)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 16:31:55 +08:00 |
|
 MickandMick Qian
|
17b2f35ae7
|
[diffusion] refactor: remove unused helpers and write-only state (#43064)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:30:55 +08:00 |
|
 James XuandMick Qian
|
ee4e2f7818
|
[diffusion] optimization: enable channels_last_3d for Cosmos3 VAE (#28021)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:29:46 +08:00 |
|
Cheng Wan
|
dc0b394471
|
[Refactor] Remove Kimi K3's own layer communication and let the consumer set an FFN's exit (#42936)
|
2026-10-09 01:27:46 -07:00 |
|
Cheng Wan
|
305ad5503d
|
[Refactor] Run Kimi K3's fused collectives through stage boundaries (#42898)
|
2026-10-09 01:27:23 -07:00 |
|
Cheng Wan
|
2b469040d2
|
[Refactor] Support attention-TP dense FFNs and unpadded batches on stage boundaries (#42897)
|
2026-10-09 01:27:00 -07:00 |
|
Cheng Wan
|
b9ae3d1a65
|
[Fix] Run attention on a padded extend batch's real rows (#42896)
|
2026-10-09 01:26:38 -07:00 |
|
Cheng Wan
|
7203747cc8
|
[Fix] Shard Kimi K3's shared experts over the TP group they sum over (#42895)
|
2026-10-09 01:26:15 -07:00 |
|
 MickandMick Qian
|
45ad463c87
|
[diffusion] refactor: deduplicate UniPC solvers and Gemma3 shard loading (#42899)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 16:26:04 +08:00 |
|
Cheng Wan
|
125f88cb75
|
[Refactor] Run Kimi K3 through stage boundaries (#42894)
|
2026-10-09 01:25:51 -07:00 |
|
Cheng Wan
|
666da4f56b
|
[Fix] Kimi K3 KDA value head size and SiTU input alignment (#42893)
|
2026-10-09 01:25:28 -07:00 |
|
Cheng Wan
|
48a6c0a5d0
|
[Fix] Return an FFN's output to the attention rows at a pipeline handoff (#42892)
|
2026-10-09 01:25:05 -07:00 |
|
Cheng Wan
|
b2402ccad6
|
[Fix] Merge DeepSeek-V4 two-batch-overlap microbatches without a residual (#42891)
|
2026-10-09 01:24:42 -07:00 |
|
 
|
b130f8af02
|
[sgl-router] Serve /v1/completions through /generate, with the shared OpenAI layer (#42997)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 16:04:04 +08:00 |
|
  
|
f620d733d2
|
[rust-processor] Share the reasoning splitter and tool constraint across hosts (#42996)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-09 15:19:41 +08:00 |
|
 
|
37ae292e6f
|
[diffusion] fix: skip LTX-2 SP masks only for globally unpadded sequences (#43134)
Co-authored-by: yatholam <yatholam@amd.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 15:08:41 +08:00 |
|
Lianmin Zheng
|
c44a42e6d3
|
docs: reorder README workloads, hardware, and ecosystem (#43307)
|
2026-10-08 23:46:24 -07:00 |
|
 
|
e0608d890e
|
fix: use dp_size instead of attn_dp_size for msprobe rank id (#43041)
Co-authored-by: l30044004 <louyujing@huawei.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
|
2026-10-09 09:40:43 +03:00 |
|
Gabriel Wu
|
217980566a
|
fix(fa4): isolate sheared-bias workspaces by CUDA stream (#33000)
|
2026-10-08 23:37:02 -07:00 |
|
 areneau-cfandJimmy Shong
|
bd2d73daa5
|
[model] support Clef and Clef-Flash decision models on /v1/systemone (#42721)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-09 14:25:52 +08:00 |
|
Michael
|
51f7ea84c7
|
[AMD] Keep MiniMax decode-score tile at 128 tokens off gfx950 (#42772)
|
2026-10-08 23:22:19 -07:00 |
|
 
|
08fc290f48
|
[AMD] gfx950 small-batch MoE: expert-count gate for the small sort and FP8 block-scale small-M kernel (#41982)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-08 23:05:50 -07:00 |
|
 
|
cba1d07a94
|
[Memory] Share one full prefill graph output buffer across shapes for tuple and list outputs (#43176)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
|
2026-10-08 23:05:29 -07:00 |
|
 
|
e14ef4b658
|
[Scheduler] Skip the decode for a request whose last token is already in flight (#42720)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-10-08 23:00:46 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
1fc6b8962c
|
[Docs] Cookbook: AgentX launches for Qwen3.5 / Qwen3.8-Flash-Next; refresh GLM-5.2, DeepSeek-V4, DeepSeek-V4.1 (#43083)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-09 13:55:35 +08:00 |
|
 
|
e46aaaa789
|
[diffusion] feat: accept strided row views in the packed QKV all-to-all (#40588)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-09 13:55:31 +08:00 |
|
Colin Z
|
3c1703d2ff
|
[AMD] Support Quark DeepSeek-V4-MXFP4 checkpoints on the DSV4 stack, enabling shared-expert fusion and MTP (#31054)
|
2026-10-08 22:54:49 -07:00 |
|
 Yuan Luoandluoyuan.luo
|
9a1aeacc3b
|
[GLM-5.3-Flash] Capture the KDA extend in breakable prefill CUDA graphs (#41105)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-10-09 13:37:20 +08:00 |
|