amote-i
|
3a9cae27ed
|
[Doc] [NPU] docs: Update NPU CANN version to 9.1.0 (#44177)
|
2026-10-15 00:27:18 +08:00 |
|
Xinyuan Tong
|
ed40c7fc66
|
[Doc] cookbook: add Ling-3.1-flash (#44301)
|
2026-10-14 22:40:01 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
72730d6360
|
[Doc] cookbook: Mirror SA cluster NCCL_CUMEM_ENABLE in AgentX launches, fix GPU counts (#44228)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 16:07:40 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
6daae9c98e
|
[Perf] Bind scheduler CPUs to the GPU's NUMA node when memory policy is not permitted (#44023)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-14 00:01:32 -07:00 |
|
ANSHUMAN TRIPATHY
|
30bdd09aed
|
DSPARK enable for XPU (#33739)
|
2026-10-14 13:10:24 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
721953c6f6
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches to InferenceX main (GLM-5.2 NVFP4 B300 agg TP4, Dynamo frontend counts) (#44065)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 13:03:51 +08:00 |
|
 HEJIAN SANGandClaude Opus 5.5
|
a832609b92
|
[Feature] Return output top logprobs as flat base64 arrays on request (#42890)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 15:58:31 -07:00 |
|
 Xinyuan TongandNihar Patel
|
7dc2930585
|
[Feature] Add Aaronson-Gumbel text watermarking (#37577)
Co-authored-by: Nihar Patel <nihpat95@gmail.com>
|
2026-10-13 12:47:50 -07:00 |
|
Xinyuan Tong
|
5eda6b7e67
|
docs: add MiniCPM-V 4.7 cookbook (#43829)
|
2026-10-13 12:04:47 -07:00 |
|
 Khoa Phamandvincentzed
|
8bf145d119
|
[DCP] Decode context parallelism for DSA (GLM-5.2 / GLM-5.3) with MTP (#43735)
Co-authored-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
|
2026-10-13 11:35:34 -07:00 |
|
 Ho-Ren (Jack) ChuangandXiaoyu Zhang
|
5100f8d11d
|
[DSA] Q8KV8 FP8 Sparse Prefill on GLM-5.3-Flash with BF16 KV Cache (#41790)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-13 20:30:13 +08:00 |
|
amote-i
|
29974d543e
|
[NPU] [DOC] update kimi k3 cookbook and supported features on NPU (#44052)
|
2026-10-13 20:27:26 +08:00 |
|
 LittleNyimaandMick Qian
|
5727f08932
|
[diffusion] feat: add configurable reference image resizing for MiniMax H3 Ref2VA (#35839)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-13 19:48:18 +08:00 |
|
Ziang Li
|
01f6840693
|
[FlashInfer] Add startup autotuning for MegaMoE (#43789)
|
2026-10-13 02:30:31 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
dbad07a06f
|
[Docs] Cookbook: refresh SemiAnalysis AgentX launches (DeepSeek-V4.1 GB200/GB300, GLM-5.2 FP8 B300) (#43983)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 14:39:45 +08:00 |
|
Jimmy Shong
|
3eebf987ed
|
[PD] Support heterogeneous TP for hybrid SWA KV transfer (#40909)
|
2026-10-12 23:21:54 -07:00 |
|
Thomas Wang
|
c2dfd5d3d6
|
[AMD] Update v4 amd cookbook 1012 (#43962)
|
2026-10-12 19:57:55 -07:00 |
|
 
|
e775fa7253
|
[Build][CI] Drop Python 3.10: require Python 3.11+ and run CUDA CI on Python 3.12 (#43021)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-10-12 18:40:16 -07:00 |
|
  
|
8afe107c24
|
[XPU] Upgrade XPU backend to PyTorch 2.14 (#42003)
Co-authored-by: Ashwini Rathi <arathi@habana.ai>
Co-authored-by: Y <ashwini.rathi@intel.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-10-12 18:24:48 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
b0c84d4518
|
[Docs] Cookbook: refresh SemiAnalysis AgentX launches (GLM-5.2 B300, DeepSeek-V4.1 GB300) (#43799)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-12 17:08:11 +08:00 |
|
Baizhou Zhang
|
450837e770
|
[Docs] Update GLM-5.3-Flash playground: B300 default, CP8, EP and PD (#43802)
|
2026-10-12 01:38:12 -07:00 |
|
 Anupa SajikumarandSiju Samuel
|
8d491fbc3e
|
[XPU] Support decode context parallelism (DCP) on Intel XPU (#34355)
Co-authored-by: Siju Samuel <siju.samuel@intel.com>
|
2026-10-12 15:50:33 +08:00 |
|
Baizhou Zhang
|
62c853b654
|
docs: clarify prefill CP terminology and simplify wording (#43787)
|
2026-10-12 00:24:57 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
166b4ae7fc
|
[Fix] Adapt to transformers 5.18 / 5.19 changes (#43688)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-11 23:24:57 -07:00 |
|
 sglang-botandsglang-bot
|
f9bd83e7a9
|
docs: sync LMSYS SGLang blog cards (#43462)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-10-12 06:07:15 +00:00 |
|
ChengYM
|
0d0be8fc98
|
[AMD][MORI] Add MORI EP V2 support (#40666)
|
2026-10-11 20:54:13 -07:00 |
|
WenhaoZhang
|
a954b395e6
|
[diffusion] perf: layerwise offload for the LTX-2.5 Gemma-4 text encoder (#43683)
|
2026-10-12 09:34:35 +08:00 |
|
WenhaoZhang
|
a67228aa43
|
[diffusion] fix: shard Qwen-Image adaLN modulation and text FFN under TP (#43691)
|
2026-10-12 09:32:52 +08:00 |
|
Liangsheng Yin
|
00ba90fd1a
|
[DSpark] Run the same markov block in the draft graph tail; drop SGLANG_DSPARK_FOLDED_SAMPLING (#43668)
|
2026-10-11 15:15:59 -07:00 |
|
 
|
97bfa5cc53
|
[diffusion] fix: select VSA-H3 for FastH3 when no transformer backend is given (#43690)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 23:05:25 +08:00 |
|
 MickandMick Qian
|
11bfd868ac
|
[diffusion] perf: encode LTX video/audio through the shared bounded MP4 path (#43656)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-11 21:15:49 +08:00 |
|
 
|
65386cb95a
|
[diffusion] perf: add the dynamic LoRA delta inside the second GEMM (#43501)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:50:53 +08:00 |
|
 
|
664e4c6499
|
[diffusion] feat: warn instead of disabling on unvalidated models for BCG(#43568)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:40:28 +08:00 |
|
 
|
23764b1242
|
[diffusion] feat: bind each GPU worker to its GPU's NUMA node (#43565)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-11 08:38:58 +08:00 |
|
Cheng Wan
|
234ccba7f6
|
[Refactor] Declare every model's stages from a shared function and drop the meta-device neighbour build (#43460)
|
2026-10-10 12:43:09 -07:00 |
|
Cheng Wan
|
3b16eeedce
|
[Refactor] Declare pipeline neighbours from a shared declaration function (#43459)
|
2026-10-10 12:42:46 -07:00 |
|
Cheng Wan
|
514feb1afc
|
[Fix] Keep residual rows and sums consistent across appends and pipeline handoffs (#43454)
|
2026-10-10 12:40:53 -07:00 |
|
Xiaoyu Zhang
|
f61163b4b0
|
[Docs] Let the Qwen3 B300 recipe use the default attention backend (#43554)
|
2026-10-10 10:00:04 -07:00 |
|
Xiaoyu Zhang
|
587b6d622d
|
[Docs] Document Qwen3-4B/8B H200 mixed-chunk latency tradeoffs (#43551)
|
2026-10-10 09:59:46 -07:00 |
|
Shunkangz
|
de487f8039
|
[kv-shard 3/4] Enable Control Plane C (#40102)
|
2026-10-10 22:53:58 +08:00 |
|
 
|
72657f7ca5
|
[diffusion] perf: pipeline every USPAttention Ulysses path's exchange over the copy engine (#43521)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 21:34:18 +08:00 |
|
siliangchen-amd
|
ff19159e16
|
[AMD] Add an opt-in AITER CK blockscale GEMM for gfx942 block-FP8 linears (#41071)
Signed-off-by: siliangchen-amd <SiLiang.Chen@amd.com
|
2026-10-10 01:31:20 -07:00 |
|
 
|
d8c5eca3ac
|
[diffusion] fix: keep a LoRA unmerged under merge_mode auto when merging would round its update away (#43385)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 15:02:03 +08:00 |
|
tao
|
6e8f3e09dd
|
[Model Loader] Add InstantTensor loader support (#40453)
|
2026-10-09 23:01:59 -07:00 |
|
Yuwei An
|
8b2aaf7060
|
[Refactor][TCPCG] Retire backend selection and configuration (3/9) (#42287)
|
2026-10-09 22:42:35 -07:00 |
|
 
|
ccae3b3639
|
[diffusion] perf: pipeline MiniMax-H3's Ulysses exchange against cuDNN SDPA on Blackwell (#43373)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-10 12:58:30 +08:00 |
|
 MickandMick Qian
|
a65f4ffba5
|
[diffusion] docs: standardize diffusion cookbook command builders (#43472)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-10 11:14:31 +08:00 |
|
     
|
436d73ddda
|
[diffusion] model: support HunyuanImage-3.0-Instruct (#36311)
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: wes-lyu <294033513+wes-lyu@users.noreply.github.com>
Co-authored-by: Wes <its.wesley.lyu@gmail.com>
Co-authored-by: AuFlow <73925903+AuFlow@users.noreply.github.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-10 11:11:28 +08:00 |
|
Liangsheng Yin
|
465253ef52
|
[Scheduler] Fix the deterministic-inference hang when a prefill chunk is shorter than its alignment (#43444)
|
2026-10-09 19:06:18 -07:00 |
|
 MickandMick Qian
|
77ba54f7df
|
[diffusion] docs: add Wan-Animate-2 cookbook command picker (#43380)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-10 09:45:16 +08:00 |
|