 Qi Yuhangandgemini-code-assist[bot]
|
3f7c95d6cc
|
[JIT Kernel][1/2]Migrate MXFP8 Group GEMM & Quant into JIT (#23833)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-04-29 22:50:09 +08:00 |
|
|
Khoa Pham
|
ddcacaf1bd
|
Fix failing test_nvidia_nemotron_3_nano by fixing test_grouped_topk (#23874)
|
2026-04-28 15:03:58 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
c7878dbb6d
|
[MoE] Deprecate act_and_mul_triton; fold filter_expert into JIT silu/gelu_and_mul (#23707)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-04-26 01:41:35 -07:00 |
|
|
|
82254bd9c5
|
[JIT Kernel] Reland JIT activation (#22094)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-04-24 23:00:28 -07:00 |
|
|
|
6d03861476
|
support Hy3 preview (#23533)
Co-authored-by: pengmeng <pengmeng@tencent.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: chengvjiang <chengvjiang@tencent.com>
Co-authored-by: russellfeng <russellfeng@tencent.com>
|
2026-04-24 12:03:24 -07:00 |
|
|
Jimmy ShongandSGLang CI
|
68a8ed9b11
|
[Fix/Kernel] Add JIT rmsnorm_hf kernel to fix transformers backend MMLU accuracy regression (#22931)
Co-authored-by: SGLang CI <ci@sglang.ai>
|
2026-04-23 12:00:31 +08:00 |
|
|
Yanbin Jiang
|
917d2aa1dc
|
[LoRA] Fix EP + per-expert MoE LoRA illegal memory access (#23178)
|
2026-04-22 14:22:32 -07:00 |
|
|
Yuhao Yang
|
5595f6e988
|
Fix trtllm mla chunked-prefill zero-length bug (#22291) (#22688)
|
2026-04-20 22:10:13 -07:00 |
|
|
DarkSharpnessandMingyang Jiang
|
314d6ecf08
|
[Feature][JIT Kernel] Fused TP QK norm For Minimax (#20673)
Co-authored-by: Mingyang Jiang <13463932+jmydurant@users.noreply.github.com>
|
2026-04-13 20:29:47 +08:00 |
|
|
Khoa Pham
|
aeeff58cd4
|
[Spec][Ngram] Clean up unused stateless batchMatch (#22487)
|
2026-04-10 21:52:56 -07:00 |
|
|
Khoa PhamandClaude Opus 4.6
|
04bd8e1218
|
[Spec][Ngram] Return token counts in list_external_corpora API (#22471)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-10 21:50:02 -07:00 |
|
|
Khoa Pham
|
f127d67823
|
[Spec][Ngram] Misc enhance support for multiple SAMs (#22294)
|
2026-04-08 19:56:23 -07:00 |
|
|
Kurt Shuster
|
db30a63a13
|
[sgl-kernel] support > 1024 experts in moe_align_block_size kernel (#21610)
|
2026-04-08 11:45:13 -07:00 |
|
|
Liangsheng Yin
|
e4b1366a46
|
[Spec][Ngram] Support multiple SAMs with dynamic HTTP API (#22203)
|
2026-04-06 18:49:22 -07:00 |
|
|
Khoa Pham
|
12272b6791
|
[Spec][Ngram] 6/N: Load an external corpus and construct a Suffix Automaton (#21425)
|
2026-04-06 00:11:14 -07:00 |
|
|
Liangsheng Yin
|
6de2ff2a80
|
[Spec][Ngram] Followup fixes for MatchState incremental advance (#22180)
|
2026-04-05 23:04:28 -07:00 |
|
|
Khoa Pham
|
b2008bf9e0
|
[Spec][Ngram] 5/N: Store and advance anchor match state across decode steps (#21243)
|
2026-04-05 22:21:05 -07:00 |
|
|
|
41c7c97ff3
|
fix hisparse LRU policy (#22170)
Co-authored-by: huangtingwei9988 <huangtingwei9988@users.noreply.github.com>
Co-authored-by: hzh0425 <hzh0425@users.noreply.github.com>
|
2026-04-05 18:47:58 -07:00 |
|
|
|
30ba1f78b0
|
Hisparse Minor Fix (#22131)
Co-authored-by: huangtingwei9988 <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: hzh0425 <58988019+hzh0425@users.noreply.github.com>
|
2026-04-05 16:15:47 -07:00 |
|
|
CHEN Xi
|
31c9d8e885
|
[Diffusion] Fix weight scale swizzle and add large-M kernel config for FLUX.2-dev-NVFP4 (#22064)
|
2026-04-04 11:50:30 +08:00 |
|
|
Baizhou Zhang
|
ac1e437f6a
|
Revert "[Feature] JIT activation and update skills (by codex)" (#22078)
|
2026-04-03 15:04:15 -07:00 |
|
|
Brayden Zhong
|
6aafe756b9
|
Revert "[Feature] NVFP4 Marlin fallback for non-Blackwell GPUs (SM75+… (#22047)
|
2026-04-03 13:12:30 -07:00 |
|
|
DarkSharpnessandweiminc
|
44e5d35703
|
[Feature][JIT Kernel] JIT activation and update skills (by codex) (#21766)
Co-authored-by: weiminc <tnwilly@gmail.com>
|
2026-04-03 23:28:54 +08:00 |
|
|
Mook
|
991f3aa5b3
|
[Feature] NVFP4 Marlin fallback for non-Blackwell GPUs (SM75+) (#19652)
|
2026-04-03 10:48:15 +08:00 |
|
|
Liangsheng YinandDarkSharpness
|
9d9537fbd3
|
Migrate ngram corpus from torch cpp_extension to TVM FFI jit_kernel (#21920)
Co-authored-by: DarkSharpness <2040703891@qq.com>
|
2026-04-02 02:18:11 -07:00 |
|
|
DarkSharpness
|
20f4193589
|
[Feature] JIT rmsnorm update (with claude) (#21834)
|
2026-04-01 23:40:00 +08:00 |
|
|
Zhiqiang Xie
|
9eb75211b1
|
style refinement for hisparse (#21198)
|
2026-04-01 01:03:17 -07:00 |
|
|
Brayden Zhong
|
6a9b09847c
|
CUTLASS NVFP4 GEMM improvement of SM120 (#21314)
|
2026-04-01 09:04:34 +08:00 |
|
|
Johnsonms
|
5bbf347bb3
|
[jit_kernel] Optimize fused_qknorm_rope: deduplicate sincosf for interleave RoPE (#21654)
|
2026-04-01 09:04:13 +08:00 |
|
|
huangtingwei
|
d864622a68
|
[Hicache & JIT_kernel] Support page first layout & mla jit kernel (#18311)
|
2026-03-27 08:54:36 -07:00 |
|
|
Xiaoyu Zhang
|
d633ab7349
|
[Diffusion] Add qknorm rope fuse kernel (#21440)
|
2026-03-27 14:27:08 +08:00 |
|
|
Xiaoyu Zhang
|
e8d46f145c
|
Opt jit qknorm_across_heads cuda kernel (#21503)
|
2026-03-27 13:30:46 +08:00 |
|
|
Johnsonms
|
8a56a7b04d
|
[jit_kernel] Migrate cast (downcast_fp8) from sgl-kernel AOT to JIT (#19103)
|
2026-03-27 13:21:44 +08:00 |
|
|
JohnsonmsandXiaoyu Zhang
|
c531be455e
|
[jit_kernel] Add fused_qknorm_rope JIT kernel (#19059)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-03-27 13:21:28 +08:00 |
|
|
Johnsonms
|
777edb6ef7
|
Fix(jit): support rmsnorm for hidden_size in {64, 128, 256} (#20661)
|
2026-03-23 23:17:44 +08:00 |
|
|
Zhiqiang Xie
|
13f4f010d8
|
HiSparse for Sparse Attention (#20343)
|
2026-03-22 23:09:31 -07:00 |
|
|
Lianmin Zheng
|
7050011dee
|
Enable JIT clamp_position and resolve_future_token_ids on ROCm (#21116)
|
2026-03-22 22:33:54 -07:00 |
|
|
Lianmin ZhengandClaude Opus 4.6
|
76e4a8662c
|
Replace clamp_position with JIT kernel + platform dispatch (#20999)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-21 21:26:26 -07:00 |
|
|
xingsy97
|
f41832795e
|
Add compile-time 256-bit vector guard for pre-Blackwell (#19794)
|
2026-03-20 18:25:12 +08:00 |
|
|
DarkSharpnessandXiaoyu Zhang
|
2dd9196079
|
[JIT Kernel][Feature] Support JIT custom all reduce (rewrite as v2) (#19880)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-03-20 18:24:07 +08:00 |
|
|
Lianmin ZhengandClaude Opus 4.6
|
112b628227
|
Replace _resolve_future_token_ids with JIT kernel + platform dispatch (#20976)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-20 01:47:03 -07:00 |
|
|
|
af2807e146
|
[LoRA][I] Add MOE LoRA JIT alignment kernel and tests (#19710)
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Jonah Bernard <96398205+Jonahcb@users.noreply.github.com>
|
2026-03-12 12:23:46 -07:00 |
|
|
|
eb4ba1bde2
|
Feature/support longcat flash lite (#17838)
Co-authored-by: sunjiaqi11 <sunjiaqi11@meituan.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-03-09 23:00:11 +08:00 |
|
|
David Wang
|
19c51fe2fa
|
fix(rope): restore K writeback in fused rope + kv store kernel (#19636)
|
2026-03-07 20:41:35 +08:00 |
|
|
Mohammad Miadh Angkad
|
f88acf8780
|
[JIT Kernel] Reland NVFP4 kernels to JIT (#20012)
|
2026-03-07 10:31:08 +08:00 |
|
|
Baizhou Zhang
|
51e5dc845a
|
Revert "[Kernel Slimming] Migrate NVFP4 kernels to JIT" (#20005)
|
2026-03-05 19:40:00 -08:00 |
|
|
Mohammad Miadh Angkad
|
2bdd89a6cd
|
[Kernel Slimming] Migrate NVFP4 kernels to JIT (#19437)
|
2026-03-05 15:22:28 +08:00 |
|
|
Xiaoyu Zhang
|
74c8e7b215
|
refactor(jit_kernel): reduce duplication and separate test code (#19323)
|
2026-02-26 18:30:49 +08:00 |
|
|
|
4e843f1216
|
[DeepSeek-V3.2][JIT-kernel] Support nsa fuse store indexer k cache (#19148)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
|
2026-02-26 10:23:10 +08:00 |
|
|
|
7c9e8e2def
|
[Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>
|
2026-02-26 09:53:57 +08:00 |
|