 Mohammad Miadh AngkadandXinyuan Tong
|
3ebb7c2d07
|
docs: point Kimi-K3 references to public branch (#32547)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-07-27 16:23:43 +00:00 |
|
|
Mohammad Miadh Angkad
|
9791fc7090
|
Add configurable FlashInfer autotune skips (#31389)
|
2026-07-25 11:17:58 -07:00 |
|
|
Mohammad Miadh Angkad
|
953c587adf
|
[Docs] Add Qwen3.6 35B NVFP4 to cookbook (#31413)
|
2026-07-25 11:16:53 -07:00 |
|
|
Mohammad Miadh Angkad
|
a2ddf92e61
|
[CI] Fix Mamba ServerArgs namespace (#32211)
|
2026-07-23 13:15:50 -07:00 |
|
|
Mohammad Miadh AngkadandBrayden Zhong
|
0c29c8fece
|
Bump FlashInfer to 0.6.15.post1 (#31927)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-07-22 14:21:59 -07:00 |
|
|
Mohammad Miadh Angkad
|
0bdd4730af
|
[CI] Fix failures on main (#32091)
|
2026-07-23 00:11:25 +08:00 |
|
|
Mohammad Miadh Angkad
|
b855efd9e6
|
Fix Inkling kernel imports after migration (#32076)
|
2026-07-22 22:09:01 +08:00 |
|
|
Mohammad Miadh Angkad
|
d6690de961
|
[CI] Fix Marlin MoE test ServerArgs initialization (#32049)
|
2026-07-22 20:16:43 +08:00 |
|
|
Mohammad Miadh Angkad
|
4f88206393
|
[CI] Fix stale per-token group quant callers (#32047)
|
2026-07-22 19:45:29 +08:00 |
|
|
Mohammad Miadh Angkad
|
a82ead53bd
|
Make Q contiguous before TRT-LLM MHA decode (#31667)
|
2026-07-20 15:21:00 -07:00 |
|
|
Mohammad Miadh Angkad
|
3d82dacd58
|
Bump CuTe DSL to 4.6.0 (#31714)
|
2026-07-20 02:11:59 -07:00 |
|
|
Mohammad Miadh Angkad
|
35f2d4f761
|
Fix no-padding CUDA graph admission (#31273)
|
2026-07-19 19:28:35 -07:00 |
|
|
Mohammad Miadh Angkad
|
8bf2ab9be9
|
Enable GPT-OSS TinyGEMM on CUDA 13 (#31649)
|
2026-07-19 19:16:39 -07:00 |
|
|
Mohammad Miadh AngkadandBrayden Zhong
|
d67aa05697
|
Bump FlashInfer to 0.6.15 and revert regressions (#31502)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-07-17 00:50:12 -07:00 |
|
|
Mohammad Miadh Angkad
|
18043aec20
|
[CI] Fix TRTLLM MHA graph metadata test fixture (#31332)
|
2026-07-15 12:44:51 -07:00 |
|
|
Mohammad Miadh Angkad
|
5af670284e
|
[CI] Lower GLM-5.2 NVFP4 MTP speed threshold (#31289)
|
2026-07-15 00:39:58 -07:00 |
|
|
Mohammad Miadh Angkad
|
271e5ef5c3
|
[CI] Fix Flash MLA SM120 test import path (#31199)
|
2026-07-14 09:01:23 -07:00 |
|
|
Mohammad Miadh Angkad
|
2f79d334f2
|
[Bugfix] Fix DeepSeek ForwardFlags across custom op boundary (#30987)
|
2026-07-13 17:19:44 -07:00 |
|
|
Mohammad Miadh Angkad
|
cbcbef6811
|
[Bugfix] Fix Nemotron ForwardFlags across custom op boundary (#30968)
|
2026-07-12 22:10:23 -07:00 |
|
|
Mohammad Miadh Angkad
|
24d59d8d74
|
Fix CUDA 12 Docker dependency resolution (#30858)
|
2026-07-12 13:50:41 -07:00 |
|
|
Mohammad Miadh Angkad
|
96a04cb13f
|
Fix DeepEP CI test registration (#30873)
|
2026-07-12 05:54:50 -07:00 |
|
|
Mohammad Miadh Angkad
|
14bef7cd11
|
fix: lazy load TileLang MHC kernels (#30580)
|
2026-07-12 08:32:27 +08:00 |
|
|
Mohammad Miadh Angkad
|
7b99900980
|
Fix hybrid attention graph hook test fixture (#30790)
|
2026-07-10 23:37:04 +05:30 |
|
|
Mohammad Miadh Angkad
|
7045e0fdff
|
Seed sgl-kernel topk sigmoid tests on all backends (#30754)
|
2026-07-10 03:08:15 -07:00 |
|
|
Mohammad Miadh Angkad
|
ecb7fb3989
|
Fix CuTe DSL DSA paged MQA export (#30627)
|
2026-07-10 01:32:58 -07:00 |
|
|
Mohammad Miadh Angkad
|
295f85df08
|
Fix DFlash mamba verify init ordering (#30680)
|
2026-07-09 17:40:12 -07:00 |
|
|
Mohammad Miadh Angkad
|
b0ecbceed9
|
[Bugfix] Migrate retired parallel accessors (#30653)
|
2026-07-09 11:22:34 -07:00 |
|
|
Mohammad Miadh Angkad
|
666a09fe2a
|
Disable multi-threaded load by default when prefetch is on (#30146)
|
2026-07-09 00:28:53 -07:00 |
|
|
Mohammad Miadh Angkad
|
04e4fadff3
|
Use FP32 logits in MoEGate fallbacks (#30323)
|
2026-07-08 23:43:45 +08:00 |
|
|
Mohammad Miadh Angkad
|
fda87173ab
|
Revert "Increase the KV cache pool when using indexShare by 15% (#30310)" (#30472)
|
2026-07-07 23:48:35 -07:00 |
|
|
Mohammad Miadh Angkad
|
f32b4ecd26
|
[Docs] Use trtllm_mha for Qwen3.6 B300 (#29964)
|
2026-07-07 01:44:01 -07:00 |
|
|
Mohammad Miadh Angkad
|
b1942fc3ea
|
[Model] Support Qwen3.6 ModelOpt mixed NVFP4 (#27906)
|
2026-07-05 21:31:15 -07:00 |
|
|
Mohammad Miadh Angkad
|
cfb9c574d3
|
Fix UE8M0 scale rounding for DeepGEMM (#29956)
|
2026-07-02 13:42:17 -07:00 |
|
|
Mohammad Miadh Angkad
|
8f0d320d31
|
[Spec] Enable FlashInfer autotune for spec draft (#29595)
|
2026-07-01 13:36:07 -07:00 |
|
|
Mohammad Miadh Angkad
|
a0d9791810
|
[CI] Fix fused EH norm CI registration (#29845)
|
2026-07-01 21:27:07 +08:00 |
|
|
Mohammad Miadh Angkad
|
07ca24372b
|
Add fused EH norm for DeepSeek NextN (#29667)
|
2026-07-01 02:46:21 -07:00 |
|
|
Mohammad Miadh Angkad
|
bae78a44da
|
[Deps] Bump transformers to 5.12.1 (#29393)
|
2026-06-30 00:54:01 -07:00 |
|
|
Mohammad Miadh Angkad
|
b6fceaa789
|
[DSA] Use cos_sin_cache for DSA indexer fusion (#29613)
|
2026-06-29 23:49:00 -07:00 |
|
|
Mohammad Miadh Angkad
|
3a72d02415
|
[DSA] Optimize DSA CUDA graph replay metadata generation (#29499)
|
2026-06-29 19:53:23 -07:00 |
|
|
Mohammad Miadh Angkad
|
6c018eb4d1
|
Fix bounded checkpoint prefetching and buffered drop-cache handling (#29156)
|
2026-06-29 21:49:16 +00:00 |
|
|
Mohammad Miadh Angkad
|
ae09b8302f
|
[CI] Fix GB300 DSV4 Pro FP4 nightly (#29502)
|
2026-06-27 21:06:17 -07:00 |
|
|
Mohammad Miadh Angkad
|
212c30d008
|
[MoE Refactor] Centralize FlashInfer CUTLASS MoE runner (#28211)
|
2026-06-25 13:40:33 -07:00 |
|
|
Mohammad Miadh Angkad
|
e4976683f4
|
[Docs] Fix broken links in cookbook (#29261)
|
2026-06-25 02:31:55 -07:00 |
|
|
Mohammad Miadh Angkad
|
8b7a1e908a
|
Revert Gemma4 modelopt fp4 MoE backend change (#28347)
|
2026-06-24 19:49:09 -07:00 |
|
|
Mohammad Miadh Angkad
|
40439acd0a
|
Sync backend docs with #29063 (#29233)
|
2026-06-24 19:48:34 -07:00 |
|
|
Mohammad Miadh Angkad
|
4992f7a108
|
Fix TRTLLM MHA FP8 KV cache scale handling (#28144)
|
2026-06-24 01:43:50 -07:00 |
|
|
Mohammad Miadh Angkad
|
cedb43d522
|
[DeepEP] Gate DeepEP MNNVL on fabric support (#28942)
|
2026-06-23 13:19:47 -07:00 |
|
|
Mohammad Miadh Angkad
|
7b1a20344c
|
Re-enable SM90 FlashInfer allreduce fusion with safe backend defaults (#28789)
|
2026-06-23 01:29:19 -07:00 |
|
|
Mohammad Miadh Angkad
|
643ee748c6
|
[PP] Pass DSA topk through PP warmup proxy buffers (#28785)
|
2026-06-21 23:55:39 +08:00 |
|
|
Mohammad Miadh Angkad
|
3a574846ff
|
[CI] Publish 4-GPU nightly profiler traces (#28738)
|
2026-06-19 15:27:24 -07:00 |
|
|
Mohammad Miadh Angkad
|
88c261c3f3
|
Fix IndexCache PP topk handoff (#28532)
|
2026-06-19 23:39:09 +08:00 |
|
|
Mohammad Miadh Angkad
|
c7397de571
|
Use Marlin for SM120 MXFP4 MoE (#28231)
|
2026-06-18 19:19:41 -07:00 |
|
|
Mohammad Miadh Angkadandshuwenn
|
59001267c3
|
Fix bench serving base-url-only runs (#28617)
Co-authored-by: shuwenn <47200617+alphabetc1@users.noreply.github.com>
|
2026-06-18 00:34:00 -07:00 |
|
|
Mohammad Miadh Angkad
|
8d4a22c5af
|
[Docs] Add fp8 kv cache for tokenspeed mla docs (#28201)
|
2026-06-17 21:42:00 -07:00 |
|
|
Mohammad Miadh Angkad
|
d773b49e5b
|
Fix MXFP8 FlashInfer CUTLASS scale selection (#28553)
|
2026-06-17 16:44:23 -07:00 |
|
|
Mohammad Miadh Angkad
|
69b02ea68a
|
[Distributed] Guard torch symm mem all-reduce sizes (#24548)
|
2026-06-14 18:28:57 -07:00 |
|
|
Mohammad Miadh Angkad
|
91c63aeb4d
|
Fix stale CUDA graph benchmark and docs refs (#28041)
|
2026-06-13 21:51:42 -07:00 |
|
|
Mohammad Miadh Angkad
|
cb9140ee61
|
Enable PDL for GPT-OSS tinygemm router (#27941)
|
2026-06-12 13:51:50 -07:00 |
|
|
Mohammad Miadh Angkadandzijiexia
|
fa4273d2db
|
[Docs] Add Kimi K2.7 Code cookbook (#28064)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-06-12 11:19:44 -07:00 |
|
|
Mohammad Miadh Angkad
|
7e245afefe
|
[CI] Fix registered sigmoid gate mul test location (#27909)
|
2026-06-11 18:52:37 +08:00 |
|
|
Mohammad Miadh Angkad
|
6ac9f66596
|
Remove MoE prefill CUDA graph disable guard (#27841)
|
2026-06-11 18:30:15 +08:00 |
|
|
Mohammad Miadh Angkad
|
bdf3ef6421
|
[CI] Fix registered QK Gemma RMSNorm test location (#27839)
|
2026-06-10 15:21:59 -07:00 |
|
|
Mohammad Miadh Angkad
|
276c98c6cf
|
[Docs] Add Kimi-K2.6 NVFP4 and update Kimi-K2.5 cookbook guidance (#27714)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-10 10:24:09 -07:00 |
|
|
Mohammad Miadh Angkad
|
91ff7baa28
|
[Docs] Add GLM-5.1 NVFP4 to cookbook (#27708)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-10 10:23:15 -07:00 |
|
|
Mohammad Miadh Angkad
|
4faaa9ba92
|
[CI] Fix stale ngram bookkeeping owner sites (#27803)
|
2026-06-10 04:51:46 -07:00 |
|
|
Mohammad Miadh Angkad
|
bc82086ef8
|
Remove FlashInfer GB transport workaround (#27453)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-09 16:48:49 -07:00 |
|
|
Mohammad Miadh Angkad
|
a287ab83c0
|
Fix Gemma4 NVFP4 MoE default attention backend (#26791)
|
2026-06-09 14:33:08 +08:00 |
|
|
Mohammad Miadh Angkad
|
dc24a26821
|
Fix GPT-OSS MXFP4 hidden size reshape on SM10X (#27528)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-08 13:26:54 -07:00 |
|
|
Mohammad Miadh AngkadandLianmin Zheng
|
52f221cce0
|
Fix Req array token-id concatenation (#26182)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-06 19:59:51 -07:00 |
|
|
Mohammad Miadh Angkad
|
7f706f4cfb
|
[Deps] Bump FI to 0.6.12 and cutedsl to 4.5.2 (#26854)
|
2026-06-03 12:09:18 -07:00 |
|
|
Mohammad Miadh Angkad
|
690d4cdd94
|
Revert "[CI] FA3: ascending cuda-graph capture to avoid varlen workspace IMA (#26532) (#26550)" (#26600)
|
2026-05-28 13:17:37 -07:00 |
|
|
Mohammad Miadh Angkad
|
76b1efaffd
|
Fix SMG service discovery Clippy lint (#26034)
|
2026-05-22 10:51:13 +08:00 |
|
|
Mohammad Miadh Angkad
|
a449ee4822
|
[Deps] Use cu13 extra for nvidia cutlass dsl (#25576)
|
2026-05-21 10:31:27 +08:00 |
|
|
Mohammad Miadh AngkadandBaizhou Zhang
|
8cb337c8ea
|
[Bugfix] Temporarily skip TRTLLM attention on (G)B300 (SM103) to avoid high-concurrency hang (#21906)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-04-03 14:19:13 -07:00 |
|
|
Mohammad Miadh Angkad
|
883ba640b2
|
[CI] Remove more redundant PCG tests (#21554)
|
2026-03-31 16:25:30 -07:00 |
|
|
Mohammad Miadh Angkad
|
dd9c9c1b8e
|
Add explicit disable flag for FlashInfer allreduce fusion (#21446)
|
2026-03-31 00:15:44 -07:00 |
|
|
Mohammad Miadh Angkad
|
2acdda1d85
|
[Fix] Remove redundant allreduce fusion block and skip TP=1 (#20621)
|
2026-03-29 12:30:40 -07:00 |
|
|
Mohammad Miadh Angkad
|
eaf392b9cc
|
Remove redundant DeepSeek V3 FP4 PCG test (#21485)
|
2026-03-26 21:52:47 -07:00 |
|
|
Mohammad Miadh Angkadandelvischenv
|
bbe25b2412
|
Use FlashInfer tinygemm for GPT-OSS MoE router on SM90+ (#20755)
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
|
2026-03-24 15:00:18 -07:00 |
|
|
Mohammad Miadh Angkad
|
4fbb311234
|
[Fix][Eval] Keep --dataset-path scoped to longbench_v2 (#21156)
|
2026-03-24 02:25:11 -07:00 |
|
|
Mohammad Miadh Angkad
|
d8a5b1dbaf
|
[Bugfix] Work around FlashInfer unified transport issue on GB (#20039)
|
2026-03-22 21:10:25 -07:00 |
|
|
Mohammad Miadh Angkad
|
3d749c49ca
|
[JIT Kernel] Fix NVFP4 multi-arch compilation failure (#20874)
|
2026-03-20 10:30:04 +08:00 |
|
|
Mohammad Miadh Angkad
|
29ced9c162
|
[UX] Suppress noisy httpx/httpcore INFO logs (#20944)
|
2026-03-19 10:58:41 -07:00 |
|
|
Mohammad Miadh Angkad
|
3879c466b4
|
[CI] Add Nemotron 3 Super 120B nightly 8-GPU tests (#20616)
|
2026-03-15 18:03:20 -07:00 |
|
|
Mohammad Miadh Angkad
|
3e643967e6
|
[CI] Add Nemotron 3 Super 120B CI tests for BF16 and NVFP4 (#20575)
|
2026-03-14 12:30:27 -07:00 |
|
|
Mohammad Miadh Angkad
|
75a7879fd4
|
[Model] Support Nemotron 3 Super NVFP4 (#20407)
|
2026-03-14 00:56:26 -07:00 |
|
|
Mohammad Miadh Angkad
|
ca997b7ba9
|
Add min_p and chat-template kwargs support to run_eval (#19571)
|
2026-03-09 14:53:09 -07:00 |
|
|
Mohammad Miadh Angkad
|
f88acf8780
|
[JIT Kernel] Reland NVFP4 kernels to JIT (#20012)
|
2026-03-07 10:31:08 +08:00 |
|
|
Mohammad Miadh Angkad
|
8cdb7e1fd4
|
[CI] Add GPT-OSS test for SM120 (#20056)
|
2026-03-06 11:43:04 -08:00 |
|
|
Mohammad Miadh Angkad
|
759700c808
|
Fix SM120 triton_kernels MXFP4 block_k for GPT-OSS (#20040)
|
2026-03-06 10:53:08 -08:00 |
|
|
Mohammad Miadh Angkad
|
41fd53fe37
|
Fix profile_activities parameter name in bench_one_batch_server_internal.py (#19954)
|
2026-03-05 10:34:06 -08:00 |
|
|
Mohammad Miadh Angkad
|
2bdd89a6cd
|
[Kernel Slimming] Migrate NVFP4 kernels to JIT (#19437)
|
2026-03-05 15:22:28 +08:00 |
|
|
Mohammad Miadh Angkad
|
1b76eb9361
|
[Doc] Update version references and add automation (#18409)
|
2026-03-04 09:51:46 -08:00 |
|
|
Mohammad Miadh Angkad
|
09fa012ba7
|
Fix /health regression from early prebound socket listen (#19805)
|
2026-03-03 23:00:46 -08:00 |
|
|
Mohammad Miadh Angkad
|
6822941514
|
[FlashInfer] Bump FlashInfer version from 0.6.3 to 0.6.4 (#19005)
|
2026-03-02 16:12:09 -08:00 |
|
|
Mohammad Miadh Angkad
|
3f9fc8b848
|
[Qwen3.5] Fix missing quant_config in Qwen3VL (#19291)
|
2026-03-02 14:07:51 -08:00 |
|
|
Mohammad Miadh AngkadandXinyuan Tong
|
9c81ce4707
|
[Anthropic API] Preserve image content in tool_result conversion (#19233)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-02-28 12:07:22 -08:00 |
|
|
Mohammad Miadh Angkad
|
35ef38c61b
|
Remove gpt-oss hybrid swa gate for trtllm_mha (#19079)
|
2026-02-27 10:30:00 -08:00 |
|
|
Mohammad Miadh Angkad
|
671b595570
|
Fix trtllm_mha fp8 SWA KV index translation (#19107)
|
2026-02-25 17:02:17 +08:00 |
|
|
Mohammad Miadh Angkad
|
7b0fb43c7a
|
[FlashInfer] Switch FlashInfer allreduce fusion to unified API (#18341)
|
2026-02-22 00:07:16 +08:00 |
|