 YAMY
|
2e4d6368c3
|
[GDN] Auto-select FlashInfer GDN prefill on validated SM100 configs (#29734)
|
2026-07-10 00:26:00 +08:00 |
|
|
Mohammad Miadh Angkad
|
666a09fe2a
|
Disable multi-threaded load by default when prefetch is on (#30146)
|
2026-07-09 00:28:53 -07:00 |
|
|
Junlin Wuandronnie_zheng
|
3abdbab9bb
|
✨ [llm][npu][quant] Add W4A8 MXFP quantization support for Qwen3 Dense on Ascend NPU (#23650)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-07-06 19:23:26 +03:00 |
|
|
Cheng Wanandlch1475369
|
4a8e76805c
|
feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678)
Co-authored-by: lch1475369 <lch1475369@gmail.com>
|
2026-07-01 13:21:59 -07:00 |
|
|
Trevor Morris
|
b8c25bfaa7
|
[NVIDIA] Support flashinfer a2a with flashinfer_trtllm_routed moe (#22394)
|
2026-06-29 16:23:58 -07:00 |
|
|
Cheng Wanandlch1475369
|
fc96edd297
|
feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533)
Co-authored-by: lch1475369 <lch1475369@gmail.com>
|
2026-06-29 14:49:54 -07:00 |
|
|
danielafrimiandDaniel Afrimi
|
a2b5ce2ed1
|
Add stochastic rounding for FP16 Mamba SSM cache (#26929)
Signed-off-by: Daniel Afrimi <dafrimi@login-lyris01.lyris.clusters.nvidia.com>
Co-authored-by: Daniel Afrimi <dafrimi@login-lyris01.lyris.clusters.nvidia.com>
|
2026-06-29 01:47:09 -07:00 |
|
|
Liangsheng Yin
|
909123ddb8
|
[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591)
|
2026-06-28 18:38:28 -07:00 |
|
|
|
b030b1a5f3
|
hisparse: support NIXL DRAM KV destinations for HiSparse (#27563)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-27 22:32:29 +08:00 |
|
|
jonah-bermanandXinyuan Tong
|
2f34dbe372
|
Add native Exa-backed web_search support (#29342)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-06-27 14:41:09 +01:00 |
|
|
|
cfc0a0e0e0
|
Add Intel Quantization Support in SGLang (#18139)
Signed-off-by: Mengni Wang <mengni.wang@intel.com>
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: Weiwei <weiwei1.zhang@intel.com>
|
2026-06-26 09:54:35 +08:00 |
|
|
Brayden ZhongandBrayden Zhong
|
f82addd4a8
|
Support online MXFP8 quantization for ungated MoE (#27939)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-24 16:58:48 -07:00 |
|
|
zijiexiaandClaude Opus 4.8
|
dd2d919e21
|
[Docs] Fix mem-fraction-static default and document how it is computed (#29135)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-24 08:05:06 +00:00 |
|
|
Trevor Morris
|
f74a1722e6
|
[NVIDIA] Support TF32 matmul to improve MiniMax gate gemm performance (#22744)
|
2026-06-23 14:54:54 -07:00 |
|
|
|
99c18cceec
|
Sync server arguments and environment variables + update various documentation (#28674)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-06-22 10:23:46 -07:00 |
|
|
Oguz Ulgen
|
3af991fb3e
|
[AMD] Make breakable CUDA graph run on ROCm/HIP (#28173)
|
2026-06-19 07:16:00 -07:00 |
|
|
Junlin Wuandronnie_zheng
|
2a8ea70059
|
✨ [llm][npu][quant] Add W8A8 MXFP8 quantization support for Qwen3 Dense on Ascend NPU (#22352)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-16 09:45:18 +03:00 |
|
|
McZyWu
|
8bdb007e58
|
[NPU] Docs op performance optimize (#28277)
|
2026-06-15 20:28:18 +08:00 |
|
|
Lianmin Zheng
|
f18d38d040
|
Revert "[AMD][Quantization] Online MXFP4 quantization 2/N - FP8 to MXFP4 requantization on AMD GPUs" (#28213)
|
2026-06-14 13:34:06 -07:00 |
|
|
Mohammad Miadh Angkad
|
91c63aeb4d
|
Fix stale CUDA graph benchmark and docs refs (#28041)
|
2026-06-13 21:51:42 -07:00 |
|
|
|
3f4a338212
|
[AMD][Quantization] Online MXFP4 quantization 2/N - FP8 to MXFP4 requantization on AMD GPUs (#18182)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-06-13 16:08:19 -07:00 |
|
|
IBRAHIM IBRAHIMandClaude Opus 4.8
|
45f8d48994
|
docs: add llm-d page under Advanced Features (#28078)
Signed-off-by: IBRAHIM IBRAHIM <66755652+Ibrahim2595@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-12 18:40:31 -07:00 |
|
|
Yuwei AnandClaude Fable 5
|
6c3e429ba1
|
[Tiny] Cuda Graph Refactor Code Style Follow up (#28107)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-06-12 18:38:13 -07:00 |
|
|
Liangsheng Yin
|
c0480a88be
|
[Spec] Retire Spec V1 (#27964)
|
2026-06-11 16:15:15 -07:00 |
|
|
Baizhou Zhang
|
3c1b0fb226
|
[1/n] [CP] Simplify prefill context parallel server args (#27312)
|
2026-06-10 14:11:38 -07:00 |
|
|
Ziang Li
|
01f10acd06
|
Implement online nvfp4 quantization (#26083)
|
2026-06-10 00:26:51 -07:00 |
|
|
|
2495c02c2c
|
[Refactor] Cuda Graph Runner/Backend Refactor (#23906)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-09 21:36:57 -07:00 |
|
|
EduardDurech
|
e9dbbd19e9
|
[model] Apertus Tool/Function and Reasoning parser (#25100)
|
2026-06-06 00:04:31 -07:00 |
|
|
|
6b180959a8
|
[SPEC][5/N] feat: batchsize-aware support for adaptive speculative_num_steps (#24055)
Co-authored-by: 坤钧 <maoyuhan.myh@antgroup.co>
Co-authored-by: alphabetc1 <alphabetc1@users.noreply.github.com>
Co-authored-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: shuwenn <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: shuwenn <2508695655@qq.com>
|
2026-06-05 15:43:02 -07:00 |
|
|
zijiexiaandClaude Opus 4.8
|
c6c1f1a29a
|
docs: sync legacy docs/-only updates into docs_new (Mintlify) (#27308)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-04 19:45:13 -07:00 |
|
|
|
e76d36214b
|
Changes for SM120 perf and usability for NVFP4 (#26496)
Co-authored-by: Martin Vit <martin@voipmonitor.org>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
|
2026-06-04 15:29:25 -07:00 |
|
|
Jinyan ChenandJinyan Chen
|
10b6b45cad
|
docs: add DeepSeek V4 FP4 indexer usage (#27035)
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
|
2026-06-04 00:44:21 -07:00 |
|
|
|
293816ab14
|
[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Colin Zeng <Colin.Zeng@amd.com>
|
2026-06-03 12:55:24 -07:00 |
|
|
|
e67810bea7
|
[SGLang Tracing] Add pd disaggregation mooncake backend tracing (#23755)
Co-authored-by: Mu Huai <tianbowen.tbw@antgroup.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-03 16:43:29 +08:00 |
|
|
Shaun Kotek
|
b8d7351a74
|
Feat/add w4a16 moe support to nemotron (#25655)
|
2026-06-02 22:42:26 -07:00 |
|
|
Teng MaandZijie Xia
|
b562da0d9f
|
[PD] docs: clarify disaggregation IB device formats (#25521)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
|
2026-06-02 11:38:33 +08:00 |
|
|
|
98a1b58c47
|
docs(cookbook): port popular model usage guides into cookbook pages (#25813)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
|
2026-06-01 17:41:49 -07:00 |
|
|
Chao Shi
|
6ce49e5f4c
|
[Utils] Support configure log level at runtime (#26583)
|
2026-05-29 14:49:06 -07:00 |
|
|
Brayden Zhongandb8zhong
|
50e0b3b77f
|
Support Flashinfer Cute-DSL MLA attention (#24737)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-28 00:21:32 -07:00 |
|
|
Shaoting
|
14c1bb2721
|
[Feat][LMCache] Support LMCache mp mode (#24089)
Signed-off-by: Shaoting-Feng <stfeng@uw.edu>
|
2026-05-28 10:15:09 +08:00 |
|
|
Ziang Li
|
2b9dd9c8b3
|
[FlashInfer v0.6.10] [RL] [DSv32] [GLM-5] Add --dsa-topk-backend and integrate FlashInfer and pytorch topk (#22851)
|
2026-05-25 13:08:03 -07:00 |
|
|
Zhanghengand晟海
|
a4db563c87
|
[hisparse]: update user guide (#26249)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-05-25 17:54:55 +08:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
8131641bc6
|
[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 00:18:04 -07:00 |
|
|
|
a080358cac
|
[Refactor] Refactor DeepEP dispatcher (#22822)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-05-18 04:36:42 +03:00 |
|
|
Zheng Luo
|
435ea41cf0
|
Delegate ModelExpress loading to package (#24723)
Signed-off-by: Zheng Luo <zheluo@nvidia.com>
|
2026-05-16 11:16:44 -07:00 |
|
|
Lewisand百麒
|
0680f1b3d1
|
Add IntraNode NVLink configration in PD disaggregation docs (#23329)
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
|
2026-05-13 23:23:57 -07:00 |
|
|
shuwenn
|
5495026a3b
|
[HiCache] feat: default storage prefetch timeout (#23309)
|
2026-05-11 18:49:35 -07:00 |
|
|
egvenediktov
|
2473659e76
|
[NPU]Documentation update for communications quantization feature (#24668)
|
2026-05-10 23:49:21 +03:00 |
|
|
Brayden Zhongandb8zhong
|
8f33bee31b
|
Reland Cute-DSL FP4 dense GEMM (#23590)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
|
2026-05-09 02:20:58 -07:00 |
|
|
Revanth Reddy Airre
|
be088f8076
|
fix(router): configure HTTP client connection settings (#24330)
Signed-off-by: Revanth Reddy Airre <revanthreddy@hippocraticai.com>
|
2026-05-07 11:42:45 -07:00 |
|