 Zheng Li
|
fa5698d791
|
feat: [Qwen3.5] Support block-wise FP8 quantization and model adaptation (#18926)
|
2026-02-18 11:44:25 +08:00 |
|
|
Tamir Baydasovandronnie_zheng
|
aeca7d348c
|
[3/N] Quantization Refactor: ModelSlim MoE schemes (#17993)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-02-17 21:38:27 +03:00 |
|
|
Mohammad Miadh Angkad
|
90a0d66e1e
|
[Tiny] Fix assert syntax warning in compressed_tensors_w4a4_mxint4_moe.py (#18899)
|
2026-02-17 12:54:30 +08:00 |
|
|
danielafrimi
|
0ff24159a5
|
Fix modelopt FP8 create weights (#18447)
Signed-off-by: root <dafrimi@nvidia.com>
|
2026-02-17 00:59:50 +08:00 |
|
|
|
eba6af385d
|
[2/N] Quantization Refactor: Compressed tensors MoE schemes (#17503)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
|
2026-02-16 18:03:51 +03:00 |
|
|
Mohammad Miadh Angkad
|
b86c6491fa
|
[Perf] ~9.5x faster Blackwell MXFP4 MoE weight loading (#18858)
|
2026-02-16 19:47:09 +08:00 |
|
|
tjp_zjuandPeng Zhang
|
7a607c4900
|
fix_get_quant_method_in_fused_moe_condition (#18459)
Signed-off-by: tom-zju <tanjianpingzju1990@gmail.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
|
2026-02-16 00:31:42 +08:00 |
|
|
SoluMilken
|
07a24f1a38
|
update pre-commit config (#18860)
|
2026-02-16 00:18:31 +08:00 |
|
|
Linyu WuandXiaoyu Zhang
|
0012d6a4eb
|
[Kernel Slimming] Migrate GPTQ-Marlin repack kernel to JIT (#18543)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-02-13 22:29:22 +08:00 |
|
|
chenxu214
|
1edc69be08
|
[Ascend]Support qwen3.5 (#18544)
This PR affects only the NPU. If any issues arise, please contact iforgetmyname.
|
2026-02-12 15:22:47 +08:00 |
|
|
|
20554a0a4f
|
[AMD] rocm 7.2 image release, PR test, Nightly Test (#17799)
Co-authored-by: Alan Kao <akao@amd.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
|
2026-02-11 21:29:25 -08:00 |
|
|
cutetocuteandLiangsheng Yin
|
8d2892330c
|
chore: fix some typos (#18577)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2026-02-10 20:47:41 -08:00 |
|
|
|
107958a489
|
Make compressed-tensors MoEs support ignored layers (#17828)
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-02-09 14:37:33 +08:00 |
|
|
Mohammad Miadh Angkad
|
7b83659310
|
fix: fix NVFP4 Kimi-K2.5 weight mapping and exclude list (#18370)
|
2026-02-08 10:23:48 +08:00 |
|
|
Mohammad Miadh Angkad
|
fddef76619
|
[Doc] Fix outdated --fp4-gemm-backend documentation (#18350)
|
2026-02-07 20:42:47 +08:00 |
|
|
Linyu Wu
|
aa390d2762
|
[Kernel] Migrate GPTQ-Marlin GEMM kernel to JIT (#18067)
|
2026-02-06 08:31:42 +08:00 |
|
|
zhangheng
|
079fc8f3c5
|
[piecewise graph]: support MiniMax-M2 (#18217)
|
2026-02-04 23:24:38 -08:00 |
|
|
danielafrimi
|
3f1df322f9
|
[FIX] Always support TP > 4 for FP4 Gemm (#17300)
|
2026-02-05 15:10:26 +08:00 |
|
|
Meng, Hengyu
|
368936a62b
|
[XPU] Integrate MoE and minor improvements in XPU attention backend (#13561)
|
2026-02-04 23:09:59 -08:00 |
|
|
Jincong Chen
|
a72f4f839c
|
Tiny fix for fp8 moe backend flashinfer_trtllm naming (#18243)
|
2026-02-04 19:58:04 +08:00 |
|
|
elvischenv
|
99fab2ce67
|
[Bugfix] Fix Mistral Large 3 NVFP4 TRTLLM MoE (#18065)
|
2026-02-03 20:32:49 +08:00 |
|
|
b8zhongandCheng Wan
|
78bf13db44
|
MoE Refactor: Refactor modelopt_quant.py -> flashinfer_trllm.py (#16685)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-02-02 20:45:14 -08:00 |
|
|
b8zhongandBrayden Zhong
|
398d13a189
|
[Perf] Add Flashinfer DeepGEMM SM90 for SwapAB Optimization (#15514)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2026-02-01 08:56:23 +08:00 |
|
|
b8zhong
|
ef134d407d
|
[Fix] Revert back to using CUTLASS mm_fp4 backend (#17369)
|
2026-01-31 23:01:29 +08:00 |
|
|
jianan-guandgemini-code-assist[bot]
|
c35aa0238c
|
[CPU][INT4] Add INT4 kernels for CPU (#8226)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-01-29 22:30:13 -08:00 |
|
|
EduardDurech
|
1b6798a6a4
|
Fix torch.__version__ for PEP440 (#15682)
|
2026-01-29 11:55:13 -08:00 |
|
|
Ziang Li
|
3c9cc44ff5
|
Add mxfp8 support for online quantization, Triton dense linear, and CUTLASS MoE (#17449)
|
2026-01-29 21:33:57 +08:00 |
|
|
kkandwunhuang
|
ef1c512754
|
Add aiter bias moe support in gpt-oss mxfp4 model (#17735)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-01-29 01:50:11 -08:00 |
|
|
22dimensions
|
7b79326751
|
[NPU] support GPTQ quantization on npu (#15203)
Signed-off-by: 22dimensions <waitingwind@foxmail.com>
|
2026-01-29 15:48:18 +08:00 |
|
|
Артем Савкинandgemini-code-assist[bot]
|
b77b0ffd60
|
[NPU] NZ for non-quantized MOE, Qwen3 MOE double memory consumption fix (#15904)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-01-29 00:55:08 +08:00 |
|
|
Jinn
|
1953efb60e
|
[AMD] ROCm: route W4A16 MoE to Triton and fix packed-weight loading (#17863)
|
2026-01-28 08:20:23 -08:00 |
|
|
MikkoParkkola
|
c56d19b977
|
fix(quantization): add sgl_kernel fallback for FP4 quantize on Blackwell GPUs (#17816)
|
2026-01-27 18:43:17 +08:00 |
|
|
HandH1998
|
a883906a24
|
Support mxint4 flashinfer_trtllm moe gemm (#16892)
|
2026-01-26 00:15:53 +08:00 |
|
|
Trevor Morris
|
2c2c4e446b
|
[NVIDIA] Add flashinfer all-to-all MOE dispatcher (#14668)
|
2026-01-24 22:59:55 +08:00 |
|
|
Nan Jiang
|
ad05782160
|
fix post_residual_addition more generally (#17286)
|
2026-01-23 15:43:37 -08:00 |
|
|
|
5d299c25c0
|
[NPU] bugfix with Kimi-k2 and bge-reranker-v2 model (#17478)
Co-authored-by: amote-i <49533125+amote-i@users.noreply.github.com>
Co-authored-by: cy <chenyang08056032@163.com>
|
2026-01-22 22:02:05 +08:00 |
|
|
|
1fdf5cac39
|
[Auto Sync] Update environ.py, fp8.py (20260121) (#17486)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
|
2026-01-21 12:04:09 -08:00 |
|
|
Sam Shleifer
|
0d49b13fdd
|
Fix circular import in quantization modules (#17372)
|
2026-01-21 15:47:09 +08:00 |
|
|
Baizhou Zhang
|
8251a74d5f
|
[Tiny] Backward compatibility for fp4 gemm flags (#17466)
|
2026-01-21 14:34:40 +08:00 |
|
|
shuwenn
|
8fb45523f3
|
feat: support bitsandbytes quantization algorithm (#15325)
|
2026-01-19 18:36:56 -08:00 |
|
|
b8zhong
|
f374623fa9
|
[Refactor] Set fp4-gemm-backend=auto on SM100 and rename fp4-gemm-backend with flashinfer_ prefix (#17309)
|
2026-01-19 20:09:07 +08:00 |
|
|
Todobe
|
733de6be31
|
[NPU]Support GPT-OSS for NPU (#14197)
|
2026-01-19 04:13:41 +08:00 |
|
|
b8zhongandVincent Zhong
|
4df74eb576
|
[Refactor] Add -fp4-gemm-backend to replace SGLANG_FLASHINFER_FP4_GEMM_BACKEND (#16534)
Co-authored-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
|
2026-01-18 23:25:46 +08:00 |
|
|
Nan Jiang
|
dd99f818e0
|
fix: fix regression and unclear pattern (#16561)
|
2026-01-16 23:21:42 -08:00 |
|
|
Baizhou Zhang
|
a04675892e
|
Update flashinfer to 0.6.1 (#15551)
|
2026-01-17 00:48:30 +08:00 |
|
|
b8zhong
|
4346db5faf
|
[Fix] Remove assertion for padding for NVFP4 weight scales to fix GLM 4.5 NVFP4 (#12497)
|
2026-01-15 08:57:14 +08:00 |
|
|
|
424a380077
|
[NPU] NPU quantization refactoring & more quantization formats support (#14504)
Co-authored-by: TamirBaydasov <mr.jeijy@gmail.com>
Co-authored-by: Tamir Baydasov <41994229+TamirBaydasov@users.noreply.github.com>
Co-authored-by: Савкин Артем <savkinartem@MacBook-Air-Viktoria.local>
Co-authored-by: Edward Shogulin <edward.shogulin@gmail.com>
|
2026-01-15 04:25:15 +08:00 |
|
|
|
5af84c8af5
|
[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392)
Co-authored-by: Dehua Tang <dehtang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: YC Tseng <yctseng@amd.com>
|
2026-01-14 01:44:40 -08:00 |
|
|
Lianmin Zheng
|
a4825ed588
|
Fix kernel type annotations for fp8 quant and logging (#16994)
|
2026-01-13 18:14:32 -08:00 |
|
|
Lianmin Zheng
|
075c5a5789
|
Code clean up for fp8 quantization (#16982)
|
2026-01-13 12:38:39 -08:00 |
|