|
0661eb1c50
|
plugins: don't directly set quant class (#34252)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-08-10 16:01:31 -07:00 |
|
|
|
11d03eaeef
|
runtime: Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120- #32994 (#33471)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-08-09 20:15:03 +08:00 |
|
|
DevashishLal-CBandDevashish Lal
|
fc74c35546
|
kernels: scalar scale A support for fp8_gemm (#33469)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
|
2026-08-06 09:11:25 +08:00 |
|
|
|
3960983753
|
Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120 (#32994)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-08-04 08:37:42 +08:00 |
|
|
DevashishLal-CBandDevashish Lal
|
ab3d421c30
|
[plugin] oot torch profiler activity support (#31580)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
|
2026-07-17 22:20:54 -07:00 |
|
|
|
52a5c01eba
|
[plugin] enable OOT platforms to provide custom quant configs (#25347)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <laldevashish@gmail.com>
|
2026-06-07 12:48:55 +08:00 |
|
|
DevashishLal-CBandDevashish Lal
|
6a3316dd1e
|
[plugin] default device detection fixes for OOT platform plugins (#25337)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
|
2026-06-06 07:55:50 +08:00 |
|
|
DevashishLal-CB
|
8831c55c3d
|
[model] added support for w8a8int8 used by neuralmagic/Qwen2-0.5B-Ins… (#9642)
|
2025-09-30 11:26:17 +08:00 |
|
|
DevashishLal-CBandXiaoyu Zhang
|
dbb1235d58
|
[Fix] illegal sync based on undefined behaviour (#9620)
Signed-off-by: Devashish Lal <devashish@rivosinc.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-09-06 11:54:48 +08:00 |
|
|
DevashishLal-CB
|
13705dae06
|
[Fix] Add speculative_draft_model_revision to server_args (#5255)
Signed-off-by: Devashish Lal <devashish@rivosinc.com>
|
2025-09-05 19:45:46 +08:00 |
|