docs: update fused MoE config path (#13211)
This commit is contained in:
@@ -151,7 +151,7 @@ After tuning, configuration files will be generated:
|
|||||||
- **Standard tuning**: `E=64,N=640,device_name=NVIDIA_GeForce_RTX_4090,dtype=fp8_w8a8.json`
|
- **Standard tuning**: `E=64,N=640,device_name=NVIDIA_GeForce_RTX_4090,dtype=fp8_w8a8.json`
|
||||||
- **Separate kernel tuning**: Two files for up/down kernels with TMA optimization flags
|
- **Separate kernel tuning**: Two files for up/down kernels with TMA optimization flags
|
||||||
|
|
||||||
Move these files to `sglang/srt/layers/fused_moe_triton/configs/triton_version/` directory to use them in SGLang.
|
Move these files to `sglang/srt/layers/moe/fused_moe_triton/configs/triton_version/` directory to use them in SGLang.
|
||||||
|
|
||||||
### Supported Models
|
### Supported Models
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user