Commit Graph
226 Commits
Author SHA1 Message Date
2495c02c2c [Refactor] Cuda Graph Runner/Backend Refactor (#23906)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-06-09 21:36:57 -07:00
zijiexia 6565b7c464 [Docs] Update MegaMoE handling and rerun benchmarks (#27726) 2026-06-09 19:00:43 -07:00
bcd9c5a903 update pytorch-xpu to 2.12 (#27133)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
2026-06-10 09:25:30 +08:00
Thomas Wang 9ab7a64ee1 [AMD] Update amd qwen3.5 cookbook (#27660) 2026-06-09 16:26:33 -07:00
Liangsheng Yin 186f1e300a [CI] Move JIT kernel tests + benchmarks to test/registered/jit; add in-package guard (#27644) 2026-06-09 12:37:39 -07:00
Mick f6d53d6d16 docs: update SANA-WM cookbook serve examples (#27626) 2026-06-09 11:44:31 +08:00
bdf47315ce docs: add cookbook for SANA-WM (#27198)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-06-09 10:47:32 +08:00
801fe5e0f2 docs: sync LMSYS SGLang blog cards (#27517)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-06-08 20:31:30 +00:00
Brian Chao b0cd533a96 [diffusion] feat: progressive resolution growing for image and video models (#27524) 2026-06-08 20:44:07 +08:00
zijiexiaandClaude Opus 4.8 d1777d1f6d Cookbook renovation (#26885)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-07 22:04:54 -07:00
52a5c01eba [plugin] enable OOT platforms to provide custom quant configs (#25347)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <laldevashish@gmail.com>
2026-06-07 12:48:55 +08:00
Артем Савкин 9f28512737 [NPU] Update documentation for software version upgrades (#26731) 2026-06-06 15:06:13 +03:00
EduardDurech e9dbbd19e9 [model] Apertus Tool/Function and Reasoning parser (#25100) 2026-06-06 00:04:31 -07:00
Zaili Wangandgemini-code-assist[bot] caeb449cd6 [Doc][CPU]Update Cookbook with Xeon support info (#27248)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-06-05 22:39:40 -07:00
Mick bf66b7b6da [diffusion] model: support Ideogram4 NVFP4 (#27379) 2026-06-06 11:14:28 +08:00
6b180959a8 [SPEC][5/N] feat: batchsize-aware support for adaptive speculative_num_steps (#24055)
Co-authored-by: 坤钧 <maoyuhan.myh@antgroup.co>
Co-authored-by: alphabetc1 <alphabetc1@users.noreply.github.com>
Co-authored-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: shuwenn <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: shuwenn <2508695655@qq.com>
2026-06-05 15:43:02 -07:00
zijiexiaandClaude Opus 4.8 632a3d480e docs: add Tencent Hunyuan and Poolside cards to autoregressive cookbook (#27400)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-05 13:17:13 -07:00
Khoa PhamandClaude Opus 4.8 bf172c492a Cookbook for QAT (#27396)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-05 11:18:11 -07:00
McZyWu d8487bad06 Update best practice for qwen3-next-80b-a3b-instruct (#27353) 2026-06-05 17:02:38 +08:00
jianzhao-xu 4248695b07 [NPU] add GLM model best practice docs (#27032) 2026-06-05 14:27:19 +08:00
zijiexiaandClaude Opus 4.8 c6c1f1a29a docs: sync legacy docs/-only updates into docs_new (Mintlify) (#27308)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-04 19:45:13 -07:00
Xinyuan Tong 7425bebb6c docs(cookbook): restore Gemma 4 transformers commit pin (#27321) 2026-06-04 17:43:36 -07:00
sglang-botandsglang-bot bba8de8cb4 docs: sync LMSYS SGLang blog cards (#27322)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-06-04 17:42:09 -07:00
e76d36214b Changes for SM120 perf and usability for NVFP4 (#26496)
Co-authored-by: Martin Vit <martin@voipmonitor.org>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
2026-06-04 15:29:25 -07:00
Faradawn Yangandzijiexia 0e4aa081ba Add --enable-symm-mem for Qwen3.5 (#27296)
Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-06-04 15:23:37 -07:00
Ziang Li 4cfebbb95f [FlashInfer v0.6.12] Support FlashInfer 4over6 NVFP4 (#25239) 2026-06-04 14:35:07 -07:00
Douglas YangandClaude Opus 4.8 75be922451 docs(cookbook): add Docker install option for Gemma 4 (#27287)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-04 12:45:32 -07:00
Jinyan ChenandJinyan Chen 10b6b45cad docs: add DeepSeek V4 FP4 indexer usage (#27035)
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
2026-06-04 00:44:21 -07:00
zijiexia b89686710d [Docs] re-organize nemotron cookbook (#27240) 2026-06-04 00:40:13 -07:00
1463e5fbdd docs: add Nemotron 3 Ultra cookbook entry (#26969)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Jiajun Li <48857426+guapisolo@users.noreply.github.com>
2026-06-04 00:14:19 -07:00
Mick 5dbc52c2b7 [diffusion] doc: add ernie Image diffusion (#27195) 2026-06-04 08:45:56 +08:00
Yihao Wang 8980eb82de [Docs] Update Nemotron3-Nano-Omni cookbook to reflect new model paths (#25198) 2026-06-03 14:55:30 -07:00
Jiajun Liandzijiexia 90985117a5 docs: fix Nemotron Super MTP deployment command (spec-v2 + B200) (#27184)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-06-03 14:52:47 -07:00
293816ab14 [AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Colin Zeng <Colin.Zeng@amd.com>
2026-06-03 12:55:24 -07:00
Xinyuan Tong 45a66f4088 [Docs] Update unified Text/Vision/Audio model cookbook: install + sgl-eval accuracy (#27171) 2026-06-03 09:32:08 -07:00
Xinyuan Tong fa5c8a3101 [model] support encoder-free unified Text/Vision/Audio model (#27167) 2026-06-03 23:58:06 +08:00
e67810bea7 [SGLang Tracing] Add pd disaggregation mooncake backend tracing (#23755)
Co-authored-by: Mu Huai <tianbowen.tbw@antgroup.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-06-03 16:43:29 +08:00
xutizhou ac16dbf412 docs: add DeepSeek-V4 EPLB Waterfill tips (#27049) 2026-06-03 00:37:45 -07:00
Shaun Kotek b8d7351a74 Feat/add w4a16 moe support to nemotron (#25655) 2026-06-02 22:42:26 -07:00
Mick 2d8cb87de7 docs: tag new diffusion cookbooks (#27094) 2026-06-03 09:50:27 +08:00
MingxuZh b678448b8a ci(xeon): merge 2 partitions into 1 job to reduce runner contention (#26904) 2026-06-03 09:46:27 +08:00
littleyellowbicycle 7271318dc3 【docs】The remote weight download function has been adjusted to be unsupported until the PTA interface is fixed. (#27050) 2026-06-02 20:55:23 +08:00
Mick a6985e1be0 [diffusion] doc: add cookbook for lingbot-world (#26958) 2026-06-02 14:35:22 +08:00
Kurkur f27fa0da93 [NPU][Docs] Kimi-K2.5 best practice (#26774) 2026-06-02 13:14:14 +08:00
1c0019da75 [Docs] GLM-4.7 cookbook: add NVIDIA Blackwell (B200, GB200) + NVFP4 sections (#26384)
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-01 20:47:51 -07:00
Teng MaandZijie Xia b562da0d9f [PD] docs: clarify disaggregation IB device formats (#25521)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
2026-06-02 11:38:33 +08:00
98a1b58c47 docs(cookbook): port popular model usage guides into cookbook pages (#25813)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
2026-06-01 17:41:49 -07:00
Baizhou Zhang 2fdae94e46 docs: update RTX PRO 6000 deployment snippet (#26968) 2026-06-01 14:34:27 -07:00
eeechoandClaude Opus 4.6 524ba10eda feat: SM120 (Blackwell Desktop) support for DeepSeek-V4 inference (#24692)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-06-01 14:05:20 -07:00
a0670b5ba3 [SPEC] feat: add adaptive speculative decoding metrics (#25940)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Jarrod Barnes <jbarnes850@gmail.com>
2026-06-01 13:53:30 -07:00