Commit Graph
242 Commits
Author SHA1 Message Date
Liangsheng Yin c0480a88be [Spec] Retire Spec V1 (#27964) 2026-06-11 16:15:15 -07:00
Trevor Morris 0bac184425 [NVIDIA] Update Minimax-M2.5,M2.7 docs with flags for performance (#24465) 2026-06-11 14:58:44 -07:00
Brian Chao 7f57b344c9 [diffusion] feat: progressive resolution growing for Ideogram 4 via GPU DCT upsampling with up to 1.56× speedup (#27736) 2026-06-11 23:16:53 +08:00
Chi McIsaacandMick b2728bda9d [diffusion] feat: use fused w8a8 kernel for Ideogram4 weight-only linear as an opt-in (#27590)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-06-11 23:15:27 +08:00
ming_wang ce0ff154a5 add mimo best practice (#27665) 2026-06-11 10:15:31 +08:00
amote-i fc1fee528c [NPU] [DOC] replace <code> with backticks and remove obsolete params (#27677) 2026-06-11 09:33:31 +08:00
zijiexiaandClaude Fable 5 43835b5ba5 docs: cookbook benchmark accuracy labels come from the model config (no engine default) (#27842)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 18:27:38 -07:00
Baizhou Zhang 3c1b0fb226 [1/n] [CP] Simplify prefill context parallel server args (#27312) 2026-06-10 14:11:38 -07:00
zijiexiaandClaude Opus 4.8 99258b2f1e [Docs] Restore right-hand ToC on the DeepSeek-V4 cookbook page (#27830)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-10 11:58:02 -07:00
Mohammad Miadh Angkad 276c98c6cf [Docs] Add Kimi-K2.6 NVFP4 and update Kimi-K2.5 cookbook guidance (#27714)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-06-10 10:24:09 -07:00
billishyahaoandHAI 0ae27405d0 [AMD] Support eplb for moriep (#22985)
Co-authored-by: HAI <hixiao@gmail.com>
2026-06-10 10:23:51 -07:00
Mohammad Miadh Angkad 91ff7baa28 [Docs] Add GLM-5.1 NVFP4 to cookbook (#27708)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-06-10 10:23:15 -07:00
1cf8efdd08 docs: Diffusion Gemma cookbook (#27824)
Co-authored-by: Richard Wang <wangrichard08@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-10 09:33:01 -07:00
JoyFuture 53ed34cb88 Fix MiMo-V2.5-Pro DP-attention dp size in cookbook deployment snippet (#27668) 2026-06-10 22:08:28 +08:00
Ziang Li 01f10acd06 Implement online nvfp4 quantization (#26083) 2026-06-10 00:26:51 -07:00
Mick e8a437ef26 [diffusion] doc: update docs architecture (#27767) 2026-06-10 14:18:10 +08:00
2495c02c2c [Refactor] Cuda Graph Runner/Backend Refactor (#23906)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-06-09 21:36:57 -07:00
zijiexia 6565b7c464 [Docs] Update MegaMoE handling and rerun benchmarks (#27726) 2026-06-09 19:00:43 -07:00
bcd9c5a903 update pytorch-xpu to 2.12 (#27133)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
2026-06-10 09:25:30 +08:00
Thomas Wang 9ab7a64ee1 [AMD] Update amd qwen3.5 cookbook (#27660) 2026-06-09 16:26:33 -07:00
Liangsheng Yin 186f1e300a [CI] Move JIT kernel tests + benchmarks to test/registered/jit; add in-package guard (#27644) 2026-06-09 12:37:39 -07:00
Mick f6d53d6d16 docs: update SANA-WM cookbook serve examples (#27626) 2026-06-09 11:44:31 +08:00
bdf47315ce docs: add cookbook for SANA-WM (#27198)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-06-09 10:47:32 +08:00
801fe5e0f2 docs: sync LMSYS SGLang blog cards (#27517)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-06-08 20:31:30 +00:00
Brian Chao b0cd533a96 [diffusion] feat: progressive resolution growing for image and video models (#27524) 2026-06-08 20:44:07 +08:00
zijiexiaandClaude Opus 4.8 d1777d1f6d Cookbook renovation (#26885)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-07 22:04:54 -07:00
52a5c01eba [plugin] enable OOT platforms to provide custom quant configs (#25347)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <laldevashish@gmail.com>
2026-06-07 12:48:55 +08:00
Артем Савкин 9f28512737 [NPU] Update documentation for software version upgrades (#26731) 2026-06-06 15:06:13 +03:00
EduardDurech e9dbbd19e9 [model] Apertus Tool/Function and Reasoning parser (#25100) 2026-06-06 00:04:31 -07:00
Zaili Wangandgemini-code-assist[bot] caeb449cd6 [Doc][CPU]Update Cookbook with Xeon support info (#27248)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-06-05 22:39:40 -07:00
Mick bf66b7b6da [diffusion] model: support Ideogram4 NVFP4 (#27379) 2026-06-06 11:14:28 +08:00
6b180959a8 [SPEC][5/N] feat: batchsize-aware support for adaptive speculative_num_steps (#24055)
Co-authored-by: 坤钧 <maoyuhan.myh@antgroup.co>
Co-authored-by: alphabetc1 <alphabetc1@users.noreply.github.com>
Co-authored-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: shuwenn <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: shuwenn <2508695655@qq.com>
2026-06-05 15:43:02 -07:00
zijiexiaandClaude Opus 4.8 632a3d480e docs: add Tencent Hunyuan and Poolside cards to autoregressive cookbook (#27400)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-05 13:17:13 -07:00
Khoa PhamandClaude Opus 4.8 bf172c492a Cookbook for QAT (#27396)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-05 11:18:11 -07:00
McZyWu d8487bad06 Update best practice for qwen3-next-80b-a3b-instruct (#27353) 2026-06-05 17:02:38 +08:00
jianzhao-xu 4248695b07 [NPU] add GLM model best practice docs (#27032) 2026-06-05 14:27:19 +08:00
zijiexiaandClaude Opus 4.8 c6c1f1a29a docs: sync legacy docs/-only updates into docs_new (Mintlify) (#27308)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-04 19:45:13 -07:00
Xinyuan Tong 7425bebb6c docs(cookbook): restore Gemma 4 transformers commit pin (#27321) 2026-06-04 17:43:36 -07:00
sglang-botandsglang-bot bba8de8cb4 docs: sync LMSYS SGLang blog cards (#27322)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-06-04 17:42:09 -07:00
e76d36214b Changes for SM120 perf and usability for NVFP4 (#26496)
Co-authored-by: Martin Vit <martin@voipmonitor.org>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
2026-06-04 15:29:25 -07:00
Faradawn Yangandzijiexia 0e4aa081ba Add --enable-symm-mem for Qwen3.5 (#27296)
Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-06-04 15:23:37 -07:00
Ziang Li 4cfebbb95f [FlashInfer v0.6.12] Support FlashInfer 4over6 NVFP4 (#25239) 2026-06-04 14:35:07 -07:00
Douglas YangandClaude Opus 4.8 75be922451 docs(cookbook): add Docker install option for Gemma 4 (#27287)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-04 12:45:32 -07:00
Jinyan ChenandJinyan Chen 10b6b45cad docs: add DeepSeek V4 FP4 indexer usage (#27035)
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
2026-06-04 00:44:21 -07:00
zijiexia b89686710d [Docs] re-organize nemotron cookbook (#27240) 2026-06-04 00:40:13 -07:00
1463e5fbdd docs: add Nemotron 3 Ultra cookbook entry (#26969)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Jiajun Li <48857426+guapisolo@users.noreply.github.com>
2026-06-04 00:14:19 -07:00
Mick 5dbc52c2b7 [diffusion] doc: add ernie Image diffusion (#27195) 2026-06-04 08:45:56 +08:00
Yihao Wang 8980eb82de [Docs] Update Nemotron3-Nano-Omni cookbook to reflect new model paths (#25198) 2026-06-03 14:55:30 -07:00
Jiajun Liandzijiexia 90985117a5 docs: fix Nemotron Super MTP deployment command (spec-v2 + B200) (#27184)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-06-03 14:52:47 -07:00
293816ab14 [AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Colin Zeng <Colin.Zeng@amd.com>
2026-06-03 12:55:24 -07:00