Commit Graph
337 Commits
Author SHA1 Message Date
Mick 643e1cc779 fix: fix prefill-aware SWA floor tracking (#29520) 2026-06-28 14:18:28 +08:00
Mick cfd911ad6e docs: refine diffusion cookbook overview (#29507) 2026-06-28 00:10:21 +08:00
Aditya KamatandMick 1589603114 model: support baidu unlimited-ocr (#29186)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-06-27 23:36:19 +08:00
b030b1a5f3 hisparse: support NIXL DRAM KV destinations for HiSparse (#27563)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-06-27 22:32:29 +08:00
jonah-bermanandXinyuan Tong 2f34dbe372 Add native Exa-backed web_search support (#29342)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-06-27 14:41:09 +01:00
amote-i a3c5e286f6 [NPU] [DOC] Fix and update Ascend NPU docs (#29501) 2026-06-27 18:23:11 +08:00
zijiexiaandClaude Opus 4.8 e0c0c0a45c [Cookbook] GLM-5.2: tune GB300 NVFP4 recipes + fill benchmarks (#29486)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-27 01:01:28 -07:00
Baizhou Zhang 12f76d115c Update GLM-5.2 B300 and GB300 NVFP4 cookbook settings (#29466) 2026-06-26 16:15:33 -07:00
Yaochen Hanandronnie_zheng c98d31143d update quantization code owner and document quantization contributions (#26784)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-06-26 19:40:33 +03:00
zijiexiaandClaude Opus 4.8 c21c2d9421 [Docs] Cookbook: match playground docker image resolution to deployment (hw|quant) (#29400)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-26 00:56:34 -07:00
aeb4e98108 [diffusion] model: support JoyEcho multi-shot A/V generation support (#27420)
Co-authored-by: niehen6174 <niehen6174@users.noreply.github.com>
Co-authored-by: 1639206518@qq.com <niehen6174>
2026-06-26 15:46:31 +08:00
zijiexiaandClaude Opus 4.8 dd56a9f069 [Docs] Add NVFP4 quantization to GLM-5.2 cookbook (#29380)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-26 00:40:13 -07:00
jianzhao-xu cc294829aa [NPU] fix best practicce docs (#29303) 2026-06-26 11:17:50 +08:00
Raiden MakotoandRaiden-Makoto 7f376644e0 [AMD] [GLM5] Mark EAGLE verified on MI300X/MI325X (gfx942) in GLM-5.1 cookbook (#29313)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
2026-06-26 10:49:58 +08:00
cfc0a0e0e0 Add Intel Quantization Support in SGLang (#18139)
Signed-off-by: Mengni Wang <mengni.wang@intel.com>
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: Weiwei <weiwei1.zhang@intel.com>
2026-06-26 09:54:35 +08:00
amote-i 10ff3c1dcb [NPU] [DOC] Add environment prerequisites to model tutorials (#29293) 2026-06-26 09:51:06 +08:00
Yi Zhong f83cbc2516 Add LFM2.5-230M to the LFM2.5 cookbook (#29321) 2026-06-26 08:27:57 +08:00
Xiaoyu Zhang 4d06d4c97f Sync Gemma4 hardware table with Blackwell recipes (#29266) 2026-06-25 22:57:33 +08:00
52c32035eb [diffusion] Add Qwen-Image ModelOpt NVFP4 support (#28928)
Co-authored-by: jingyu-ml <jingyux@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-25 22:56:09 +08:00
Mick 890b38c211 [diffusion] doc: fix diffusion docs and cookbook drift (#29302) 2026-06-25 21:13:00 +08:00
Raiden MakotoandRaiden-Makoto 0075c8f02b [AMD] [GLM5] GLM-5.1 MXFP4 (MI355X) + enable EAGLE for gfx950 in cookbook (#29194)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
2026-06-25 03:54:48 -07:00
Mohammad Miadh Angkad e4976683f4 [Docs] Fix broken links in cookbook (#29261) 2026-06-25 02:31:55 -07:00
Xiaoyu Zhang 7c9804ef21 Add MiMo V2.5 Blackwell vision FA4 recipe (#29253) 2026-06-25 13:47:32 +08:00
Xiaoyu Zhang efbe67d237 Tune Gemma4 26B-A4B B200 memory recipe (#29252) 2026-06-25 11:31:25 +08:00
Brayden ZhongandBrayden Zhong f82addd4a8 Support online MXFP8 quantization for ungated MoE (#27939)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-06-24 16:58:48 -07:00
Brayden ZhongandBrayden Zhong 2c697daf5f [Cookbook] Nemotron3-Ultra: align MTP draft depth with NVIDIA reference (num_steps 5) (#29200)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-06-24 19:12:34 +00:00
Anusha Pant e97cc339e3 Add DeepSeek V4 Flash demo notebook (#28952) 2026-06-24 18:42:33 +00:00
Yihao Wang dd4caf9459 [Docs] fix SGLang-diffusion installation links (#29139) 2026-06-24 09:46:06 -07:00
amote-i 73d976e375 [NPU] [DOC] Fix TOC of Ascend NPU Docs (#29129) 2026-06-24 16:47:10 +08:00
zijiexiaandClaude Opus 4.8 dd2d919e21 [Docs] Fix mem-fraction-static default and document how it is computed (#29135)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-24 08:05:06 +00:00
Trevor Morris f74a1722e6 [NVIDIA] Support TF32 matmul to improve MiniMax gate gemm performance (#22744) 2026-06-23 14:54:54 -07:00
Yihao Wang 83d32fbc2f remove lora section (#29056) 2026-06-23 16:26:51 +00:00
Yihao Wang b5e0965b07 [Diffusion][Cookbook] Add Krea-2 cookbook (#29051) 2026-06-23 08:02:08 -07:00
zijiexiaandClaude Opus 4.8 52a90c9a36 docs(minimax-m3): use published AMD ROCm images (#28777)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-23 07:48:16 +01:00
Thomas Wang 7e6587c94a [AMD] Update v4 cookbook to clean env vars (#28981) 2026-06-22 22:16:29 -07:00
amote-i 84338df6f0 [NPU] [DOC] Update contribution guide of Ascend NPU (#28909) 2026-06-23 10:00:12 +08:00
99c18cceec Sync server arguments and environment variables + update various documentation (#28674)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-06-22 10:23:46 -07:00
Brayden ZhongandBrayden Zhong 34e5e38604 [Cookbook] Nemotron3-Ultra: Add mamba-backend and SSM dtype flags (#28675)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
2026-06-22 09:50:22 -07:00
jianzhao-xu 4e1d25117b [NPU] update best practice docs from testcase (#28621) 2026-06-22 16:58:48 +08:00
amote-i 93553a67a3 [NPU] [DOC] Create deployment tutorials for mainstream models on Ascend NPU (#27893) 2026-06-22 16:21:13 +08:00
018d0c21dc [Docs] Add Anthropic-compatible API documentation (#28522)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-22 04:01:09 +00:00
be774d0acd [docs][cookbook] Laguna-M.1 playground: add HiCache; refresh EP / DP-Attention notes (#28774)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
2026-06-22 03:58:42 +00:00
Trevor Morris c0bb04b67f [NVIDIA] Support NVFP4 MoE for DeepSeek-V4 (#25820) 2026-06-21 19:35:14 -07:00
amote-i 5deca2d39f [DOC] [NPU] Update features on Ascend NPU (#28643) 2026-06-22 09:50:51 +08:00
cctry 6d4ca9bc54 Cap SWA pool sizing with chunk cache (#28755) 2026-06-21 01:06:59 -07:00
Jimmy Shong 7516f0db9f [cookbook] Laguna-M.1: add PD disaggregation section (#28737) 2026-06-19 19:49:49 -07:00
Oguz Ulgen 3af991fb3e [AMD] Make breakable CUDA graph run on ROCm/HIP (#28173) 2026-06-19 07:16:00 -07:00
Xiaoyu Zhang 7e20e25848 [docs] Add B300 cookbook deployment options (#28697) 2026-06-18 21:52:45 -07:00
Clintandclintg6 fac11f3bc1 [AMD] Document Mori XGMI for Single-Node PD Disaggregation (#25094)
Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>
2026-06-18 19:25:49 -07:00
Jimmy Shong d962d18f15 docs: add --trust-remote-code to Laguna-M.1 / XS.2 cookbook configs (#28693) 2026-06-19 10:21:39 +08:00