Commit Graph
2036 Commits
Author SHA1 Message Date
Ziang Li 197be2203a [Doc] quantization: Link W4A16 design from environment reference (#46170) 2026-10-23 15:49:18 -07:00
Alex NailsandClaude Opus 5.5 baf80c61b7 [Feat] platforms: Let out-of-tree platforms bind group devices and custom ops (#45897)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 12:02:42 -07:00
3e5f5505ed [Perf] diffusion: Serve image responses from in-memory encoded bytes (#45987)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 21:16:44 +08:00
chuyehandCursor f967418a35 [Doc] cookbook: Qwen3.5 MI355X FP8 agentic adds scheduler/tokenizer tuning from the InferenceX recipe (#46032)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-10-23 19:12:05 +08:00
chuyehandCursor 69f830756e [Doc] cookbook: Qwen3.5 MI355X FP8 agentic uses HiCache write_through on the v0.5.22 image (#46017)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-10-23 17:47:52 +08:00
2b8e4cde95 [Doc] [CPU] Cookbook: Update to the cookbook for models supported by Intel Xeon CPUs (#40092)
Co-authored-by: Niu Ziru <niuziru@a4bf018d3341.jf.intel.com>
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
2026-10-23 16:22:50 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 02d2445138 [Doc] cookbook: Refresh SemiAnalysis AgentX launches with seven open InferenceX PRs (#46005)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 16:04:01 +08:00
Jimmy Shong 2be6577ba9 [Doc] beam: Offer Python and Docker commands in the cookbook (#45991) 2026-10-22 23:39:10 -07:00
MickandMick Qian 363e6c6b4d [Feat] diffusion/disaggregation: split FLUX.3 prompt and image encoders (#45309)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-23 10:35:41 +08:00
zijiexiaandClaude Opus 5.5 f36ee5de93 [Doc] Cookbook: add MiniMax-M3.1 (#45924)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-23 09:07:35 +08:00
Wenbo Ji 嵇文博 afd0d7b47b [Fix] diffusion/flux: use true_cfg_scale as the FLUX CFG weight (#44260) 2026-10-22 21:30:45 +08:00
Song Bianandkernel-design-agents 0ec3fee429 [Perf] [KDA] cookbook: enable custom all-reduce for GB300 BF16 Muse Spark (#45429)
Co-authored-by: kernel-design-agents <kernel-design-agents@users.noreply.github.com>
2026-10-22 20:46:28 +08:00
Song Bianandkernel-design-agents e43f6128a0 [Fix] [KDA] cookbook: add MoE runner backend to Muse Spark BF16 recipes (#45422)
Co-authored-by: kernel-design-agents <kernel-design-agents@users.noreply.github.com>
2026-10-22 20:38:35 +08:00
Jzz1943 8a6770d566 [Fix] NIXL: Preserve explicit UCX network device selection (#45722) 2026-10-22 20:07:27 +08:00
weireweireandweireweire 96f013b452 [Doc] Cookbook: update GB300 DSV4.1 disagg AgentX launches from InferenceX #4303 (#45495)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-10-22 19:18:55 +08:00
Ankit DhallandAnkit Dhall f727076ed0 [Feat] diffusion: support wan-animate-2 distilled model (#44085)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
2026-10-22 15:37:08 +08:00
Shangming Cai 9569a36561 [Feat] scheduler: Gate --prefill-decode-interval on running batch size (#44001) 2026-10-22 14:30:12 +08:00
Richard Wang ce66b3ab59 [Feat] systemone: serve Kev pointer head decision models (#45413) 2026-10-22 14:16:52 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 12370da115 [Doc] cookbook: Refresh SemiAnalysis AgentX launches with five open InferenceX PRs (#45749)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 14:15:19 +08:00
WenhaoZhangandMick d9ce511646 [Feat] diffusion: support FastH3 Omni (Ref2VA 8-step PDD) (#45530)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-22 13:07:13 +08:00
MickandMick Qian 3472e16f96 [Refactor] diffusion: remove the deprecated kitchen_int8 alias (#45706)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-22 13:06:07 +08:00
zijieandZijie Chen f91b81b82a [Doc] [AMD] cookbook: Add Muse Spark Open MI355X AgentX recipe (#45689)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
2026-10-21 21:12:52 -07:00
Thomas Wang 9ee9858805 [Doc] [AMD] dsv41: Update amd cookbook 1021 (#45693) 2026-10-21 20:33:34 -07:00
WenhaoZhang 1962cbeebe [Perf] diffusion: convrot_int8 comfy_kitchen issues one GEMM per layer by default (#44179) 2026-10-22 11:30:32 +08:00
Viraat ChandraandClaude Opus 5.5 5f62e23d30 [Doc] cookbook: Add Muse Spark Open GB300 Dynamo + SGLang deployments measured with AA AgentPerf (#45629)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 11:24:58 +08:00
MickandMick Qian 780a5b1acc [Doc] diffusion: document prompt enhancer tasks and link Cosmos recipes (#45705)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-22 10:28:58 +08:00
b453996b7d [Doc] diffusion/minimax-h3: Refresh VDN-H3 B200 benchmarks, fix 8-step bench presets and popular-models snippet (#45267)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-22 10:09:13 +08:00
7e5256d1ba [Feat] srt: Balance uvicorn tokenizer workers with per-worker SO_REUSEPORT listeners (#45482)
Co-authored-by: luccafong <116399278+luccafong@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
2026-10-21 11:57:26 -07:00
zijiexia 75878f27c8 [Doc] cookbook: Add Recursive Flint cookbook (#45625) 2026-10-21 08:58:16 -07:00
Shiyang Lyu cdbd478422 [Doc] [NPU] cookbook: add tested A2 deployment and A3 reference for MiniMax-M2.5 (#40120) 2026-10-21 22:59:37 +08:00
Peng Xingchen 7163e97462 [Doc] [NPU] GLM: Add Ascend cookbook deployment recipes (#45597) 2026-10-21 22:44:08 +08:00
8e3e2980db [Feat] [Intel] disaggregation: Support XPU for staging-buffer KV transfer (#40861)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-10-21 22:09:04 +08:00
unclezhou e109bc1832 [Doc] [NPU] deepseek-v4: Add A3/950 single-node cookbook recipes (#45602) 2026-10-21 21:16:49 +08:00
amote-i fda84f80b7 [Doc] [NPU] docs: reference released Qwen3.8-Max W4A8 checkpoint in tutorial (#45574) 2026-10-21 19:38:17 +08:00
bz f 9c10e0dd61 [Doc] [NPU] cookbook: add NPU (A3 series) deployment scenarios for Qwen3.6 (#38678) 2026-10-21 17:37:24 +08:00
Shangming Cai be65391abd [Feat] mooncake: Enable the failed-session probe by default with backoff and idle pruning (#45338) 2026-10-21 17:16:19 +08:00
Peng Xingchenandpengxingchen0810 4449d7ecb0 [Doc] [NPU] GLM: Add GLM-5.3 and GLM-5.3-Flash deployment tutorials (#43372)
Co-authored-by: pengxingchen0810 <pengxingchen0810@noreply.gitcode.com>
2026-10-21 15:02:58 +08:00
Junlin Wu 844d2b5dec [Fix] [NPU] qwen3.5: Fix dense serving on Ascend 950 (#32745) 2026-10-21 09:50:38 +03:00
Shangming Cai 574f9cdb2e [CI] slash-command: Add /run-cpu-ci to run only the CPU unit suite (#45501) 2026-10-21 13:59:16 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 1689cb2d52 [Doc] cookbook: Add GLM-5.3 AgentX section and refresh with eight open InferenceX PRs (#45513)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-21 13:22:38 +08:00
Chunan Zeng 93088901fb [Chore] attention: Remove the tokenspeed_mla backend and dependency (#44803) 2026-10-20 18:50:05 -07:00
c1c287a429 [Doc] cookbook: add TPU7x recipe for GLM-5.3-Flash (#45326)
Co-authored-by: Qinghan Chen <qinghan.chen@radixark.net>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-20 17:10:18 -07:00
Cheng Wan 027208ae02 [Doc] layer-boundary/moe: Correct guides and comments that drifted from the code (#44896) 2026-10-20 16:26:40 -07:00
averyjones4andaveryjones4 c1e43b95f4 [Doc] cookbook: Add DeepReinforce Ornith-1.5 (#45455)
Co-authored-by: averyjones4 <averyjones4@users.noreply.github.com>
2026-10-20 16:08:53 -07:00
7656071309 [Feat] platform: Add initial T-HEAD SAIL platform support [2/N] (#43826)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: yzshi <163985193+Yunzshi310@users.noreply.github.com>
2026-10-20 22:19:07 +08:00
Shuwen Wang 15e8e687db [Chore] environ: Remove retired unified radix tree environment variable (#45090) 2026-10-20 07:02:43 +00:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 9e23107772 [Doc] cookbook: Refresh SemiAnalysis AgentX launches with five open InferenceX PRs (#45311)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 14:48:48 +08:00
lpdinkandZhangheng 4a651146de [Feat] hicache: Notify storage backends when the initial host-pool registration burst completes (#44030)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-10-20 14:09:13 +08:00
Duyi-Wang 50fa3727eb [Doc] [AMD] cookbook: Fix DeepSeek-V4 PD image and c1 capacity (#45297) 2026-10-19 22:45:50 -07:00
Qiaolin Yuandzijiexia 28448a86d4 [Doc] cookbook: Default Qwen3.8-Flash-Next datacenter recipes to FP8 KV cache and QSA indexer (#45245)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-19 15:57:22 -07:00