|
702bddcee8
|
[Model] Add support for JetBrains' Mellum v2 code generation model (#27375)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Jiminator <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-13 22:54:38 -07:00 |
|
|
Brayden Zhongandroot
|
9756f768a6
|
Refactor FP4 quantization and remove deprecated JIT kernels (#30448)
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
|
2026-07-14 09:22:07 +08:00 |
|
|
|
423b8485fb
|
[Quantization] add humming quantization kernel (#23754)
Co-authored-by: guzekai01 <zekai01@antgroup.com>
Co-authored-by: Julian Huang <huangzhilin.hzl@gmail.com>
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-07-14 08:42:56 +08:00 |
|
|
|
cfe4eefabb
|
[diffusion] model: support LongLive 2.0 T2V and I2V inference (#27639)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-07-13 17:39:30 -07:00 |
|
|
zijiexia
|
50ed4c011f
|
Remove legacy Sphinx docs/ and finish the Mintlify cutover (#28964)
|
2026-07-13 15:06:08 -07:00 |
|
|
Liangsheng Yin
|
e2728ac504
|
[Spec] Remove dead padded_static_len and stale SGLANG_ENABLE_SPEC_V2 references (#30998)
|
2026-07-13 15:30:31 -05:00 |
|
|
sglang-botandsglang-bot
|
805385414e
|
chore: bump docs install version to 0.5.15 (#31058)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-07-13 18:58:48 +00:00 |
|
|
|
11a82af5f8
|
[Platform] Route pin memory availability through current_platform (#28113)
Co-authored-by: N3u0ns <N3u0ns@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-13 11:37:59 -07:00 |
|
|
amote-i
|
be9791071a
|
[NPU] [DOC] Fix Ascend NPU docs issues found by AIDD (#31036)
|
2026-07-13 23:45:35 +08:00 |
|
|
amote-i
|
f391c71758
|
[NPU] [DOC] --pp-size can not be used witgh --tp-size (#31039)
|
2026-07-13 22:35:20 +08:00 |
|
|
xutizhou
|
eb31b5310c
|
Support Waterfill with MegaMoE backend (#27350)
|
2026-07-13 03:56:46 -07:00 |
|
|
amote-i
|
2225817424
|
[NPU] [DOC] Optimize and fix docs issues on Ascend NPU (#30767)
|
2026-07-13 15:35:02 +08:00 |
|
|
loading66
|
79f096d43b
|
[DOCS][NPU]update npu support features and models (#30843)
|
2026-07-11 15:21:29 +08:00 |
|
|
Lucia Fang
|
51c5ddbe65
|
[eplb] chunk expert-weight P2P on CUDA to prevent NCCL rebalance hang (#30829)
|
2026-07-10 21:45:17 -07:00 |
|
|
Chenchen HongandXiaoyu Zhang
|
e3ceccf781
|
[dLLM] Make FDFO a framework capability for all dLLM algorithms (#27551)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-07-11 11:05:05 +08:00 |
|
|
Mick
|
559854fe6a
|
[diffusion] docs: sync cookbook and log hygiene (#30791)
|
2026-07-10 22:55:14 +08:00 |
|
|
YAMY
|
2e4d6368c3
|
[GDN] Auto-select FlashInfer GDN prefill on validated SM100 configs (#29734)
|
2026-07-10 00:26:00 +08:00 |
|
|
|
7aab39a18b
|
[Diffusion] SGLang backend for GLM Image AR. Step 1 - Separate server (#25381)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: yuefeng Wu <33725817+ChefWu551@users.noreply.github.com>
Co-authored-by: wuyuefeng <wuyuefeng@noreply.gitcode.com>
|
2026-07-09 15:54:50 +03:00 |
|
|
amote-i
|
4153410477
|
[NPU] [DOC] remove unsupported models from Ascend NPU models list (#30647)
|
2026-07-09 20:01:00 +08:00 |
|
|
Mohammad Miadh Angkad
|
666a09fe2a
|
Disable multi-threaded load by default when prefetch is on (#30146)
|
2026-07-09 00:28:53 -07:00 |
|
|
amote-i
|
69ddbf9ef6
|
[NPU] [DOC] fix model name error on Ascend NPU (#30577)
|
2026-07-09 11:28:29 +08:00 |
|
|
amote-i
|
042228a195
|
[NPU] [DOC] Remove unsupported options of features on Ascend NPU (#30504)
|
2026-07-08 17:35:06 +08:00 |
|
|
zijiexia
|
0bf7ddb481
|
docs(install): add nightly install + docker tag guidance, and auto-bump version on release tag (#30308)
|
2026-07-07 12:10:05 -07:00 |
|
|
amote-i
|
cfd3fdc54f
|
[NPU] [DOC] Update features and mainstream models on ascend npu (#30370)
|
2026-07-07 19:03:43 +08:00 |
|
|
qinsir5522
|
5e9032c527
|
[NPU]Modify LoRA heading in ascend_npu_support_features.mdx to specify Qwen model limitations. (#30358)
|
2026-07-07 16:01:51 +08:00 |
|
|
ZeyuanChen2000
|
2d9f0b3317
|
[NPU] [DOC] Update arguments detail to NPU support features page (#30328)
|
2026-07-07 14:09:46 +08:00 |
|
|
loading66
|
998acf7df8
|
[DOCS][NPU]update npu support features (#30324)
|
2026-07-07 11:37:19 +08:00 |
|
|
|
3a679459e5
|
[bench] Add agentic-trace multi-turn dataset to bench_serving (#29215)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-06 19:45:44 -07:00 |
|
|
Junlin Wuandronnie_zheng
|
3abdbab9bb
|
✨ [llm][npu][quant] Add W4A8 MXFP quantization support for Qwen3 Dense on Ascend NPU (#23650)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-07-06 19:23:26 +03:00 |
|
|
Baizhou Zhang
|
5eb1b6a7ba
|
Remove retired DSA env paths (#29912)
|
2026-07-05 22:58:02 -07:00 |
|
|
|
addffd7489
|
[Diffusion] Diffusion model support log-requests (#23049)
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-07-05 12:01:26 +03:00 |
|
|
Cao E
|
9df16b5ba9
|
[XPU] Remove redundant xpu graph backend and make xpu graph opt-in by default (#29911)
|
2026-07-03 15:58:56 +08:00 |
|
|
amote-i
|
2fe7182e75
|
[DOC] [NPU] update supported features on ascend npu (#30011)
|
2026-07-03 15:36:41 +08:00 |
|
|
ming_wang
|
d8a4f7a7aa
|
add mimo-v2-flash model tutorial (#29932)
|
2026-07-03 11:02:24 +08:00 |
|
|
Peng Xingchen
|
a6bc7fef90
|
glm5.2 on ascend doc (new version) (#29828)
|
2026-07-03 10:19:44 +08:00 |
|
|
amote-i
|
70a813493f
|
[NPU] [DOC] add missing DEEP_NORMAL_MODE_USE_INT8_QUANT for w8a8+deepep scenarios (#29937)
|
2026-07-03 10:18:22 +08:00 |
|
|
Cao E
|
926140d789
|
[XPU] Enable XPU graph support (decode full-graph + prefill tc_piecewise) (#29053)
|
2026-07-02 13:24:35 +08:00 |
|
|
Zaili Wang
|
cb06c4e6ce
|
[CPU] Fix model failures on Xeon (#29497)
|
2026-07-02 13:20:18 +08:00 |
|
|
Cheng Wanandlch1475369
|
4a8e76805c
|
feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678)
Co-authored-by: lch1475369 <lch1475369@gmail.com>
|
2026-07-01 13:21:59 -07:00 |
|
|
qinsir5522
|
a7390b17f8
|
[NPU]Modify --lora-backend & --moe-runner-backend description. (#29793)
|
2026-07-01 11:15:46 +08:00 |
|
|
|
97fc4dfd73
|
[Doc]Checking and modifying Markdown formatting issues and link validity (#28586)
Signed-off-by: a60124901 <anyuxin4@h-partners.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-30 20:27:38 +03:00 |
|
|
Trevor Morris
|
b8c25bfaa7
|
[NVIDIA] Support flashinfer a2a with flashinfer_trtllm_routed moe (#22394)
|
2026-06-29 16:23:58 -07:00 |
|
|
Cheng Wanandlch1475369
|
fc96edd297
|
feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533)
Co-authored-by: lch1475369 <lch1475369@gmail.com>
|
2026-06-29 14:49:54 -07:00 |
|
|
zijiexiaandClaude Opus 4.8
|
11b7ed7c9e
|
[Docs] Add --prerelease=allow so uv installs the latest sglang (#29676)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-29 14:13:34 -07:00 |
|
|
Jyothirmai KottuandXinyuan Tong
|
473a278dd1
|
model: support nvidia/LocateAnything-3B (#28958)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-06-30 00:16:42 +08:00 |
|
|
amote-i
|
489017b3d6
|
[NPU] [DOC] Update deterministic inference feature support status to A2, A3 (#29632)
|
2026-06-29 19:17:06 +08:00 |
|
|
danielafrimiandDaniel Afrimi
|
a2b5ce2ed1
|
Add stochastic rounding for FP16 Mamba SSM cache (#26929)
Signed-off-by: Daniel Afrimi <dafrimi@login-lyris01.lyris.clusters.nvidia.com>
Co-authored-by: Daniel Afrimi <dafrimi@login-lyris01.lyris.clusters.nvidia.com>
|
2026-06-29 01:47:09 -07:00 |
|
|
jianzhao-xu
|
2260e612f6
|
[NPU] update best practicce docs from testcase (#29492)
|
2026-06-29 11:30:27 +08:00 |
|
|
Liangsheng Yin
|
909123ddb8
|
[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591)
|
2026-06-28 18:38:28 -07:00 |
|
|
|
b030b1a5f3
|
hisparse: support NIXL DRAM KV destinations for HiSparse (#27563)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-27 22:32:29 +08:00 |
|