Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 16831ab6d7 [diffusion] fix: fix using upstream flash_attn on blackwell (#17111) Mick 2026-01-15 22:30:48 +08:00
• c9a45b7e3c [diffusion] fix: fix UMA detection (#17113) R0CKSTAR 2026-01-15 22:29:46 +08:00
• e7df8bdc5c [diffusion] refactor: move SLA to attention_backend folder (#17020) HuangJi 2026-01-15 21:36:48 +08:00
• e997995037 [diffusion] fix: optimize text encoder CPU offload initialization to address OOM (#17064) LancerandLancer 2026-01-15 21:28:57 +08:00
• 6586f44ad4 [NPU] Add Ascend NPU best practice in doc (#17103) Hexq0210 2026-01-15 15:21:45 +08:00
• 43fe3a4ddf [AMD] Align alternative sgl-kernel wheel (#17092) Alan Kao 2026-01-15 13:26:45 +08:00
• 98096b5e02 [AMD CI] migrate and re-enable CI tests to new CI registry (#16949) Bingxu Chenandyctseng0211 2026-01-15 13:25:25 +08:00
• 68e8d0f68d [diffusion] CI: add testcase for cfg parallel (#17056) Mick 2026-01-15 13:13:31 +08:00
• 000ad42225 chore: bump sgl-kernel version to 0.3.21 (#17075) sglang-botandsglang-bot 2026-01-14 20:41:17 -08:00
• 9d5f16d456 [SWA] fix swa radix cache match_len_since_tombstone update when hits swa_tombstone (#17061) Hanming Lu 2026-01-14 19:28:33 -08:00
• 7f8a58fffb Refactor prefix cache type checking (#17028) Ke Bao 2026-01-15 11:28:13 +08:00
• 6b065298b5 [Docs] add routing-key to schedule-policy in docs (#17101) Glen Liu 2026-01-14 22:22:07 -05:00
• c020d30045 [Model-Gateway: grpc]: create tokenizer with chat template (#17052) jeff.ye 2026-01-15 09:56:08 +08:00
• 4346db5faf [Fix] Remove assertion for padding for NVFP4 weight scales to fix GLM 4.5 NVFP4 (#12497) b8zhong 2026-01-14 16:57:14 -08:00
• 424a380077 [NPU] NPU quantization refactoring & more quantization formats support (#14504) 5 people 2026-01-14 23:25:15 +03:00
• f091858304 [gRPC] Add GetLoads RPC for comprehensive load metrics (#17087) Simo Lin 2026-01-14 12:05:10 -08:00
• 5b1215d9da fix session request with None tokenizer (#16278) Aurick Qiao 2026-01-14 10:41:08 -08:00
• aa2b4f7661 fix: renaming test file and job names + skip blocking llama4 nightly (#16971) Douglas Yang 2026-01-14 09:57:59 -08:00
• b3a3f51320 [API] Add /v1/loads endpoint for load metrics (#16976) Simo Lin 2026-01-14 09:13:20 -08:00
• de94d793ad feat: support qwen3(-VL) rerank scoring&chat template (#16403) shuwennandXinyuan Tong 2026-01-15 00:45:46 +08:00
• 0d904ef44c [diffusion] fix: fix fsdp tp load make param miss parallel meta data (#17058) Xiaoyu Zhang 2026-01-15 00:12:33 +08:00
• 969faaa410 [diffusion] fix: revise fa4 backend to support blackwell (#17077) Yuan Luoandluoyuan.luo 2026-01-14 23:31:46 +08:00
• 48c2aca9ba [Env] centralize pd vars in environ.py (#16264) shuwenn 2026-01-14 23:06:01 +08:00
• 5af84c8af5 [AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392) 4 people 2026-01-14 10:44:40 +01:00
• feae615b11 [VLM] Support ViT CUDA Graph for InternVL (#16732) Yuan Luo 2026-01-14 17:29:23 +08:00
• e75299a111 Fix issues/16714: Revert comment out of tl.debug_barrier() in causal_conv1d_triton (#16899) Netanel HaberandYi Zhang 2026-01-14 11:26:48 +02:00
• 72bacc88c8 [NemotronH] Use ReplicatedLinear for fc1_latent_proj (#16569) roikoren755 2026-01-14 11:08:27 +02:00
• ba625c2d90 Feat/support nemotron h mtp (#17013) shaharmor98 2026-01-14 10:30:35 +02:00
• b025cff441 [AMD] Add AMD CI registration (1-gpu unit test) to nightly CI. (#16941) Michael 2026-01-13 23:41:45 -08:00
• 030496eb06 [diffusion] fix: fix --warmup-resolutions' conflict with CacheDiT (#16962) HuangJi 2026-01-14 14:44:10 +08:00
• c86ca12875 chore: bump sgl-kernel version to 0.3.21 (#16888) sglang-botandsglang-bot 2026-01-13 21:27:49 -08:00
• cd33694585 feat: add --admin-api-key for finer-grained endpoint auth (#15908) shuwennandSimo Lin 2026-01-14 12:21:55 +08:00
• c5e363e8e0 test: split Qwen3 Next tests and disable PCG tests due to intermittent failures (#16989) Alison Shao 2026-01-13 20:18:42 -08:00
• 9479eca75d [CI] Fix max_parallel for scheduled runs (#17046) Alison Shao 2026-01-13 20:16:32 -08:00
• a5348eac4c [diffusion] chore: avoid raising error when output resolution is not optimal (#17030) Mick 2026-01-14 11:36:27 +08:00
• 9524040220 [diffusion] chore: refactor warmup logic (#17027) Mick 2026-01-14 11:35:06 +08:00
• 2122fea3c4 Update deepseekV32 Cp doc (#17054) ybyang 2026-01-14 11:19:26 +08:00
• e2c8a50b38 fix grammar timeout sync across tp ranks. (#16898) Liangsheng Yin 2026-01-14 10:26:31 +08:00
• a4825ed588 Fix kernel type annotations for fp8 quant and logging (#16994) Lianmin Zheng 2026-01-13 18:14:32 -08:00
• afe285f7bd [AMD] enable CUDA graph for NSA backend and fix NSA FP8 fused RMSNorm group quant (#16841) Hubert Luandwufann 2026-01-13 17:36:01 -08:00
• cf25852a1d [model-gateway] add --disable-health-check option to skip worker health probes (#17002) Ziwen Zhao 2026-01-13 17:28:32 -08:00
• 5938c3b06a [model-gateway] HA - Lightweight State Layer + gRPC Mesh (#14108) Tony LuandKun 2026-01-14 09:03:39 +08:00
• b880607108 Add 5090 dry run stage to PR test workflow (#17022) Alison Shao 2026-01-13 14:12:33 -08:00
• 339915ce2b [logprob] Fix logprob + streaming for long concurrent decode by caching already processed logprob (#17005) Byron Hsuandroot 2026-01-13 12:39:14 -08:00
• 075c5a5789 Code clean up for fp8 quantization (#16982) Lianmin Zheng 2026-01-13 12:38:39 -08:00
• a0b4ba9032 [diffusion] model: GLM-Image (#16894) Yuhao Yangandjianyingzhu 2026-01-14 02:02:03 +08:00
• 2a7b67adff [CI/NPU] Fix ascend CI issue (#16953) Junrong Lin 2026-01-13 23:39:12 +08:00
• 1d811094f8 [Misc] Auto download question file for benchmark/mtbench (#17019) elvischenv 2026-01-13 23:34:29 +08:00
• 2ab3ed3e9e Fix sgl-kernel per_token_quant fp8 kernel scale shared_memory bug (#16886) Xiaoyu Zhang 2026-01-13 23:22:05 +08:00
• 250477d2ac [model-gateway] Optimize L1 cache insertion with incremental hashing and tokenization (#16259) 3 people 2026-01-13 19:54:25 +05:30
• af1232b2f2 [model-gateway] fix wasm example (#16924) Praneth Paruchuri 2026-01-13 19:51:47 +05:30
• 7a869045b6 [diffusion] chore: clean excessive document (#16986) Mick 2026-01-13 21:33:50 +08:00
• 888d7e54d1 [diffusion] fix: fix compatibility issue with torch.compile and flash attention v4 (#16790) 3 people 2026-01-13 21:11:19 +08:00
• 3cb1fbaee4 [diffusion] fix: fix Qwen-Image-Edit Lightning LoRA alpha/rank scaling (read per-layer *.alpha) (#16935) qichu-yun 2026-01-13 21:09:11 +08:00
• ba9f6d8f26 [Refactor] Clean up JIT kernel utilites (#16884) 3 people 2026-01-13 17:54:16 +08:00
• 740d3c0b39 [Diffusion] Remove useless dependency in diffusion (#16967) Xiaoyu Zhang 2026-01-13 17:25:53 +08:00
• 8716589826 [AMD][Diffusion] support timestep embedding kernel for AMD GPUs (#16766) Hubert Lu 2026-01-12 22:17:07 -08:00
• ff3ddb9d9b Support min num routing keys in key-based load balancing policy (#16564) fzyzcjy 2026-01-13 13:38:03 +08:00
• 9d3018f484 Support min load besides random routing key assignment policy in ManualPolicy (#16767) fzyzcjy 2026-01-13 10:31:18 +08:00
• a83484275d [diffusion] perf: optimize linear calculation in SLA (#16648) HuangJi 2026-01-13 09:38:35 +08:00
• 47d485f35f [diffusion] fix: fix not respecting dit_layerwise_offload server arg (#16252) Mick 2026-01-13 09:29:07 +08:00
• 2b42309955 [diffusion] UX: provide solutions for OOM (#16940) Mick 2026-01-13 09:25:27 +08:00
• ae0baefb94 [NPU] upgrade npu mf_apater plugin (#15853) James 2026-01-13 09:02:10 +08:00
• 1f0e3d7fd8 Support tracking worker routing key loads in gateway (#16765) fzyzcjy 2026-01-13 08:07:17 +08:00
• d3c08fb07c [layers] support zero-dim rmsnorm (#16978) Yinghai Lu 2026-01-12 15:53:19 -08:00
• c6a64e9f69 [smg] fix type complexity for workflow run_if (#16981) Simo Lin 2026-01-12 15:41:52 -08:00
• e0ac559ae1 feat(workflow): add scheduled/delayed steps and conditional branching (#16980) Simo Lin 2026-01-12 15:06:12 -08:00
• 6620548fd8 [model-gateway] make StateStore trait async for external persistence (#16979) Simo Lin 2026-01-12 12:55:59 -08:00
• 6e158e55b4 [model-gateway] improve workflow engine code quality (#16977) Simo Lin 2026-01-12 12:14:46 -08:00
• ed729d22b3 [model-gateway] refactor workflow engine from type erasure to typed engines (#16973) Simo Lin 2026-01-12 10:47:00 -08:00
• fa51b85466 [model-gateway] convert workflow system to type-safe workflow data (#16970) Simo Lin 2026-01-12 10:06:36 -08:00
• 559ff9ecaf Bug: fixed multi_chain_reasoning test (#16192) Bhavneek Singh 2026-01-13 02:06:41 +09:00
• 7b682de870 [Model] Support IQuest-Coder-40B-Loop (#16348) 4 people 2026-01-12 23:44:45 +08:00
• d0092decb1 [model-gateway] Fix workflow engine race conditions and add graceful shutdown (#16963) Simo Lin 2026-01-12 06:37:39 -08:00
• 76f69b7753 [diffusion] app: add ComfyUI plugin support for SGLang-Diffusion (#15271) 4 people 2026-01-12 21:58:16 +08:00
• 9a628744fc [CI] fix piecewise graph test case on ascend (#16933) khalilzhk 2026-01-12 20:16:30 +08:00
• 53dca74f47 Bugfix: EagleDraftWorker has not attribute "eagle_use_aux_hidden_state" (#16480) chenxu214 2026-01-12 20:14:35 +08:00
• 2dadf63562 [diffusion] Support I2I/TI2I/I2V/TI2V warmup && T2I/T2V warmup bug fix (#16922) 3 people 2026-01-12 19:40:37 +08:00
• aab640c99f add doc for dsv32 cp+pp (#16916) ybyang 2026-01-12 19:14:07 +08:00
• 2b3791ed37 Fix wrong kernel selection for int32/int64 indices (#16912) Liangsheng YinandDarkSharpness 2026-01-12 17:26:57 +08:00
• 9f5cd80a8d Re-introduce the unit test of test_mooncake_ep_small (#16019) Xun Sun 2026-01-12 17:01:24 +08:00
• b1ee75ae7b [AMD] CI - enable test case for amd ci : triton_attention_kernels , torch_compile_moe (#16559) YC Tseng 2026-01-12 16:06:31 +08:00
• f44c63eef7 [diffusion] chore: validate sampling params (#16677) Hu Chongandroot 2026-01-12 16:00:10 +08:00
• c54c70ab62 [model-gateway] Improve Health Check Logging (#16930) Wenyi Xu 2026-01-12 15:01:29 +08:00
• aab906a3d4 [docs] sync diffusion docs to main docs (#16932) Adarsh Shirawalmath 2026-01-12 12:19:55 +05:30
• feb39f7768 [diffusion] model: Support TurboWan2.2-I2V SLA && add CI test for TurboWan (#16536) HuangJi 2026-01-12 13:55:38 +08:00
• 38b30c7b56 Tiny refactor age computation in router (#16850) fzyzcjyandSimo Lin 2026-01-12 13:42:43 +08:00
• c581b5ed79 [NPU] update feature supported on ascend NPU (#16915) Hexq0210 2026-01-12 11:47:58 +08:00
• a1c48943d7 Tiny fix NoAvailableWorkers being a RetryError (#16896) fzyzcjy 2026-01-12 10:53:17 +08:00
• 5b7bed7ca4 Decouple grammar logic out of scheduler. (#16820) Liangsheng Yin 2026-01-12 10:52:42 +08:00
• 38a88479c6 llama model and llama eagle3 model support dp-attn (#15268) chenxu140 2026-01-12 08:54:56 +08:00
• 503c3d9566 [model-gateway]: add qwen coder tool parser support xml format for qwen3 coder and microthinker (#12909) ybyang 2026-01-12 08:09:41 +08:00
• 934ae89abe Tiny fix typo minxin -> mixin (#16908) Liangsheng Yin 2026-01-12 00:36:45 +08:00
• cf1426a7b7 [CI] reapply max-parallel in stage-b-test-small-1-gpu (#16906) Liangsheng Yin 2026-01-11 23:17:38 +08:00
• 17cb3c8e49 Enable /rerun-stage workflow URL lookup for fork PRs (#16851) Alison Shao 2026-01-11 07:05:37 -08:00
• 2f4a6addf3 [cpu/arm64] support run sglang on arm64 cpu (#14867) Yibo Cai 2026-01-11 20:27:19 +08:00
• f9fc50acd6 [Tiny] Rename test_sparse_flash_attn.py to fix CI (#16895) Baizhou Zhang 2026-01-11 18:18:29 +08:00
• 3c16c58619 [model-gateway] Add Redis support as a history backend (#16300) Wenyi Xu 2026-01-11 17:03:00 +08:00
• 7b089ae4e0 [Diffusion] Docs for Diffusers backend (#16864) Adarsh Shirawalmathandgemini-code-assist[bot] 2026-01-11 13:38:26 +05:30
• 8b5d426340 [CI]Move fa4 e2e test to 4-gpu-b200 runner (#16889) Baizhou Zhang 2026-01-11 15:53:38 +08:00