Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• b5493f65be [NVIDIA] upstream FA4 (#15182) 3 people 2026-01-11 08:31:28 +01:00
• 09e2571e2e Clarify the meaning of cpu_group / entry_rank when dp + tp is enabled. (#16876) Liangsheng Yin 2026-01-11 13:04:43 +08:00
• c0248d6f37 [dpc]: unify DP controller load balancing and simplify dispatch logic (#16258) Ratish P 2026-01-11 10:08:03 +05:30
• cc25f9df50 Update est_time for stage-b-test-small-1-gpu tests (#16835) Alison Shao 2026-01-10 20:03:43 -08:00
• cf14feba4d Fix parallel tool call parsing bug when tool parameters contain arrays (#16345) Leoyzen 2026-01-11 11:31:38 +08:00
• 7c25687c9b fix(gateway): rewrite gauge_histogram.rs for zero-allocation hot path (#16878) Simo Lin 2026-01-10 18:15:21 -08:00
• ff97814232 Tiny fix hicache kernel backend comparison (#16867) Mohammad Miadh Angkad 2026-01-11 10:10:42 +08:00
• d112f6a25b [Feature] Support JIT set kv cache (#16273) DarkSharpness 2026-01-11 09:34:09 +08:00
• a2c2c09d7d [BugFix] fix gpt-oss-120b launch failure with --enable-piecewise-cuda-graph (#16757) Minglei Zhu 2026-01-10 17:19:59 -08:00
• 2a9344d320 [tiny remove] remove torch_compile in parallel_state (#16865) Yuwei An 2026-01-10 16:04:25 -08:00
• 78c41758ad [hot fix ci] Hot fix for the unregistered. (#16877) Liangsheng Yin 2026-01-11 01:24:32 +08:00
• 206db66f5c tiny refactor pcg split op registration (#16863) Qiaolin Yu 2026-01-10 07:45:28 -08:00
• 5c72be1e51 [diffusion] feat: support multiple LoRA adapters loading and application (#16667) 3 people 2026-01-10 23:32:45 +08:00
• 76d4881794 [diffusion] improve: apply tp optim to cross-attn for wan2.2 (#16788) wxy 2026-01-10 21:25:59 +08:00
• d1ec93e3ac Optimize layernorm_gated for Qwen3-Next (#16397) Yuan Luoandluoyuan.luo 2026-01-10 20:55:31 +08:00
• bdb76b34db [diffusion] fix: fix LoRA weight merging when using layerwise offload (#16737) 5 people 2026-01-10 20:17:35 +08:00
• dae6a4092a Tiny add scheduler status logging (#16872) fzyzcjy 2026-01-10 20:12:24 +08:00
• a0899bdbd8 Fix log_decode_stats_every_iteration when having TP in attention (#16871) fzyzcjy 2026-01-10 20:10:23 +08:00
• 641830c1c2 Tiny extract file logging utils (#16870) fzyzcjy 2026-01-10 20:02:37 +08:00
• 3fd88ea9b5 [MTP][spec_v2] Fix TRTLLM MLA backend crash in EAGLE draft_extend mode (#15790) YAMY 2026-01-10 03:58:23 -08:00
• 145bd54f1b Piecewise Cuda Graph Memory Usage (#15927) Yuwei An 2026-01-10 03:29:13 -08:00
• 2d088b85d9 [IDLE FORWARD][Indexer] Fix forward_idle bs mismatch issue in DeepseekV3.2's NSAIndexer (#15227) YAMY 2026-01-10 02:14:30 -08:00
• 3a8b44fe89 Update LoRA Weights via Tensor (#16226) lg(x)andPopSoda2002 2026-01-10 17:36:43 +08:00
• aeb480c11f Add top-p to run_eval.py (#16844) hlu1 2026-01-10 01:10:37 -08:00
• 9fd2358cc2 Update Cutedsl version and pin cuda-python version (#16838) Baizhou Zhang 2026-01-10 17:08:43 +08:00
• 3c358736d1 Enhance test for dp-attention + constrained decoding. (#16849) Liangsheng Yin 2026-01-10 16:49:10 +08:00
• 6327dff242 enhance LoRA tests and fix base model LoRA eviction in Scheduler (#16333) Glen Liu 2026-01-10 03:49:00 -05:00
• 675acecec6 Attention backend selection bug fix for hicache (#16779) Zhiqiang Xieandhxie 2026-01-10 00:22:41 -08:00
• ad20127359 [CI] Remove duplicate code in test_mamba_ut (#16854) Yuan Luoandluoyuan.luo 2026-01-10 16:16:56 +08:00
• 7f393d9512 [Docker] Add nightly dev docker for Cuda 13 (#16862) Baizhou Zhang 2026-01-10 14:56:53 +08:00
• 4b14f622e1 [CI] Add PD Disaggregation aarch64 test (#16572) Shangming Cai 2026-01-10 14:44:54 +08:00
• 94fc26aad8 [Doc]Update note for Cuda 13 container usage (#16805) Baizhou Zhang 2026-01-10 14:03:19 +08:00
• 67b61a4e8d [Rework] Add SwapAB Optimization for triton fused_moe_kernel on SM90. (#16723) Insideyyy 2026-01-10 13:57:44 +08:00
• d27f16f38a Fix EPLB + FP4 Quantization Compatibility Issue (#13715) Shifang XuandShu Wang 2026-01-10 13:38:19 +08:00
• c89949bbaf Tiny let soft watchdog cover initialization phase (#16853) fzyzcjy 2026-01-10 13:20:08 +08:00
• 20abaee26c [DSv32] Overlap indexer weights_proj during dual_stream decode (#16637) Ziang LiandZiang Li 2026-01-09 21:06:44 -08:00
• 32a569fb77 Tiny add CPU resource monitoring for overload diagnosis (#16852) fzyzcjy 2026-01-10 12:48:18 +08:00
• 3ed3b7ef7c Tiny add routing key distribution metrics (#16847) fzyzcjy 2026-01-10 12:06:40 +08:00
• 1f9d4795a9 Tiny add gauge histogram abstraction for engine and router (#16848) fzyzcjy 2026-01-10 11:45:25 +08:00
• e6d40bff81 Revert "feat: reduce constrained-decoding overhead in TP" (#16845) Liangsheng Yin 2026-01-10 11:39:38 +08:00
• fbc128a32e fix(function_call): group batch decode by options instead of fallback (#16698) 若可andMuqi Li 2026-01-10 11:38:13 +08:00
• 9c64a15ad4 feat: add workflow run URL to /rerun-stage comment (#16825) Alison Shao 2026-01-09 18:41:20 -08:00
• e91a717632 [llama] Allow passing tp_rank and tp_size into llama mlp (#16837) Yinghai Lu 2026-01-09 18:32:05 -08:00
• 1f0ea4f958 Add routing key based schedule policy (#16840) fzyzcjy 2026-01-10 10:16:23 +08:00
• 15da3061bc Tiny pass routing key to scheduler processes (#16839) fzyzcjy 2026-01-10 10:13:00 +08:00
• 6406a5969b Tiny support customizing prometheus buckets for prefill delayer (#16831) fzyzcjy 2026-01-10 08:17:37 +08:00
• cec19b56c6 Tiny add command line args for prefill delayer and unify names (#16830) fzyzcjy 2026-01-10 07:54:25 +08:00
• ef35d8fe4e Migrate VLM tests and remove unit-test-backend-1-gpu job (#16679) Alison Shao 2026-01-09 15:24:26 -08:00
• 08636f72b5 [Fix CI] Fix test_mamba_unittest.py (#16810) Yuan Luoandluoyuan.luo 2026-01-10 07:03:47 +08:00
• a6c29d4cbd [AMD CI] Temporarily disable docker caching. (#16783) Sai Enduri 2026-01-09 14:35:49 -08:00
• 84ab32a2a0 Reduce some small cpu overhead in stream fetch (#16587) Yi Zhong 2026-01-09 16:53:06 -05:00
• 7066711529 [ci hot fix] fix global server args init for mamba ut (#16821) Liangsheng Yin 2026-01-10 02:03:32 +08:00
• bd1afeb568 [model-gateway] Restore response streaming by optimizing WASM middleware buffering (#16804) Praneth Paruchuri 2026-01-09 22:59:22 +05:30
• 8ef5b90528 Fix GLM-4.7 MoE Detector complex JSON Schema type parsing (#15753) Leoyzen 2026-01-10 01:21:10 +08:00
• 76b3c698d6 feat: reduce constrained-decoding overhead in TP (#13947) Raayan Dhar 2026-01-09 08:38:32 -08:00
• 5dcff94791 [nemetron/mtp] fix nemotron mtp (#16275) Hanming Lu 2026-01-09 07:22:21 -08:00
• 8eeffbe9aa Support token low usage watermark in prefill delayer (#16814) fzyzcjy 2026-01-09 23:07:18 +08:00
• 71e9c31cb8 Tiny add and enhance tests for prefill delayer (#16813) fzyzcjy 2026-01-09 22:58:38 +08:00
• 7656d26737 Tiny enhance prefill delayer observability (#16812) fzyzcjy 2026-01-09 22:51:16 +08:00
• dd24ba9084 Refactor prefill delayer for clarity and extensibility (#16811) fzyzcjy 2026-01-09 22:46:41 +08:00
• 068abe7e40 add doc for #14386 (#14655) siyu 2026-01-09 22:38:51 +08:00
• 64a31d4b75 [diffusion] amd: fix SGLANG_DIFFUSION_ATTENTION_BACKEND env var for diffusion attention backend selection (#16325) sunxxunsandroot 2026-01-09 04:16:58 -08:00
• 2babf88f24 fix spec qwen3 pd error (#16708) ybyang 2026-01-09 19:20:17 +08:00
• d56d14e566 [Docs] Improve docs for install on gb200 (#16760) Lianmin Zheng 2026-01-09 03:07:13 -08:00
• 0c4e155a3c chore: bump mooncake version to 0.3.8.post1 (#16792) Shangming Cai 2026-01-09 18:42:27 +08:00
• d6d5c3fdea [AMD] Clean up vllm dependencies in moe_runner/triton.py (#11349) Hubert LuandHAI 2026-01-09 00:24:04 -08:00
• e46f79431b Fix external_models import path and migrate model loading tests (#16458) Alison Shao 2026-01-08 23:43:49 -08:00
• 9d4d57dbfa [Diffusion] Tiny rename parallel_groups (#16743) Xiaoyu Zhangandgemini-code-assist[bot] 2026-01-09 15:08:25 +08:00
• 41609b52fe support page size large than 64 for mamba radix cache with fix (#16768) Hanming Lu 2026-01-08 21:28:37 -08:00
• ccd0fb3291 [AMD] Change AITER package name (#16721) YC Tseng 2026-01-09 13:17:20 +08:00
• 87ee6b5eaa Tiny remove auto-triggering for list-active-pr-runs. (#16778) Liangsheng Yin 2026-01-09 13:16:23 +08:00
• f7c1d24b18 List ci workflows status. (#16774) Liangsheng Yin 2026-01-09 13:02:12 +08:00
• cceb5e6aa5 add AWS SGLang DLC to docs (#16686) Sirut Buasai 2026-01-08 20:06:31 -08:00
• c1c13c841a [diffusion] docs: add LoRA support (#16378) Fenglin Yu 2026-01-08 17:31:38 -10:00
• fcec35dc4a [AMD] Add MI35x nightly CI tests (#16588) 4 people 2026-01-08 19:29:15 -08:00
• 75da784d48 Tiny simplify draft worker init. (#16446) Liangsheng Yin 2026-01-09 11:20:29 +08:00
• 77d3566555 Tiny fix wording about CI preemption. (#16773) Liangsheng Yin 2026-01-09 11:08:17 +08:00
• 05dfef92a1 [DeepSeek 3.2] Support and optimize pipeline parallelis when context pipeline enabled (#16380) Yongfei Xuandybyang 2026-01-09 11:01:49 +08:00
• 7460240737 [model-gateway] release 0.3.1 (#16254) Simo Lin 2026-01-08 17:49:37 -08:00
• f7f5c3896d [diffusion] model: wan tp+usp optimize (#16720) 3 people 2026-01-09 10:40:31 +09:00
• 9e3a032ad6 [smg] cleanup router RAII guards (#16560) fzyzcjy 2026-01-09 08:39:53 +08:00
• 1bc7aa5801 [smg] update gRPC proto to match upstream changes (#16764) Simo LinandChang Su 2026-01-08 16:33:09 -08:00
• 8726d30cb2 [smg] Add Nemotron Nano V3 reasoning parser support (#16763) Simo Lin 2026-01-08 16:29:24 -08:00
• a1b243d76f fix: extend cpu only install dependency timeout to 20 mins (#16759) Douglas Yang 2026-01-08 16:08:21 -08:00
• a979927727 Skip causal_conv1d test with padded batches due to Triton kernel bug (#16715) Alison Shao 2026-01-08 15:13:13 -08:00
• ee71e773e1 [smg] Work around sglang's notorious orphan process problem (#16756) Simo Lin 2026-01-08 14:41:03 -08:00
• 55a8dd0095 [grpc] Fix protobuf compilation in isolated build environments (#16754) Simo Lin 2026-01-08 13:09:01 -08:00
• cf24232100 fix(e2e): prevent potential hangs in model pool subprocess handling (#16752) Simo Lin 2026-01-08 12:35:56 -08:00
• 9d03af916a [smg][ci] delete old chat completion integration tests and workflow step (#16751) Simo Lin 2026-01-08 11:31:54 -08:00
• 064ae3419e Adjust the cancel PR workflows for better preemption. (#16749) Liangsheng Yin 2026-01-09 03:25:41 +08:00
• 49305fa1c1 [smg][ci] migrate function calling tests to new infrastructure (#16748) Simo Lin 2026-01-08 11:08:01 -08:00
• 4e999404c3 [AMD] Fix CI - unit-test-backend-1-gpu-amd-mi35x and unit-test-backend-2-gpu-amd, stage-b-test-small-1-gpu-amd (#16675) YC TsengandBingxu Chen 2026-01-09 02:16:27 +08:00
• fbc24886dd [smg][ci] migrate validation tests to new infrastructure (#16746) Simo Lin 2026-01-08 09:26:31 -08:00
• 16880235d1 [grpc] Auto-generate protobuf files during wheel build (#16409) Chang Su 2026-01-08 09:09:54 -08:00
• cda35611d4 [perf] Add two stream norm for Olmo3 speedup 5% (#13681) Yi Zhongandb8zhong 2026-01-08 12:01:35 -05:00
• 8a45a9c6a9 [smg][ci] fix model pool GPU cleanup and add startup reliability improvements (#16745) Simo Lin 2026-01-08 08:55:18 -08:00
• aecd5f5f3e [smg][ci] migrate reasoning_content tests to new infrastructure (#16741) Simo Lin 2026-01-08 08:25:39 -08:00
• 05ab110e02 [Performance] Force split_k=1 for MXFP4 Triton kernels on Hopper (#16014) Mohammad Miadh Angkad 2026-01-08 23:52:22 +08:00
• c8dc4d2d1f [smg][ci] migrate enable_thinking tests to new infrastructure (#16739) Simo Lin 2026-01-08 06:57:45 -08:00
• 82a8d77bc0 [Diffusion] model: fix zimage tp (#16719) cheng pengandgemini-code-assist[bot] 2026-01-08 22:47:21 +08:00