Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 0500fea965 fix editable install (#16241) ishandhanani 2025-12-31 14:34:54 -08:00
• 2b461c15b4 Update logprob_start_len handling in scheduler (#16240) Cheng Wan 2025-12-31 14:11:24 -08:00
• 5595ae142c docs: fix markdown preview (#16236) Yineng Zhang 2025-12-31 10:43:57 -10:00
• ace6f3005f ci(benchmark): disable sccache summary annotations and fix tree output (#16233) Simo Lin 2025-12-31 11:05:21 -08:00
• 2da49eec50 Fix XEON docker release workflow (#16107) Kangyan-Zhou 2025-12-31 09:47:01 -08:00
• d65ae0ec7a Use a different concurrency group for release branch testing (#16202) Kangyan-Zhou 2025-12-31 09:46:43 -08:00
• 60d7279c46 test(tree): add comprehensive unit tests and fix input_char_count bug (#16228) Simo Lin 2025-12-31 07:31:39 -08:00
• abdf65d4f3 Fix OOM by offloading multimodal features to CPU after embedding (#16018) siyu 2025-12-31 23:02:34 +08:00
• c1dfbc777b deprecate prefill-round-robin-balance (#16195) Huaixin ChangandLiangsheng Yin 2025-12-31 22:25:33 +08:00
• 3b3c5a05c1 [CI/NPU] fix multiple NPU CI issue (#16111) Even Zhou 2025-12-31 21:14:04 +08:00
• 2667c857a7 Fix DeepSeekV31's structural tag trigger (#13394) Muqi Li 2025-12-31 21:13:52 +08:00
• fc643ffbc9 Download missing shards in model weights files when not in CI (#16211) Kangyan-Zhou 2025-12-31 04:42:34 -08:00
• 4280a18a13 [diffusion] CI: add test for cache-dit (#16204) Yuhao YangandMick 2025-12-31 19:58:10 +08:00
• 386e541520 Update document for Ascend NPU (#16214) Hexq0210 2025-12-31 19:03:53 +08:00
• b6267de5ae Upgrade python version in lint ci (#16221) Ke Bao 2025-12-31 18:22:53 +08:00
• e47afa0237 [DP]Fix sync bubble in adjust_num_token_non_padded_for_attn_tp (#16178) Baizhou Zhang 2025-12-31 17:58:18 +08:00
• 5ed384d07b [CI/CD] re-enable lora test (#16187) Ethan (Yusheng) Su 2025-12-31 00:32:20 -08:00
• b4ce7a6d71 [model-gateway] cache_aware eliminate String allocations in hot path (#16209) Simo Lin 2025-12-31 00:26:10 -08:00
• 25b48564c3 [NPU][Bugfix] fix Qwen3-VL-30B-A3B-Instruct accuracy loss (#15597) cen121212 2025-12-31 15:57:38 +08:00
• 1c360bf753 [AMD CI] add testcases to unit-test-backend-1-gpu (#16117) Bingxu Chen 2025-12-31 15:08:45 +08:00
• 3619ec61b4 [diffusion] feat: support multi-frame image output (#15878) chhnbandgemini-code-assist[bot] 2025-12-31 13:50:02 +08:00
• db6b51a838 Add CI_PERMISSION sort hook. (#16200) Liangsheng Yin 2025-12-31 12:15:15 +08:00
• 8a9ca41fda Move log_prefill_stats_late to correct location in PP mode (#15946) Hudson Xing 2025-12-31 12:00:24 +08:00
• ac11e6a7c5 Add alphabetc1 into CI_PERMISSION (#16198) shuwenn 2025-12-31 11:31:47 +08:00
• 47a660d5b9 [NemotronH] PP support (#16172) roikoren755 2025-12-31 05:16:15 +02:00
• c0fc7a89e7 [sgl-kernel] fix: make sgl-kernel build respect MAX_JOBS (#15575) shuwenn 2025-12-31 10:44:45 +08:00
• 5bf0d862dd [diffusion] CI: fix generate mode and add cli test (#16174) Mickandgemini-code-assist[bot] 2025-12-31 09:51:48 +08:00
• 75b72eb8b2 [cp] assert dsv3.2 cp in pd decode mode (#16156) liupeng374 2025-12-31 09:24:46 +08:00
• bc8b526eda Fix: Handle empty func_name and None values in GLM MoE detectors (#15754) 3 people 2025-12-31 06:32:35 +08:00
• 3dfff6ae3c Eagle: GPT-OSS Eagle v2 support (#14920) Izzy Putterman 2025-12-30 14:23:07 -08:00
• ad2c1ee352 doc: mooncake store add dummy client support (#16050) EkiRui 2025-12-31 04:37:57 +08:00
• 9940c6f592 [model-gateway]: ASCII byte comparison and probabilistic timestamp updates (#16181) Simo Lin 2025-12-30 12:28:01 -08:00
• 00e607111a [Auto Sync] Update request_metrics_exporter.py (20251230) (#16183) 3 people 2025-12-30 09:09:41 -10:00
• 4bc2f2e0bc [model-gateway][docs] Add Classification API documentation (#16182) Simo LinandChang Su 2025-12-30 10:53:31 -08:00
• d17b9e6392 Fusing RMSNormTP in minimax_m2 (#14416) Roger Youngandxuebi 2025-12-31 02:22:07 +08:00
• ba67e006a7 Refactor speculative algorithm registry. (#16168) Liangsheng Yin 2025-12-31 01:24:22 +08:00
• 45f3ad2f52 [Refactor] Rename CustomOp -> MultiPlatformOp (#16175) DarkSharpness 2025-12-31 01:16:32 +08:00
• f35b5da521 [CI] Append test variant name to markdown report header in nightly test (#16166) Baizhou Zhang 2025-12-31 00:09:24 +08:00
• 733a0c1a37 [Diffusion] Zimage opt with qknorm and flashinfer rope (#16161) Xiaoyu Zhangandgemini-code-assist[bot] 2025-12-30 23:39:32 +08:00
• b369aaa23f [Diffusion] Refine diffusion profling doc (#16163) Xiaoyu Zhangandgithub-actions[bot] 2025-12-30 23:38:46 +08:00
• b973202526 Split tp model worker init (#16165) Ke Bao 2025-12-30 23:36:03 +08:00
• cbff7ad985 dp-attention: add follow_bootstrap_room + auto load-balance; drop decode_round_robin (#16110) Mufeez Amjad 2025-12-30 09:33:06 -05:00
• 4de59d83a1 Reduce stages of pr-test from 4 to 3. (#16173) Liangsheng Yin 2025-12-30 22:21:48 +08:00
• 39ca57cd28 [diffusion] chore: tiny fix model config (#16159) Yuhao YangandMick 2025-12-30 22:11:38 +08:00
• 3449806727 [diffusion] feat: generalize layer-wise-offload to all supported models (#16150) Mick 2025-12-30 22:06:57 +08:00
• b3817fa93b Split model_worker init function (#16160) Ke Bao 2025-12-30 21:39:11 +08:00
• 059428bd8a Tiny remove additional args in init_memory_pool (#16158) Ke Bao 2025-12-30 21:38:06 +08:00
• 5d200dd8d9 [diffusion] bench: distinguish between video generation and image generation in the bench_serving (#16149) jiapingW 2025-12-30 21:29:18 +08:00
• 7f9a3d0609 [docs][NPU]Update model and feature docs support (#16124) husf 2025-12-30 20:05:40 +08:00
• 664f611e83 Add profiling capture support to the encoder server (#15730) Jumiarandliusy58 2025-12-30 19:56:25 +08:00
• 49adb37e37 [diffusion] chore: fix ZMQ binding and model loading for FastWan compatibility (#13978) 4 people 2025-12-30 02:09:38 -08:00
• 7518dc3532 feat(SpecEagleV2): add standalone_worker_v2 (#12625) Gaoji Liuandliugaoji.lgj 2025-12-30 17:55:04 +08:00
• b6871ba7c9 [CI] set max-parallel to 4 by default. (#16154) Liangsheng Yin 2025-12-30 17:27:48 +08:00
• 98225be6e5 [CI] Fixing release with cut branch workflow (#16153) Baizhou ZhangandKangyan Zhou 2025-12-30 17:18:02 +08:00
• 94bcc19bce [VLM] Support Video for InternVL3_5 (#15942) Yuan Luoandluoyuan.luo 2025-12-30 17:07:49 +08:00
• db3821a9ef [PP] Add a minimum chunk value for PP dynamic chunking (#16140) Shangming Cai 2025-12-30 16:35:39 +08:00
• 8c5d91b884 Fix race condition in /tag-and-rerun-ci command (#16142) Alison Shao 2025-12-29 23:55:49 -08:00
• 6a3e709253 Tiny rename test_deepseek_v3_fp4_mtp_stage_b.py (#16141) Qiaolin Yu 2025-12-29 23:55:07 -08:00
• c2601f0d21 Fix wrong assigning extend_input_len_per_req with eagle. (#16129) Liangsheng Yin 2025-12-30 15:51:53 +08:00
• 1048803c1f Reworked fast_pos_embed_interpolate() using torch (#10959) Vitaly Tuzov 2025-12-30 09:45:34 +03:00
• 8a84b1e7e0 [diffusion] model: support TurboWan2.1-T2V-1.3B/14B SLA (#15888) HuangJi 2025-12-30 14:30:22 +08:00
• 5e20e7a60d [AMD CI] Organize AMD nightly perf test files (#16114) Bingxu Chen 2025-12-30 14:09:46 +08:00
• 3946dad6fa Add attack204 into CI_PERMISSION (#16131) Liangsheng Yin 2025-12-30 13:55:00 +08:00
• ac03ec0851 Add PR review process into template. (#16133) Liangsheng Yin 2025-12-30 13:45:56 +08:00
• 9416464682 Fix Qwen Next GDN w/ Radix Cache (#16053) Stefan He 2025-12-29 21:06:06 -08:00
• 5fb734f1a5 Enhance comments in set_extend_input_len method (#16130) Cheng Wan 2025-12-29 20:47:33 -08:00
• 60f1ca6925 Refactor: Moving extend_logprob_start_len calculation out of prepare_for_extend (#16105) Cheng Wan 2025-12-29 20:38:33 -08:00
• 9e263c2162 [LoRA] Torch native backend: rework implementation and updated tests (#15187) Vladimir Serov 2025-12-30 06:48:51 +03:00
• 0d003e34b0 Reduce CI failure monitor to run once every 12 hours (#16123) Kangyan-Zhou 2025-12-29 19:44:25 -08:00
• f253f43c9d [diffusion] CI: fix LoRA downloading issues and respect offline flag (#15813) Prozac614 2025-12-30 11:39:27 +08:00
• 1e45320198 [diffusion] improve: tiny improve layerwise offload manager by consolidating weights per layer (#16081) Mick 2025-12-30 11:31:00 +08:00
• 26e17f9076 [diffusion] improve: tiny speedup qwen-image-edit-2511 by avoiding unnecessary calculation (#15896) Mick 2025-12-30 10:10:32 +08:00
• 3de23274ee Clean up swa handling in fa3 backend (#15877) Ke Bao 2025-12-30 08:51:40 +08:00
• f4ec6f8e17 ci: migrate remaining spec/eagle tests to test/registered/spec/ (#15800) Alison Shao 2025-12-29 14:00:00 -08:00
• 9c4eb46099 Add a new branch cut GH workflow, and adopt setuptools-scm for version control (#15985) Kangyan-Zhou 2025-12-29 13:51:21 -08:00
• c2e0913e17 Fix extend_input_len calculation in decode.py (#16103) Cheng Wan 2025-12-29 13:13:24 -08:00
• 8c6f865afb [model-gateway]: optimize prefix_match with zero-copy tenant and deferred char count (#16099) Simo Lin 2025-12-29 11:32:57 -08:00
• 269aa27bff Enable testing slash command handler changes on non-fork PRs (#15921) Alison Shao 2025-12-29 11:30:39 -08:00
• f39382c6ca [model-gateway] Fix duplicate classify prefix in response ID (#16101) Simo LinandChang Su 2025-12-29 11:07:21 -08:00
• 2ff289e2dc [model-gateway] Generate UUID-based request IDs for embedding/classify (#16100) Simo LinandChang Su 2025-12-29 10:49:58 -08:00
• b2a3f0551a [model-gateway] Wire classify pipeline to gRPC router (#16098) Simo LinandChang Su 2025-12-29 10:44:45 -08:00
• 684e148e38 [model-gateway] Optimize INSERT with leaf-only timestamp updates (#16097) Simo Lin 2025-12-29 10:43:20 -08:00
• f44c4b3715 [model-gateway] Add classify pipeline stages and protocol types (#16094) Simo LinandChang Su 2025-12-29 10:23:36 -08:00
• 7380ec9d55 [CI] fix test_mla_deepseek_v3.py (#16096) shuwenn 2025-12-30 02:18:02 +08:00
• ac78f96ec5 [model-gateway] Optimize radix tree timestamp updates for multi-tenant scaling (#16093) Simo Lin 2025-12-29 10:08:19 -08:00
• 278012caa0 [Feature] support bench jsonl files with sharegpt format (#15057) jiapingWandXinyuan Tong 2025-12-30 02:06:11 +08:00
• 7f5879985c [model-gateway] Improve tree benchmark with realistic multi-tenant scenarios (#14838) Simo Lin 2025-12-29 08:37:24 -08:00
• 162d1cf9be [model-gateway] Add classification model support infrastructure (#16061) Simo LinandChang Su 2025-12-29 08:34:05 -08:00
• 8e08207c18 [diffusion] fix: fix serving with dit-layerwise-offload enabled (#16066) MickandXiaoyu Zhang 2025-12-30 00:21:42 +08:00
• c31f62722c [model-gateway] fix tokenizer to match transformers special token handling (#16087) Simo Lin 2025-12-29 08:13:03 -08:00
• b5d9fc873b [diffusion] chore: minor refactor by streamlining the VAE class hierarchy (#16069) Mick 2025-12-29 23:37:59 +08:00
• 88f3de2514 [JIT kernel] Jit kernel add codeowners (#16085) Xiaoyu Zhang 2025-12-29 22:32:55 +08:00
• 24616c5234 [Diffusion] Qwen image edit support qknorm optimization (#16062) Xiaoyu Zhang 2025-12-29 21:37:24 +08:00
• d48723b77d Clamp logprob tokens with model vocab size (#14414) cklxx 2025-12-29 20:37:07 +08:00
• f3d73b0199 [Diffusion] Refactor qwen_image's rope in a single helper func (#16047) Xiaoyu Zhang 2025-12-29 17:24:26 +08:00
• 4ab66d956f [HiCache] Fix deadlock when creating new group (#15805) Xuchun Shang 2025-12-29 17:13:04 +08:00
• de2799f3f5 [docs] Fix non-clickable ToC links in model gateway documentation (#16054) Simo Lin 2025-12-28 23:35:37 -08:00
• f784cbfa92 Update model and feature support for Ascend NPU (#16003) Hexq0210 2025-12-29 15:16:25 +08:00
• 097330909f [model-gateway] update WorkerRegistryStats with connection mode and circuit breaker info (#16046) Simo Lin 2025-12-28 23:14:57 -08:00
• a44d0079f8 [ci] update genai bench to 0.0.3 for pd testing (#16051) Simo Lin 2025-12-28 23:14:44 -08:00