 Bruce Changlong XuandKe Bao
|
172bd8e6b9
|
[scheduler] Zero gen_throughput and flush KV events on pause (#24003)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-06-02 16:43:04 +08:00 |
|
Bruce Changlong Xu
|
11411aa49d
|
[tokenizer] Surface scheduler load info (num_running_reqs / num_waiting_reqs) in meta_info (#24000)
|
2026-06-01 11:45:35 +08:00 |
|
Bruce Changlong Xu
|
376635c1e3
|
Fix routed-experts device buffer overflow under DP attention (#26123)
|
2026-05-30 19:11:06 -07:00 |
|
Bruce Changlong Xu
|
7ed53d15f3
|
[config] Recognize custom hybrid SWA models via hf_text_config.is_hybrid_swa (#23988)
|
2026-05-30 23:21:10 +08:00 |
|
Bruce Changlong Xu
|
714bcd84e2
|
[parallel] Support moe_dense_tp_size == attn_tp_size to share the attention TP group (#23996)
|
2026-05-30 02:10:07 -07:00 |
|
Bruce Changlong Xu
|
a5e6a8887a
|
[attention] Fallback to Triton merge_state when FlashInfer hits CUDA thread limit (#23993)
|
2026-05-29 16:30:49 -07:00 |
|
Bruce Changlong Xu
|
d3edfb579b
|
[connector] Add Azure Blob Storage connector (az:// and *.blob.core.windows.net URLs) (#23995)
|
2026-05-11 14:20:22 -07:00 |
|
Bruce Changlong Xu
|
feda2b11c4
|
[AMD] Add AWQ AMD CI coverage and quantization platform compatibility docs (#19550)
|
2026-03-04 19:50:55 -08:00 |
|