 Ratish P
|
5e7bf73757
|
Fix bench_serving non-stream reasoning content (#25298)
|
2026-05-20 18:41:46 +00:00 |
|
|
Ratish P
|
fab097d66d
|
[Gemma4]: Fix FP8 Triton scale layout (#25286)
|
2026-05-19 14:00:23 -07:00 |
|
|
Ratish P
|
dbac464726
|
[Spec]: Make Triton standalone spec test deterministic (#25303)
|
2026-05-18 17:36:10 -07:00 |
|
|
Ratish P
|
8227187d47
|
[SKILL]: add component accuracy guidance to the diffusion add-model skill (#22460)
|
2026-04-10 23:08:31 +08:00 |
|
|
Ratish P
|
cf5ad12612
|
[diffusion][CI]: route multimodal component accuracy through run_suite (#21960)
|
2026-04-10 23:06:03 +08:00 |
|
|
Ratish P
|
7f2fcc0b08
|
[VLM]: allow Qwen3.5 models for encoder disaggregation (#21849)
|
2026-04-07 02:07:24 +08:00 |
|
|
Ratish PandXiaoyu Zhang
|
4f5b55e379
|
[diffusion][CI]: Add individual component accuracy CI for diffusion models (#18709)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-04-01 21:51:36 +08:00 |
|
|
Ratish PandXiaoyu Zhang
|
2b1d3c935e
|
[diffusion] fix Z-Image SP sharding for portrait and padded resolutions (#21042)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-03-24 10:15:33 +08:00 |
|
|
Ratish P
|
e3277b3be2
|
[diffusion]: remove stale offload-manager in LTX2 AV denoising (#20624)
|
2026-03-17 15:14:00 +08:00 |
|
|
Ratish P
|
574aa2d723
|
[diffusion]: remove stale offload-manager cleanup in denoising stage (#20587)
|
2026-03-14 22:56:57 +08:00 |
|
|
Ratish P
|
4e5ca92249
|
[diffusion]: clear file-path-only outputs on all ranks to prevent TP GPU memory skew (#20353)
|
2026-03-12 17:29:09 +08:00 |
|
|
Ratish P
|
ab9de886c5
|
[diffusion] reduce LayerwiseOffloadManager reserved GPU memory (#20042)
|
2026-03-08 19:26:17 +08:00 |
|
|
Ratish P
|
ef6540b439
|
[diffusion]: add width/height passthrough for OpenAI image API (#19970)
|
2026-03-07 20:43:46 +08:00 |
|
|
Ratish P
|
e6e02ec938
|
[diffusion]: Add model detectors and warning for quantized diffusion models (#18041)
|
2026-03-03 09:46:25 +08:00 |
|
|
Ratish PandLiangsheng Yin
|
ae6f6e1495
|
[Refactor] Benchmark: Add typed DatasetArgs/Loader registry and CPU dataset unit tests (#19147)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2026-02-24 12:22:01 -08:00 |
|
|
Ratish P
|
02a646ba4e
|
[CI]: add CI permission (#19214)
|
2026-02-23 20:37:55 -08:00 |
|
|
Ratish PandXiaoyu Zhang
|
0e670c36d6
|
fix(diffusion): enforce strict input_reference validation for T2V (#14825)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-02-23 12:04:06 +08:00 |
|
|
Ratish PandXuchun Shang
|
f158869c2c
|
[Refactor] Benchmark Phase 1: extract utils and datasets from bench_serving (#19077)
Co-authored-by: Xuchun Shang <107600043+xucsh@users.noreply.github.com>
|
2026-02-21 13:50:11 -08:00 |
|
|
Ratish PandLiangsheng Yin
|
9a7d6be567
|
cleanup prefill metrics logging to fix dp-attn metrics (#18778)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2026-02-17 14:35:35 -08:00 |
|
|
Ratish Pandronnie_zheng
|
f6cc02489f
|
[diffusion]: fix sparse video gen 2 backend being applied to cross-attention (#18900)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-02-17 13:17:46 +03:00 |
|
|
Ratish PandXiaoyu Zhang
|
50ca24aebb
|
[diffusion]: fix scheduler crash on ZMQ messages with unexpected frame counts (#17890)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-02-17 09:45:05 +08:00 |
|
|
Ratish P
|
c1d1337afc
|
[diffusion][Wan]: fix sparse attention backends being applied to cross-attention (#17596)
|
2026-02-16 21:57:58 +08:00 |
|
|
Ratish P
|
ddfe147377
|
[diffusion]: Improve layerwise offload buffer reuse and shared-storage handling (#18611)
|
2026-02-15 22:17:51 +08:00 |
|
|
Ratish P
|
274bf6607a
|
[diffusion] fix: enable torch.compile for UlyssesAttention (#18840)
|
2026-02-15 15:54:27 +08:00 |
|
|
Ratish P
|
88fb927cc9
|
[diffusion]: add dummy device attribute to fix AttributeError (#17949)
|
2026-01-29 09:35:12 -08:00 |
|
|
Ratish P
|
c560e14216
|
[diffusion] fix: enforce 16-pixel alignment for flux2 to prevent shape mismatch crash (#17302)
|
2026-01-20 12:03:33 +08:00 |
|
|
Ratish P
|
c81bad1bf7
|
[diffusion] feat: add cloud storage support for API (#14579)
|
2026-01-16 10:29:38 +08:00 |
|
|
Ratish P
|
c0248d6f37
|
[dpc]: unify DP controller load balancing and simplify dispatch logic (#16258)
|
2026-01-11 12:38:03 +08:00 |
|
|
Ratish P
|
f02d82211a
|
[model-gateway]: move PD configuration conflict checks to model gateway (#16088)
|
2026-01-05 14:16:07 +08:00 |
|
|
Ratish P
|
2af955e16c
|
[model-gateway]: remove unnecessary comment (#15947)
|
2025-12-27 13:33:02 -05:00 |
|
|
Ratish P
|
ca740a41f3
|
[model-gateway]: fix grpc embedding test (#15934)
|
2025-12-27 05:56:54 -05:00 |
|
|
Ratish P
|
886e038329
|
[model-gateway]: fix crash in embedding worker health check (#15910)
|
2025-12-26 12:57:13 -08:00 |
|
|
ratish
|
5f3a47d8a7
|
[model-gateway]: add gRPC router embeddings endpoint implementation (#15273)
|
2025-12-23 09:12:22 -08:00 |
|
|
ratish
|
3d484be547
|
fix(attention): Prevent trtllm_mha auto-selection with eagle3 speculative decoding (#15127)
|
2025-12-15 16:42:26 +00:00 |
|
|
ratish
|
0e4108ba29
|
feat(gateway): Add server-side TLS support (#15052)
|
2025-12-14 15:37:55 -08:00 |
|