13 Commits
Author SHA1 Message Date
Vedant V JhaveriandCopilot 9fdb71732a Avoid materializing GDN QKV tensors during target verification (#33778)
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-09-21 17:04:18 -07:00
Vedant V JhaveriandCopilot dc10483592 [Kernel] Add H200 MoE configs for Qwen3.5 and Qwen3.6 (#35374)
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-08-27 16:01:22 -07:00
03c1d58112 perf: add H200 Triton MoE configs for E256 N512 (#34150)
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-08-14 14:37:58 -07:00
Vedant V JhaveriandVedant Jhaveri 3be5a7ec89 Respect explicit --max-running-requests instead of clamping to heuristic (#27399)
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
2026-06-12 12:30:47 -07:00
Vedant V Jhaveri 4a9ffc3ab6 fix nemotron capture for non attention layers (#21436) 2026-03-30 12:50:49 -07:00
Vedant V Jhaveri db995fba47 perf(kimi_linear): replace einops rearrange with native torch ops in Kimi-Linear KDA path (#20396) 2026-03-20 10:38:12 +08:00
Vedant V Jhaveri 9b55a98a67 perf(qwen3_5): replace einops rearrange with torch.flatten in GatedDe… (#20386) 2026-03-12 09:51:27 +08:00
Vedant V Jhaveri 25bd83033d Enable Piecewise CUDA Graph for NemotronH Hybrid (Mamba+Attention) Models (#19903) 2026-03-12 09:16:38 +08:00
Vedant V JhaveriandVedant Jhaveri 98b5013d59 add support to enable lora with embedding models (#17780)
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
2026-02-11 23:19:40 +08:00
Vedant V JhaveriandLiangsheng Yin 9dab534b35 fix spec dec request level metrics (#13754)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2025-11-27 01:09:21 +08:00
Vedant V Jhaveri aac07bf7fd [Embeddings Performance Testing] Add performance test for embedding models (#12359) 2025-11-17 15:35:18 -08:00
Vedant V Jhaveri 7e61737d3f [Generative Scores API] add performance tests to CICD (#10830) 2025-10-02 19:57:55 -07:00
2f555c4cee [Generative Score API] Added test_scores_api.py to github CICD to run per commit (#10755)
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Sundara Raman Ramachandran <sundar24295@gmail.com>
2025-09-22 14:41:57 -07:00