Alex Nails and Claude Opus 5
bfa4e4a57b
[Nemotron] Hoist mamba track-mask host syncs out of the per-layer prefill path ( #32589 )
...
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-03 23:58:28 -07:00
Alex Nails
ec4a7fa2b7
codeowners update ( #32608 )
2026-07-27 21:21:20 -07:00
Alex Nails and Claude Opus 4.8
b83041c3cc
Migrate CompressedTensorsW4A4Nvfp4MoE TRT-LLM path onto MoeRunner ( #32248 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-07-24 20:57:38 -07:00
Alex Nails and Claude Opus 4.7
3d2e7cc601
[gRPC] Native server: launcher + HTTP + server args wiring (3/4) ( #23508 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-07-07 14:57:25 -07:00
Alex Nails and Claude Opus 4.7
b5e4e289b1
[gRPC] Native server: Python bridge entrypoint (2/4) ( #23507 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-06-22 13:08:33 -07:00
Alex Nails and Claude Opus 4.8
533b59d00c
Add @alexnails as codeowner for srt/platforms ( #28066 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-06-12 10:28:58 -07:00
Alex Nails
1d19721394
[gRPC] Native server: Rust crate (1/N) ( #23506 )
2026-05-18 22:31:38 -07:00
Alex Nails
4df42da658
Introduce CudaDeviceMixin and CudaSRTPlatform ( #24096 )
2026-05-15 10:59:02 -07:00
Alex Nails and Claude Opus 4.7
c3ab5bec7d
ci: consolidate rust + protoc install across workflows ( #23700 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-04-29 13:39:02 -07:00
Alex Nails and Claude Opus 4.7
345fecc547
fix(bench): wire request_func in bench_long_context ContextWorkloadGenerator ( #23898 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-04-28 14:45:51 -07:00
Alex Nails and Claude Opus 4.7
579bd0b152
[bug fix] has_fp8_weights_in_checkpoint: handle HF repo IDs, not just local paths ( #23542 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-04-23 12:56:49 -07:00
Alex Nails
332ec5e5ee
[release] install rust toolchain in main dockerfile ( #23014 )
2026-04-20 09:50:08 -07:00
Alex Nails and Claude Opus 4.7
bea4c895c1
[gRPC] Pass --experimental_allow_proto3_optional to protoc in build.rs ( #23226 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-04-20 17:20:14 +08:00
Alex Nails
10e17cc55e
[gRPC] Native gRPC server: proto + Rust crate scaffold + server args ( #22736 )
2026-04-20 12:39:35 +08:00
Alex Nails
43eb66028f
ci: install rust toolchain in ci_install_dependency.sh ( #23017 )
2026-04-16 23:18:22 -07:00
8092431316
[serving] replace O(n²) stream_buffer string concat with integer offset ( #22606 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-04-14 14:48:44 -07:00
Alex Nails and Claude Opus 4.6
c6fd9a00c7
[tokenizer] eliminate O(n²) copy in non-incremental streaming ( #22567 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-11 23:05:36 -07:00
Alex Nails and Claude Opus 4.6
8eac618a8d
[tokenizer] lazy text accumulation + use deltas directly for streaming ( #22548 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-10 21:26:04 -07:00
Alex Nails
0af9166474
[tokenizer] improve non streaming request processing + some small fixes. ( #20310 )
2026-04-10 15:46:12 -07:00
Alex Nails and Claude Opus 4.6
931dbceadc
[CI] Set RUNAI_STREAMER_MEMORY_LIMIT=0 for stage-b-test-1-gpu-small ( #22346 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-08 02:23:35 -07:00
Alex Nails and Claude Opus 4.6
493ec91cbe
[CI] Fix stage-b-test-1-gpu-large (0) timeout by reordering LoRA tests and using tokenizer from cache ( #22292 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-07 20:00:44 -07:00
Alex Nails
912494f596
[CI] Fix lint that was not applied in #21458 ( #21818 )
2026-03-31 23:58:12 -07:00
