Alex Nails and Claude Opus 4.7
c3ab5bec7d
ci: consolidate rust + protoc install across workflows ( #23700 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-04-29 13:39:02 -07:00
Alex Nails and Claude Opus 4.7
345fecc547
fix(bench): wire request_func in bench_long_context ContextWorkloadGenerator ( #23898 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-04-28 14:45:51 -07:00
Alex Nails and Claude Opus 4.7
579bd0b152
[bug fix] has_fp8_weights_in_checkpoint: handle HF repo IDs, not just local paths ( #23542 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-04-23 12:56:49 -07:00
Alex Nails
332ec5e5ee
[release] install rust toolchain in main dockerfile ( #23014 )
2026-04-20 09:50:08 -07:00
Alex Nails and Claude Opus 4.7
bea4c895c1
[gRPC] Pass --experimental_allow_proto3_optional to protoc in build.rs ( #23226 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
2026-04-20 17:20:14 +08:00
Alex Nails
10e17cc55e
[gRPC] Native gRPC server: proto + Rust crate scaffold + server args ( #22736 )
2026-04-20 12:39:35 +08:00
Alex Nails
43eb66028f
ci: install rust toolchain in ci_install_dependency.sh ( #23017 )
2026-04-16 23:18:22 -07:00
8092431316
[serving] replace O(n²) stream_buffer string concat with integer offset ( #22606 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-04-14 14:48:44 -07:00
Alex Nails and Claude Opus 4.6
c6fd9a00c7
[tokenizer] eliminate O(n²) copy in non-incremental streaming ( #22567 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-11 23:05:36 -07:00
Alex Nails and Claude Opus 4.6
8eac618a8d
[tokenizer] lazy text accumulation + use deltas directly for streaming ( #22548 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-10 21:26:04 -07:00
Alex Nails
0af9166474
[tokenizer] improve non streaming request processing + some small fixes. ( #20310 )
2026-04-10 15:46:12 -07:00
Alex Nails and Claude Opus 4.6
931dbceadc
[CI] Set RUNAI_STREAMER_MEMORY_LIMIT=0 for stage-b-test-1-gpu-small ( #22346 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-08 02:23:35 -07:00
Alex Nails and Claude Opus 4.6
493ec91cbe
[CI] Fix stage-b-test-1-gpu-large (0) timeout by reordering LoRA tests and using tokenizer from cache ( #22292 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-07 20:00:44 -07:00
Alex Nails
912494f596
[CI] Fix lint that was not applied in #21458 ( #21818 )
2026-03-31 23:58:12 -07:00
