Commit Graph
12 Commits
Author SHA1 Message Date
Alex NailsandClaude Opus 4.7 579bd0b152 [bug fix] has_fp8_weights_in_checkpoint: handle HF repo IDs, not just local paths (#23542)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-23 12:56:49 -07:00
Alex Nails 332ec5e5ee [release] install rust toolchain in main dockerfile (#23014) 2026-04-20 09:50:08 -07:00
Alex NailsandClaude Opus 4.7 bea4c895c1 [gRPC] Pass --experimental_allow_proto3_optional to protoc in build.rs (#23226)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-20 17:20:14 +08:00
Alex Nails 10e17cc55e [gRPC] Native gRPC server: proto + Rust crate scaffold + server args (#22736) 2026-04-20 12:39:35 +08:00
Alex Nails 43eb66028f ci: install rust toolchain in ci_install_dependency.sh (#23017) 2026-04-16 23:18:22 -07:00
8092431316 [serving] replace O(n²) stream_buffer string concat with integer offset (#22606)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-04-14 14:48:44 -07:00
Alex NailsandClaude Opus 4.6 c6fd9a00c7 [tokenizer] eliminate O(n²) copy in non-incremental streaming (#22567)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-11 23:05:36 -07:00
Alex NailsandClaude Opus 4.6 8eac618a8d [tokenizer] lazy text accumulation + use deltas directly for streaming (#22548)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-10 21:26:04 -07:00
Alex Nails 0af9166474 [tokenizer] improve non streaming request processing + some small fixes. (#20310) 2026-04-10 15:46:12 -07:00
Alex NailsandClaude Opus 4.6 931dbceadc [CI] Set RUNAI_STREAMER_MEMORY_LIMIT=0 for stage-b-test-1-gpu-small (#22346)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-08 02:23:35 -07:00
Alex NailsandClaude Opus 4.6 493ec91cbe [CI] Fix stage-b-test-1-gpu-large (0) timeout by reordering LoRA tests and using tokenizer from cache (#22292)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-07 20:00:44 -07:00
Alex Nails 912494f596 [CI] Fix lint that was not applied in #21458 (#21818) 2026-03-31 23:58:12 -07:00