Commit Graph
84 Commits
Author SHA1 Message Date
Douglas YangandClaude Opus 5 59450c4f18 docs(cookbook): Kimi-K3 — drop --enable-symm-mem from the GB cells (#34444)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-11 19:23:41 +00:00
Douglas YangandClaude Opus 5 86f373daff docs(cookbook): DeepSeek-V4-Flash-0731 — drop chunked-prefill/autotune flags on B300 low-latency (#34044)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-07 23:12:56 +00:00
4a55fdba0b docs(cookbook): re-benchmark DeepSeek-V4 on sglang 0.5.15 (#31363)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
2026-07-21 22:55:36 +00:00
Douglas YangandClaude Opus 4.8 e149cdb337 docs(cookbook): revert MiniMax-M3 to dev image (model not yet in a release) (#31819)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-20 12:16:47 -07:00
Douglas YangandClaude Opus 4.8 a01a8e1ed9 docs(cookbook): replace pinned nightly/dev images with :latest (#31610)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-17 23:33:19 +00:00
Douglas YangandClaude Opus 4.8 ae3f62613a docs(cookbook): fix stale/pruned Docker image tags (#31508)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-17 13:24:46 -07:00
Douglas Yang 105e095e00 [Docker] Fix cu12 dev image build: pin torch reinstall + JIT-fallback for missing x86 cubins (#28632) 2026-06-18 10:51:57 +02:00
Douglas YangandClaude Opus 4.8 75be922451 docs(cookbook): add Docker install option for Gemma 4 (#27287)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-04 12:45:32 -07:00
e5589843a3 feature: upstream cancel (#19524)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-18 16:20:09 +08:00
f6fc39569a [CI] Migrate mgsm_en eval to gsm8k to remove openaipublic dependency (#21931)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2026-04-07 16:29:20 -07:00
Douglas Yang a94c3804c2 fix: mistral embedding regression fix (#21913) 2026-04-04 00:11:51 -07:00
Douglas Yang 1b45d81e91 fix: only showing recent runners from ci failure analysis (#21015) 2026-03-31 20:18:17 -07:00
Douglas Yang 061ec582bf fix: adding teacache.params back to sampling params as intended (#20665) 2026-03-16 11:27:06 -07:00
Douglas Yang 65de904130 feature: adding image retag workflow (#19265) 2026-02-24 11:33:05 -08:00
Douglas Yang 59e7ea99c5 fix: release docker worker wrong args (#19207) 2026-02-23 19:51:06 -08:00
Douglas Yang 3a11e7dad9 fix: patch docker image fixes (#19100) 2026-02-23 16:34:29 -08:00
Douglas Yang 77fdb6af81 feature: docker patch workflow (#19025) 2026-02-20 15:37:40 +08:00
Douglas Yang f1efb46bdd fix: adding performance logging for nightly diffusion (#18023) 2026-02-16 14:09:00 +08:00
Douglas Yang 2050875424 fix: unifying docker image build pipeline (#18814) 2026-02-16 14:05:55 +08:00
Douglas Yang 45715af50c fix: nightly whl dev date suffix (#18873) 2026-02-16 10:57:37 +08:00
Douglas Yang 4ef8ece08a feature: adding build commit to sgl kernel workflow (#18853) 2026-02-15 23:28:43 +08:00
Douglas Yang e730c728d3 fix: image version in pypi pr workflow (#18735) 2026-02-13 00:18:01 +08:00
Douglas Yang b7c1dfc602 fix: bumping nightly whl version (#18212) 2026-02-03 20:43:38 -08:00
Douglas Yang ae004e15c9 fix: ensuring nightly whls are tagged with latest commit (#18204) 2026-02-03 15:54:41 -08:00
Douglas Yang c8da307d7e feature: adding gpt-oss 120b nightly test (#18134) 2026-02-02 17:11:28 -08:00
Douglas Yang 8643fb2f52 fix: remove truncation for test and job names in ci failure monitor (#17765) 2026-01-26 09:46:33 -08:00
Douglas Yang 51d139b867 fix: move nightly whl to cuda version folder (#17762) 2026-01-27 00:13:46 +08:00
Douglas Yang 58799d91a7 fix: nightly wheel naming for non-post versions (#17538) 2026-01-24 12:51:52 +08:00
Douglas Yang 4c7136bb36 feature: adding openai compatible API request to bench_serving (#17219) 2026-01-23 16:04:28 -08:00
Douglas Yang d50dcd9b61 fix: Release pr pypi fix (#17382) 2026-01-19 23:00:54 -08:00
Douglas Yang 91d8c52d6d fix: updating pypi workflow with new base version formatting in pyproject.toml (#17366) 2026-01-19 13:23:11 -08:00
Douglas Yang d2ec128bbf fix: ci failure monitor reorganization (#17165) 2026-01-16 13:25:13 -08:00
Douglas Yang 655d2c7c2a fix: adding matrix partitioning for h200 and b200 nightly tests (#17091) 2026-01-15 11:23:19 -08:00
Douglas Yang aa2b4f7661 fix: renaming test file and job names + skip blocking llama4 nightly (#16971) 2026-01-14 09:57:59 -08:00
Douglas Yang a1b243d76f fix: extend cpu only install dependency timeout to 20 mins (#16759) 2026-01-08 16:08:21 -08:00
Douglas Yang 1e5de05e35 fix: adding timeout for install dependencies (#16706) 2026-01-08 00:30:41 -08:00
Douglas Yang f4742558ac fix: 8-gpu-b200 increase timeout length (#16658) 2026-01-07 09:45:55 -08:00
Douglas Yang 2ff872311b ci: adding llama4 placeholder test to nightly (#16599) 2026-01-07 21:51:30 +08:00
Douglas Yang 5c04088b3a fix: remove performance testing from nightly dpsk v32 cp single node (#16582) 2026-01-07 13:38:31 +08:00
Douglas Yang 951d16c890 fix: adjusting vlm accuracy thresholds (#16593) 2026-01-06 19:41:05 -08:00
Douglas Yang 5349764298 fix: kimi k2 thinking accuracy threshold change (#16585) 2026-01-06 13:18:43 -08:00
Douglas Yang 6e3fff1352 fix: adding retries for server start and increasing hf read timeout (#16523) 2026-01-06 09:53:12 -08:00
Douglas Yang 5097e1e85b fix: moving dpsk v32 cp single node to nightly (#16539) 2026-01-05 22:18:59 -08:00
Douglas Yang c80c0e0fc0 fix: adding multi-threading for kimi weights loading in pr test (#16538) 2026-01-05 20:10:13 -08:00
Douglas Yang 76c71d1d34 fix: unimplemented methods in BaseIndexerMetadata (#16520) 2026-01-06 10:26:42 +08:00
Douglas Yang 55d112dc79 fix: enable multi-threading for h200 tests (#16413) 2026-01-04 14:43:53 -08:00
Douglas Yang a1ed247fd7 feature: add runner online count to failure monitor (#16408) 2026-01-04 13:24:04 -08:00
Douglas Yang 87699d48eb fix: only publish trace from tp 0 (#16411) 2026-01-04 12:17:08 -08:00
Douglas Yang 16e00651dd fix: health check adding test delays (#16381) 2026-01-04 00:28:32 -08:00
Douglas Yang 8b111b20c3 feature: improvements to CI failure monitor (#16272) 2026-01-02 20:09:41 -08:00
Douglas Yang 67caea6fe4 fix: adding deepseek base tests to b200 (#15915) 2025-12-26 18:04:25 -08:00
Douglas Yang f2ccc44240 fix: improving format and design (#15791) 2025-12-25 13:13:27 -08:00
Douglas Yang 17e65466de fix: nightly fix b200 gpqa (#15745) 2025-12-24 10:29:45 -08:00
Douglas Yang f9dd90ac35 fix: increasing H200 test timeout (#15600) 2025-12-23 01:00:37 -08:00
Douglas Yang 96740d6983 feature: revamp nightly tests with combined runner (#15324) 2025-12-20 19:25:22 -08:00
Douglas Yang 9e7656be80 fix: adjust time for test_epd_disaggregation.py (#15354) 2025-12-17 18:30:52 -08:00
Douglas Yang 46ad4b986d fix: moving decorator to header (#15297) 2025-12-16 17:05:45 -08:00
Douglas Yang da58df6b3d fix: skipping TestEPDDisaggregationOneEncoder test (#15292) 2025-12-16 16:31:20 -08:00
Douglas Yang 3c8dc448b2 fix: removing latest-sglang=1 (#15220) 2025-12-16 00:14:48 -08:00
Douglas Yang 61f362c694 feature: create docker image from pr branch (#15185) 2025-12-15 10:53:50 -08:00
Douglas Yang 1e2d753804 fix: adding date and fixing release name issue (#15174) 2025-12-15 17:11:03 +08:00
Douglas Yang af49e30242 feature: PR wheel (#15170) 2025-12-15 00:22:47 -08:00
Douglas Yang 21cfebac65 fix: move ci-bot (#15154) 2025-12-14 22:47:19 -08:00
Douglas Yang 9e9a61691e ci: adding errors to Github summary (#14778) 2025-12-14 21:08:16 -08:00
Douglas Yang 2c899431f8 fix: adjusting frequency for ci failure monitor (#15134) 2025-12-14 17:49:57 -08:00
Douglas YangandClaude Sonnet 4.5 8c96fcda70 feature: ci failure monitor slack bot (#15110)
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
2025-12-14 13:47:15 -08:00
Douglas Yang ea07a283b2 fix: adding schedule for nightly wheel (#15054) 2025-12-13 10:48:21 -08:00
Douglas Yang ea91a720d5 feature: ci failure monitor improvements (#15055) 2025-12-13 10:47:52 -08:00
Douglas Yang b2e240bc4a feature: adding nightly wheel workflow and indexer (#14924) 2025-12-13 00:26:10 -08:00
Douglas Yang 6ce36b1232 fix: making the publish trace error check broader (#14931) 2025-12-11 18:19:57 -08:00
Douglas Yang 3d98bd5edf ci: adding more nightly tests to bot bump workflows (#14928) 2025-12-11 16:26:21 -08:00
Douglas Yang e52cf30e81 fix: adding temporary bypass for nightly tests (#14876) 2025-12-11 00:09:03 -08:00
Douglas Yang 1a96e66493 fix: creating blobs only once for publish trace retries (#14845) 2025-12-10 22:40:06 -08:00
Douglas Yang c8d74feb06 fix: adding rate limit warning at verify token permission stage (#14756) 2025-12-09 17:21:04 -08:00
Douglas Yangandgemini-code-assist[bot] 7c6fb3aa2d fix: making rate limit a warning instead of error (#14753)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-09 13:41:09 -08:00
Douglas Yang 8b0b6a45c8 fix: checking if tokenizer is in cache before downloading from HF (#14698) 2025-12-09 13:08:07 -08:00
Douglas Yang 5c03aa3e9d Adding section for scheduled PR test runs on main (#14309) 2025-12-02 14:52:44 -08:00
Douglas Yang 253be18e52 Fix nonetype error for ci failure monitor (#14319) 2025-12-02 14:24:25 -08:00
Douglas YangandLiangsheng Yin 697a77bf73 Add stress test workflow (#13937)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2025-11-26 13:24:39 -08:00
Douglas Yang ed8786b0b9 Adding nightly tests for Kimi-K2-thinking, Qwen3, minimax-m2, GLM4.6 (#13890) 2025-11-24 22:47:46 -08:00
Douglas Yang fc9efdcb98 Adding nightly tests as release guard for bot bump workflows (#13655) 2025-11-20 10:04:36 -08:00
Douglas Yang 8900f996aa CI Failure Monitor Improvements (#13558) 2025-11-18 22:55:38 -08:00
Douglas Yang d7984f3125 Adding CI Monitor Improvements (#13462) 2025-11-17 18:42:35 -08:00
Douglas Yang 7ee3e36412 Fix: test_vlm_offline_throughput output throughput (#13279) 2025-11-15 14:31:48 +08:00