 Ke Bao
|
956d414dad
|
Update ci permission (#40121)
|
2026-09-18 15:12:36 +08:00 |
|
|
Ke BaoandSam Shleifer
|
fd6f96bf96
|
Re-land dp-attention local control broadcast test (#39835)
Co-authored-by: Sam Shleifer <sshleifer@gmail.com>
|
2026-09-17 14:33:25 +08:00 |
|
|
Ke Bao
|
5aaa18207c
|
Revert "[CI] Add e2e test for dp-attention local control broadcast" (#39828)
|
2026-09-16 23:41:50 +08:00 |
|
|
Ke Bao
|
ae3205ba28
|
Fail fast on undersized swa pool (#37610)
|
2026-09-05 13:40:37 +08:00 |
|
|
Ke Baoandadityakamat24
|
0b57847ebf
|
Fix mamba radix cache ssm state indexing (#37836)
Co-authored-by: adityakamat24 <adityakamat007@gmail.com>
|
2026-09-04 15:46:33 +08:00 |
|
|
Ke Bao
|
db017e3490
|
Build Rust extensions on hosted runners in parallel (#37258)
|
2026-09-02 09:00:25 +08:00 |
|
|
Ke Bao
|
d10a656ad8
|
Cleanup duplicate mamba backup helper (#36203)
|
2026-08-25 00:52:37 +08:00 |
|
|
Ke Bao
|
586211bc46
|
Add PD test for inkling with mxfp8 KV (#35840)
|
2026-08-25 00:12:05 +08:00 |
|
|
Ke Bao
|
54ec2c4699
|
Fix recurrent state loss on decode retraction (#35957)
|
2026-08-25 00:11:05 +08:00 |
|
|
Ke Bao
|
5662c03363
|
Support CPU offload for mxfp8 KV cache (#35888)
|
2026-08-22 10:19:06 +08:00 |
|
|
Ke Bao
|
73a2c117c6
|
Support mxfp8 KV cache in PD transfer (#35718)
|
2026-08-21 13:05:06 +08:00 |
|
|
Ke Bao
|
ba97cc6397
|
Skip empty linear-attention state buffers in PD transfer (#35689)
|
2026-08-21 01:00:50 +08:00 |
|
|
Ke Bao
|
480033def0
|
Refactor kv cache event mixin into a recorder (#35164)
|
2026-08-19 01:20:17 +08:00 |
|
|
Ke Bao
|
d528192bf9
|
Skip inkling sheared bias under batch invariance (#35161)
|
2026-08-18 12:22:58 +08:00 |
|
|
Ke Bao
|
6e8a4abb57
|
Add bit-exact class for MTP (#35143)
|
2026-08-17 19:51:39 +08:00 |
|
|
Ke Bao
|
4cad864361
|
Fix sconv track refresh on graph capture (#35042)
|
2026-08-17 15:51:45 +08:00 |
|
|
Ke Bao
|
ace7314173
|
Add bit-exact guard for extra_buffer_lazy (#35030)
|
2026-08-16 23:34:46 +08:00 |
|
|
Ke Bao
|
0f706c33d2
|
Fix swa eviction frontier for bigram keys (#34870)
|
2026-08-16 11:52:14 +08:00 |
|
|
Ke Bao
|
dd458f3212
|
Fix dsv4 kl test timeout (#34963)
|
2026-08-16 01:57:40 +08:00 |
|
|
Ke Bao
|
7562e741e2
|
Retain SWA down to the last state checkpoint (#34729)
|
2026-08-15 01:12:38 +08:00 |
|
|
Ke Bao
|
c20aceeb88
|
Fix mamba checkpoint depth under dcp (#34808)
|
2026-08-15 00:34:00 +08:00 |
|
|
Ke Bao
|
18107e38d2
|
Skip oow slot freeing under eagle (#34823)
|
2026-08-14 17:13:21 +08:00 |
|
|
Ke Bao
|
5a5c3d309b
|
Drop the mmlu case from the unified radix cache kit (#34667)
|
2026-08-13 15:16:05 +08:00 |
|
|
Ke Bao
|
ebc144ce3f
|
Enable unified cache out-of-window slot freeing by default (#34653)
|
2026-08-13 14:31:42 +08:00 |
|
|
Ke Bao
|
5efe9b104d
|
Record both architectures in the bit-exact guard docstrings (#34656)
|
2026-08-13 10:55:35 +08:00 |
|
|
Ke Bao
|
3974b00359
|
Add bit-exact unified radix cache KL test for hybrid SWA + mamba (#34607)
|
2026-08-13 02:15:36 +08:00 |
|
|
Ke Bao
|
126010c373
|
[misc] update CI_PERMISSIONS.json (#34610)
|
2026-08-13 01:58:21 +08:00 |
|
|
Ke Bao
|
f9153df62e
|
Add bit-exact hicache logprob-consistency test (#34356)
|
2026-08-12 01:54:45 +08:00 |
|
|
Ke Bao
|
b20c375c10
|
Fix flaky decode cache-hit check in Inkling test (#34405)
|
2026-08-11 21:47:01 +08:00 |
|
|
Ke Bao
|
430f38ea25
|
Update dspark draft path in Inkling small cookbook (#34250)
|
2026-08-10 17:12:51 +08:00 |
|
|
Ke Bao
|
68b961e9fb
|
Add kda replayssm tests (#33630)
|
2026-08-10 09:11:20 +08:00 |
|
|
Ke Bao
|
25b7015064
|
Fix stale track rows corrupting conv checkpoints under the prefill graph (#34184)
|
2026-08-10 08:57:23 +08:00 |
|
|
Ke Bao
|
c2fbe2f6d8
|
Add skill for the logprob consistency tests (#34169)
|
2026-08-10 01:33:00 +08:00 |
|
|
Ke Bao
|
2ab96d0fe0
|
Fix mlx unit test batch mock (#34181)
|
2026-08-10 00:55:55 +08:00 |
|
|
Ke Bao
|
fb72a37fde
|
Add deterministic logprob-consistency test for inkling-small nvfp4 (#34168)
|
2026-08-09 22:22:27 +08:00 |
|
|
Ke Bao
|
fcc5468cce
|
Fix deterministic inference all-reduce for tp>1 (#34159)
|
2026-08-09 18:08:14 +08:00 |
|
|
Ke Bao
|
c500674124
|
Switch inkling per-commit test to nvfp4 (#32402)
|
2026-08-09 16:49:49 +08:00 |
|
|
Ke Bao
|
633838b0ec
|
Add the 8-gpu Inkling consistency test (#34009)
|
2026-08-08 08:24:08 +08:00 |
|
|
Ke Bao
|
ce84df0fa1
|
Fix deterministic inference for Inkling (#33417)
|
2026-08-08 07:48:15 +08:00 |
|
|
Ke Bao
|
bc8c037041
|
Fix vae fast path test after the gate refactor (#33983)
|
2026-08-07 20:45:19 +08:00 |
|
|
Ke Bao
|
0756a1d2b0
|
Move SWA chunk-cap hatch tests into the registered suite (#33975)
|
2026-08-07 17:49:07 +08:00 |
|
|
|
04edadb34d
|
Add Inkling-Small cookbook (#32951)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com>
|
2026-07-31 01:59:11 +08:00 |
|
|
Ke Bao
|
07a087bf45
|
Fix Inkling tool-call parsing recovery, content handling, and streaming (#32861)
|
2026-07-30 14:11:09 +08:00 |
|
|
Ke Bao
|
f73d6f2789
|
Update Inkling cookbook install command (#32799)
|
2026-07-30 02:23:23 +08:00 |
|
|
Ke Bao
|
3763d3fa8c
|
Add decode-lock skip to compute-mamba-ratio (#32789)
|
2026-07-29 22:38:34 +08:00 |
|
|
Ke Bao
|
50b029257f
|
Skip mamba lock during decoding (#32228)
|
2026-07-29 21:53:28 +08:00 |
|
|
Ke Bao
|
c151080d28
|
Add compute-mamba-ratio skill (#32763)
|
2026-07-29 18:15:48 +08:00 |
|
|
Ke Bao
|
69a3c54c70
|
Fix SWA admission livelock on cached-prefix resumes (#32379)
|
2026-07-25 22:37:35 +08:00 |
|
|
Ke Bao
|
40ac197fb2
|
Fix get_server_args import lint error (#32096)
|
2026-07-23 00:09:25 +08:00 |
|
|
Ke Bao
|
e81b326e72
|
Add Inkling per-commit server test (#32095)
|
2026-07-22 23:56:18 +08:00 |
|
|
Ke Bao
|
604b1507d2
|
Add Inkling to nightly test (#31939)
|
2026-07-21 23:06:11 +08:00 |
|
|
Ke Bao
|
0a06cc5317
|
Fix extra_buffer_lazy guard bypass (#31942)
|
2026-07-21 20:41:35 +08:00 |
|
|
Ke Bao
|
2cf2e7377f
|
Fix dropped tool calls when a stream delta carries several (#31860)
|
2026-07-21 18:07:43 +08:00 |
|
|
Ke Bao
|
5ab3d90b81
|
Fix dropped Inkling reasoning at stream end (#31787)
|
2026-07-20 23:23:15 +08:00 |
|
|
Ke Bao
|
7fc545b649
|
Align reasoning_effort schema across chat, tokenize, and responses (#31784)
|
2026-07-20 23:22:43 +08:00 |
|
|
Ke Bao
|
5609f8e509
|
Reset only the used mamba state on radix cache hit (#31643)
|
2026-07-19 00:40:02 +08:00 |
|
|
Ke Bao
|
48ae829f6e
|
Reset only the used mamba state on unified radix cache (#31648)
|
2026-07-18 21:43:13 +08:00 |
|
|
Ke Bao
|
372a893744
|
Move deferred mamba cow and clear (#29945)
|
2026-07-03 11:29:05 +08:00 |
|
|
Ke Bao
|
a375e9f3da
|
Fix SWA eviction tombstoning the last leaf (#29860)
|
2026-07-02 21:42:30 +08:00 |
|
|
Ke Bao
|
854d232a40
|
Fix flaky hicache l3 mmlu nightly test (#27688)
|
2026-06-10 10:01:14 +08:00 |
|
|
Ke Bao
|
d03182cd2d
|
Fix TP deadlock in unified radix cache writing_check / loading_check (#27489)
|
2026-06-08 16:08:47 +08:00 |
|
|
Ke Bao
|
44d4a25a07
|
Type hicache transfer hook kwargs in unified cache (#27071)
|
2026-06-03 18:57:25 +08:00 |
|
|
Ke Bao
|
28f9c1ff24
|
Relax mamba unified cache kl threshold (#27070)
|
2026-06-02 23:28:22 +08:00 |
|
|
Ke Bao
|
b5e154dc73
|
Fix stale import after kl_nightly rename (#27064)
|
2026-06-02 21:46:21 +08:00 |
|
|
Ke Bao
|
38d4c9ba88
|
Improve type annotations in unified radix cache (#26948)
|
2026-06-02 21:17:50 +08:00 |
|
|
Ke Bao
|
f59bbef841
|
Split SWA leaf to one window on insert (#26919)
|
2026-06-01 23:46:55 +08:00 |
|
|
Ke Bao
|
693adabff7
|
Fix Mamba2Metadata dropping has_mamba_track_mask (#26877)
|
2026-06-01 22:03:59 +08:00 |
|
|
Ke Bao
|
cdd06011a1
|
Make unified tree SWA hicache tests faithful to write-through backup (#26870)
|
2026-06-01 16:08:57 +08:00 |
|
|
Ke Bao
|
972fbf7711
|
Skip flaky mamba extra_buffer disagg test (#26838)
|
2026-05-31 15:59:03 +08:00 |
|
|
Ke Bao
|
e7b12fe6fa
|
Fix stale forward_metadata leak in DP attn unpadded idle batch (#26313)
|
2026-05-25 16:04:00 -07:00 |
|
|
Ke Bao
|
b13d3d18c6
|
Refactor HiCache stack dispatch into strategies (#26295)
|
2026-05-26 00:06:17 +08:00 |
|
|
Ke Bao
|
e4378ff37f
|
[UnifiedRadixCache] Fix HiCache load back start node (#25088)
|
2026-05-14 13:18:12 +08:00 |
|
|
Ke Bao
|
6be1a45d99
|
Fix swa component host hit (#25085)
|
2026-05-12 21:03:39 +08:00 |
|
|
Ke Bao
|
d7f4761a48
|
[PD] Refactor hybrid state transfer (#24932)
|
2026-05-12 13:16:54 +08:00 |
|
|
Ke Bao
|
d9cb38012e
|
Update MiMo V2.5 cookbook image to nightly (#24983)
|
2026-05-11 22:04:31 +08:00 |
|
|
Ke Bao
|
62edbc37c4
|
[Doc] Add rerun-test slash command usage (#24979)
|
2026-05-11 21:30:01 +08:00 |
|
|
Ke Bao
|
9c03171f6c
|
Fix gb envs in deployment guide (#24977)
|
2026-05-11 21:06:02 +08:00 |
|
|
Ke Bao
|
36ba60ad49
|
Register SWA unit tests under unit/mem_cache (#24974)
|
2026-05-11 20:21:05 +08:00 |
|
|
Ke Bao
|
59faf986b2
|
[PD] Unify dsv4 dispatch with swa (#24888)
|
2026-05-10 22:01:13 +08:00 |
|
|
Ke Baoandhzh0425
|
eb5f0fbeef
|
Support swa HiCache for unified radix cache (#23391)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-05-06 22:19:25 +08:00 |
|
|
Ke Bao
|
6dd7aebb36
|
Minor scheduler fixes (#24359)
|
2026-05-05 02:01:23 +08:00 |
|
|
Ke Bao
|
aea527afdc
|
Fix swa chunk req deferred (#24318)
|
2026-05-04 14:52:15 +08:00 |
|
|
Ke Bao
|
50fc2c9e23
|
Fix hybrid swa chunked prefill oom (#23174)
|
2026-04-21 10:46:45 +08:00 |
|
|
Ke Bao
|
3c0a6c6987
|
Add page_size and SWA coverage to unified radix cache bench test (#22815)
|
2026-04-14 23:58:05 +08:00 |
|
|
Ke Bao
|
9f9e0231bb
|
Refactor unified radix cache UT into parameterized test suite (#22812)
|
2026-04-14 22:34:33 +08:00 |
|
|
Ke Bao
|
bc1bfbf607
|
Fix swa input length limitation (#22597)
|
2026-04-12 16:03:35 +08:00 |
|
|
Ke Bao
|
e77bfba24d
|
Fix NCCL AllGather hanging issue for Qwen3 Next MTP (#22458)
|
2026-04-10 11:40:54 +08:00 |
|
|
Ke Bao
|
021bd77c91
|
Add skills for debugging hanging issues (#22463)
|
2026-04-10 01:37:44 +08:00 |
|
|
Ke Bao
|
be42fbbbd7
|
Support HTTP2 server (#21700)
|
2026-04-08 00:42:52 +08:00 |
|
|
Ke Bao
|
fae90abf6e
|
Move ring test to nightly (#22267)
|
2026-04-07 21:56:39 +08:00 |
|
|
Ke Bao
|
b95324d19c
|
Update test coverage report (#22190)
|
2026-04-06 20:59:38 +08:00 |
|
|
Ke Bao
|
9ca2ae1c6c
|
Update test skills and guide (#22189)
|
2026-04-06 20:30:25 +08:00 |
|
|
Ke Bao
|
c4240218cb
|
Fix ut module importing (#22176)
|
2026-04-06 11:53:58 +08:00 |
|
|
Ke Bao
|
896ea75820
|
Remove reverted test (#22058)
|
2026-04-03 23:51:37 +08:00 |
|
|
Ke Bao
|
47f4fd275a
|
[CI] Fix test suite names and add suite validation (#21937)
|
2026-04-03 23:47:17 +08:00 |
|
|
Ke Bao
|
9f409d0749
|
[CI] Adjust CI server launch timeout (#22045)
|
2026-04-03 22:38:07 +08:00 |
|
|
Ke Bao
|
b21db86e2f
|
[CI] Fix gpu deps import in cpu test (#21950)
|
2026-04-03 00:06:31 +08:00 |
|
|
Ke Bao
|
dbc97456ad
|
Enable evict swa with piecewise cuda graph (#21754)
|
2026-03-31 20:07:16 +08:00 |
|
|
Ke Bao
|
91ab75b505
|
[CI] Fix ring test timeout (#21751)
|
2026-03-31 18:26:08 +08:00 |
|
|
Ke Bao
|
acd37d8701
|
[CI] Fix rerun-test suite detection to skip commented registrations (#21753)
|
2026-03-31 18:00:53 +08:00 |
|