 fzyzcjy
|
4add6ec0f6
|
Enhance displaying and debuggability in dump comparator (#19466)
|
2026-02-27 09:06:19 +08:00 |
|
|
fzyzcjy
|
23cbbd6d41
|
Integrate packed data context parallel in dump comparator (#19464)
|
2026-02-27 08:28:36 +08:00 |
|
|
fzyzcjy
|
8293a914a6
|
Support token align with packed CP data in dump comparator (#19463)
|
2026-02-27 08:12:54 +08:00 |
|
|
fzyzcjy
|
695e93b91f
|
Make reorderer support packed format with CP in dump comparator (#19462)
|
2026-02-27 08:12:18 +08:00 |
|
|
fzyzcjy
|
e3cdf6b1a3
|
Support CP packed format in unsharder in dump comparator (#19461)
|
2026-02-27 08:11:47 +08:00 |
|
|
fzyzcjy
|
f2d1b7c4ad
|
Support sequence parallel and trivial dims in dump comparator (#19460)
|
2026-02-27 08:11:15 +08:00 |
|
|
fzyzcjy
|
eb2ada3804
|
Support non-packed format when aligning tokens in dump comparator (#19459)
|
2026-02-27 08:10:29 +08:00 |
|
|
fzyzcjy
|
e1e0cfd856
|
Use named tensors in dump comparator (#19458)
|
2026-02-27 08:09:55 +08:00 |
|
|
fzyzcjy
|
eb0e905fc3
|
Update token layout and cleanup printer in dump comparator (#19457)
|
2026-02-27 08:09:15 +08:00 |
|
|
fzyzcjy
|
8ac64e1487
|
Support unifying axis ordering in dump comparator (#19456)
|
2026-02-27 08:08:32 +08:00 |
|
|
fzyzcjy
|
425d333ee3
|
Support token dim in arbitrary location in dump comparator (#19455)
|
2026-02-27 08:07:38 +08:00 |
|
|
fzyzcjy
|
265eb56d44
|
Support multi-step alignment and pipeline integration in dump comparator (#19378)
|
2026-02-26 10:23:22 +08:00 |
|
|
fzyzcjy
|
f9a2f0398f
|
Support token aligner planning and execution in dump comparator (#19377)
|
2026-02-26 10:04:33 +08:00 |
|
|
fzyzcjy
|
d34d5aca07
|
Support loading token aligner data in dump comparator (#19376)
|
2026-02-26 10:03:56 +08:00 |
|
|
fzyzcjy
|
e8dd14519d
|
Add aligner entrypoint and bundle handler in dump comparator (#19375)
|
2026-02-26 10:03:22 +08:00 |
|
|
fzyzcjy
|
2739d7df62
|
Reorganize modules and pipeline in dump comparator (#19374)
|
2026-02-26 10:00:13 +08:00 |
|
|
fzyzcjy
|
508b8e3387
|
Handle warnings via sink for structured output and add pair in dump comparator (#19373)
|
2026-02-26 09:59:15 +08:00 |
|
|
fzyzcjy
|
46321ee70e
|
Support dumping rid for correlation across passes in dump comparator (#19372)
|
2026-02-26 09:57:57 +08:00 |
|
|
fzyzcjy
|
b7af58b9af
|
Support replication axis in dump comparator (#19282)
|
2026-02-25 09:48:43 +08:00 |
|
|
fzyzcjy
|
2e2b18e870
|
Support context parallel zigzag reordering in dump comparator (#19281)
|
2026-02-25 09:46:17 +08:00 |
|
|
fzyzcjy
|
0de1f4b07b
|
Support multi axis unsharding in dump comparator (#19280)
|
2026-02-25 09:44:07 +08:00 |
|
|
fzyzcjy
|
4bb678f28a
|
Full test coverage in dump comparator (#19279)
|
2026-02-25 09:43:29 +08:00 |
|
|
fzyzcjy
|
94ca2ac5d7
|
Support TP unification and enhance tests in dump comparator (#19278)
|
2026-02-25 09:42:56 +08:00 |
|
|
fzyzcjy
|
39ba9b5ab5
|
Support simple unsharding in dumper comparator (#19277)
|
2026-02-25 09:42:21 +08:00 |
|
|
fzyzcjy
|
02ca107b2c
|
Support dims annotation and enhance dump loader in dumper (#19276)
|
2026-02-25 09:41:48 +08:00 |
|
|
fzyzcjy
|
8b1ab4aaf9
|
Support agent-friendly output formats in dump comparator (#19275)
|
2026-02-25 09:40:33 +08:00 |
|
|
fzyzcjy
|
d7578ce279
|
Implement simplest dump comparator v2 (#19274)
|
2026-02-25 09:37:21 +08:00 |
|
|
fzyzcjy
|
1a1c768d44
|
Support kwargs and megatron core tensor parsing in dumper (#19138)
|
2026-02-22 16:24:33 +08:00 |
|
|
fzyzcjy
|
326b788ab4
|
Fix wrongly large dumped file and handle non intrusive hook reset in dumper (#19124)
|
2026-02-22 16:20:08 +08:00 |
|
|
fzyzcjy
|
c1f497e20e
|
Enhance reset, states, http in dumper (#19095)
|
2026-02-22 16:17:41 +08:00 |
|
|
fzyzcjy
|
4091b720c5
|
Support multi colocated dumper, named exp cleanup, argparse config (#19094)
|
2026-02-22 16:16:15 +08:00 |
|
|
fzyzcjy
|
31f0c11405
|
Configure and call dumper in main SGLang logic (#19093)
|
2026-02-22 16:14:27 +08:00 |
|
|
fzyzcjy
|
cc63c99f11
|
Enhance hook mechanism in dumper (#19073)
|
2026-02-22 16:13:38 +08:00 |
|
|
fzyzcjy
|
fdf80b5031
|
Extract framework plugins in dumper (#19072)
|
2026-02-22 16:10:43 +08:00 |
|
|
fzyzcjy
|
e32b5364a2
|
Auto annotate context in dumper (#19071)
|
2026-02-22 16:08:48 +08:00 |
|
|
fzyzcjy
|
8bc0751376
|
Support enabling partial non intrusive dump in dumper (#19069)
|
2026-02-22 16:07:45 +08:00 |
|
|
fzyzcjy
|
0384c459a7
|
Support non-intrusive dumping in dumper (#19068)
|
2026-02-22 16:04:02 +08:00 |
|
|
fzyzcjy
|
5eccc3cff9
|
Refactor dumper and change on_forward_pass_start API (#19065)
|
2026-02-22 16:03:27 +08:00 |
|
|
fzyzcjy
|
0d20cf5a66
|
Fix lint on main (#19054)
|
2026-02-20 15:45:24 +08:00 |
|
|
fzyzcjy
|
046ef0aa35
|
Support using SGLang port in dumper (#19038)
|
2026-02-20 12:30:24 +08:00 |
|
|
fzyzcjyandYueming Yuan
|
2fecc2c075
|
Support resetting and enhance HTTP endpoints for dumper (#19046)
Co-authored-by: Yueming Yuan <112649537+yueming-yuan@users.noreply.github.com>
|
2026-02-20 12:29:09 +08:00 |
|
|
fzyzcjy
|
503bf3047a
|
Enhance configure and env parsing in dumper (#19034)
|
2026-02-20 12:28:10 +08:00 |
|
|
fzyzcjy
|
df995aab56
|
Support filtering labels in dumper (#19018)
|
2026-02-20 12:27:12 +08:00 |
|
|
fzyzcjy
|
261bca3c58
|
Support captured dump output and console output control in dumper (#19017)
|
2026-02-20 12:26:24 +08:00 |
|
|
fzyzcjy
|
fc1500adc6
|
Hint users when wrongly execute it with partial ranks in dumper (#19014)
|
2026-02-20 12:25:54 +08:00 |
|
|
fzyzcjy
|
b41d412c3d
|
Support cleanup previous dumps in dumper (#19013)
|
2026-02-20 12:25:21 +08:00 |
|
|
fzyzcjyandYueming Yuan
|
f554b3c27b
|
Support dumping gradients, parameters, lazy values (#18881)
Co-authored-by: Yueming Yuan <112649537+yueming-yuan@users.noreply.github.com>
|
2026-02-16 13:34:06 +08:00 |
|
|
fzyzcjy
|
9a7d8d5eb0
|
Collect upper level metadata to dump output (#18880)
|
2026-02-16 13:31:19 +08:00 |
|
|
fzyzcjy
|
949792d0c6
|
Change dump output format to dict with value and metadata (#18879)
|
2026-02-16 13:30:47 +08:00 |
|
|
fzyzcjy
|
02816abc0d
|
Flip dumper to disable by default and refactor environment handling (#18878)
|
2026-02-16 13:29:32 +08:00 |
|
|
fzyzcjy
|
90555a0228
|
Add missing dumper tests (#18859)
|
2026-02-15 18:42:57 +08:00 |
|
|
fzyzcjy
|
4c7f986c6b
|
Extract dumper and prefill delayer tests common utils (#18857)
|
2026-02-15 18:33:23 +08:00 |
|
|
fzyzcjy
|
9c2530642c
|
Change routing policy API to be async to support more policies (#17048)
|
2026-01-17 17:12:51 +08:00 |
|
|
fzyzcjy
|
a7b5f75d88
|
Support integration tests with Redis binary (#17045)
|
2026-01-17 11:59:04 +08:00 |
|
|
fzyzcjy
|
305c1a575a
|
Tiny remove unused code (#17047)
|
2026-01-17 11:58:43 +08:00 |
|
|
fzyzcjy
|
c824ddd581
|
Fix imbalancedness for manual policy min group mode for requests without routing id (#17044)
|
2026-01-17 11:58:35 +08:00 |
|
|
fzyzcjy
|
ff3ddb9d9b
|
Support min num routing keys in key-based load balancing policy (#16564)
|
2026-01-12 21:38:03 -08:00 |
|
|
fzyzcjy
|
9d3018f484
|
Support min load besides random routing key assignment policy in ManualPolicy (#16767)
|
2026-01-12 18:31:18 -08:00 |
|
|
fzyzcjy
|
1f0e3d7fd8
|
Support tracking worker routing key loads in gateway (#16765)
|
2026-01-13 08:07:17 +08:00 |
|
|
fzyzcjyandSimo Lin
|
38b30c7b56
|
Tiny refactor age computation in router (#16850)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2026-01-11 21:42:43 -08:00 |
|
|
fzyzcjy
|
a1c48943d7
|
Tiny fix NoAvailableWorkers being a RetryError (#16896)
|
2026-01-11 18:53:17 -08:00 |
|
|
fzyzcjy
|
dae6a4092a
|
Tiny add scheduler status logging (#16872)
|
2026-01-10 20:12:24 +08:00 |
|
|
fzyzcjy
|
a0899bdbd8
|
Fix log_decode_stats_every_iteration when having TP in attention (#16871)
|
2026-01-10 20:10:23 +08:00 |
|
|
fzyzcjy
|
641830c1c2
|
Tiny extract file logging utils (#16870)
|
2026-01-10 20:02:37 +08:00 |
|
|
fzyzcjy
|
c89949bbaf
|
Tiny let soft watchdog cover initialization phase (#16853)
|
2026-01-10 13:20:08 +08:00 |
|
|
fzyzcjy
|
32a569fb77
|
Tiny add CPU resource monitoring for overload diagnosis (#16852)
|
2026-01-10 12:48:18 +08:00 |
|
|
fzyzcjy
|
3ed3b7ef7c
|
Tiny add routing key distribution metrics (#16847)
|
2026-01-10 12:06:40 +08:00 |
|
|
fzyzcjy
|
1f9d4795a9
|
Tiny add gauge histogram abstraction for engine and router (#16848)
|
2026-01-10 11:45:25 +08:00 |
|
|
fzyzcjy
|
1f0ea4f958
|
Add routing key based schedule policy (#16840)
|
2026-01-10 10:16:23 +08:00 |
|
|
fzyzcjy
|
15da3061bc
|
Tiny pass routing key to scheduler processes (#16839)
|
2026-01-10 10:13:00 +08:00 |
|
|
fzyzcjy
|
6406a5969b
|
Tiny support customizing prometheus buckets for prefill delayer (#16831)
|
2026-01-10 08:17:37 +08:00 |
|
|
fzyzcjy
|
cec19b56c6
|
Tiny add command line args for prefill delayer and unify names (#16830)
|
2026-01-10 07:54:25 +08:00 |
|
|
fzyzcjy
|
8eeffbe9aa
|
Support token low usage watermark in prefill delayer (#16814)
|
2026-01-09 23:07:18 +08:00 |
|
|
fzyzcjy
|
71e9c31cb8
|
Tiny add and enhance tests for prefill delayer (#16813)
|
2026-01-09 22:58:38 +08:00 |
|
|
fzyzcjy
|
7656d26737
|
Tiny enhance prefill delayer observability (#16812)
|
2026-01-09 22:51:16 +08:00 |
|
|
fzyzcjy
|
dd24ba9084
|
Refactor prefill delayer for clarity and extensibility (#16811)
|
2026-01-09 22:46:41 +08:00 |
|
|
fzyzcjy
|
9e3a032ad6
|
[smg] cleanup router RAII guards (#16560)
|
2026-01-08 16:39:53 -08:00 |
|
|
fzyzcjy
|
b6e8a0d851
|
Add file size hints in bitwise model file verifier (#16735)
|
2026-01-08 22:28:52 +08:00 |
|
|
fzyzcjy
|
83abecd0c2
|
Support pre-generating and using expected checksums (#16730)
|
2026-01-08 20:26:13 +08:00 |
|
|
fzyzcjy
|
d54f0a10b4
|
Support bitwise weight checksum verifier (#16729)
|
2026-01-08 20:19:25 +08:00 |
|
|
fzyzcjy
|
3be1e734ee
|
[model-gateway] extract header extraction in policy and add (#16566)
|
2026-01-06 20:18:44 -08:00 |
|
|
fzyzcjy
|
d874c8bba4
|
Tiny support http headers in bench serving (#16606)
|
2026-01-07 10:15:17 +08:00 |
|
|
fzyzcjy
|
9a21d89c5b
|
Tiny add metrics for prefill delayer (#16603)
|
2026-01-07 09:53:52 +08:00 |
|
|
fzyzcjy
|
ed307a40bf
|
Tiny add --gsp-ordered (#16575)
|
2026-01-06 22:43:52 +08:00 |
|
|
fzyzcjy
|
f959250f76
|
Tiny support sglang_routing_keys_active in engine (#16570)
|
2026-01-06 22:10:10 +08:00 |
|
|
fzyzcjy
|
c105a3124b
|
Support multi-round conversations in bench_serving (#6135)
|
2026-01-06 11:59:39 +08:00 |
|
|
fzyzcjy
|
1e41069ad1
|
Fix age bucket rendering issue (#16492)
|
2026-01-05 09:29:14 -08:00 |
|
|
fzyzcjy
|
7f35c46efb
|
Tiny add sglang:http_requests_active metric (#16479)
|
2026-01-05 17:20:31 +08:00 |
|
|
fzyzcjy
|
4308c25b47
|
Super tiny move test folder (#16447)
|
2026-01-05 16:29:26 +08:00 |
|
|
fzyzcjy
|
4d737db857
|
Tiny fix prefill delayer not support non-fcfs schedule policy (#16471)
|
2026-01-05 16:28:54 +08:00 |
|
|
fzyzcjy
|
9d6029fb92
|
Fix TokenizerManager bottleneck for offline generation (#16456)
|
2026-01-05 16:28:25 +08:00 |
|
|
fzyzcjy
|
c63e9cb29e
|
Super tiny fix CI (#16437)
|
2026-01-04 20:34:49 -08:00 |
|
|
fzyzcjy
|
1e7b326482
|
Super tiny fix main code (#16432)
|
2026-01-05 10:34:25 +08:00 |
|
|
fzyzcjy
|
249c356331
|
Super tiny update tokenizer benchmark (#16429)
|
2026-01-05 09:14:52 +08:00 |
|
|
fzyzcjy
|
12df16607b
|
Tiny speed up kimi detokenizer by 10x (#16427)
|
2026-01-05 09:12:05 +08:00 |
|
|
fzyzcjy
|
f16606d6f6
|
Super tiny code cleanup (#16401)
|
2026-01-04 23:00:09 +08:00 |
|
|
fzyzcjy
|
387fad2f74
|
Tiny add detokenization benchmarks (#16400)
|
2026-01-04 22:53:38 +08:00 |
|
|
fzyzcjy
|
27a0830593
|
Tiny add manual policy benchmark to CI (#16392)
|
2026-01-04 19:10:35 +08:00 |
|
|
fzyzcjy
|
53479e226b
|
Tiny refactor router benchmark github actions (#16374)
|
2026-01-04 18:00:12 +08:00 |
|
|
fzyzcjy
|
1b2b95d8d1
|
Super tiny cleanup unused function (#16376)
|
2026-01-04 15:08:12 +08:00 |
|