Commit Graph
100 Commits
Author SHA1 Message Date
fzyzcjy d4c1665626 docs(DeepSeek-V4): mark h200|big|pd-disagg verified + recipe fixes (#23715) 2026-04-25 22:49:12 +08:00
fzyzcjy 880599cd43 docs(DeepSeek-V4): bump GB300 Pro PD decode --mem-fraction-static 0.83 → 0.9 (#23698) 2026-04-25 16:35:44 +08:00
fzyzcjy 8a395994ed docs(DeepSeek-V4): mark gb300|{small,big}|{cp,pd-disagg} verified + GB300-specific fixes (#23691) 2026-04-25 12:21:57 +08:00
fzyzcjy d2c61acf25 docs(DeepSeek-V4): mark b200|small|pd-disagg + h200|small|{cp,pd-disagg} verified (#23689) 2026-04-25 11:57:25 +08:00
fzyzcjy fd401c2fb4 docs(DeepSeek-V4): note SGLANG_FIX_DSV4_BASE_MODEL_LOAD for base models (#23684) 2026-04-25 11:27:00 +08:00
fzyzcjy 92bb5c6bbe Update pro fp8 checkpoint in DeepSeek V4 cookbook (#23634) 2026-04-24 15:58:04 +08:00
fzyzcjy 3a620cb761 Again update DeepSeek V4 cookbook (#23622) 2026-04-24 15:12:35 +08:00
fzyzcjy 734e1e2965 Further update Deepseek V4 docs (#23617) 2026-04-24 13:23:50 +08:00
fzyzcjy 146700db68 Add e2e demo test in dump comparator (#21031) 2026-03-20 22:41:01 +08:00
fzyzcjy 6703cc4484 Enhance output formatting in dump comparator (#21029) 2026-03-20 22:04:50 +08:00
fzyzcjy fdbcb8156e Refactor dp_utils to use ParallelAxis enum in dump comparator (#21028) 2026-03-20 22:04:20 +08:00
fzyzcjy 154395ab7d Support s≡t dimension name equivalence in dump comparator (#21027) 2026-03-20 22:03:34 +08:00
fzyzcjy cc22601d28 Validate replicated axes orthogonality in dump comparator (#21026) 2026-03-20 22:02:40 +08:00
fzyzcjy 2f01950a0e Support jointly-determined axes inference in dump comparator (#21025) 2026-03-20 22:01:26 +08:00
fzyzcjy ecd7e40d20 Support dependent axis auto-resolution in dump comparator (#21024) 2026-03-20 21:56:39 +08:00
fzyzcjy 7579ab3f33 Enhance error resilience in dump comparator (#19685) 2026-03-02 19:08:35 +08:00
fzyzcjy e5ef845cad Support multiple verbosity in dump comparator (#19684) 2026-03-02 18:47:30 +08:00
fzyzcjy 3dd4649b42 Beautify text output in dump comparator (#19683) 2026-03-02 18:47:01 +08:00
fzyzcjy 5bf3deb4bc Trace execution information in dump comparator (#19682) 2026-03-02 18:46:27 +08:00
fzyzcjy 3ebd85bf1c Enhance sglang engine dumping tests in dump comparator (#19681) 2026-03-02 18:46:03 +08:00
fzyzcjy abdc0ee71f Support directory detection in dump comparator (#19680) 2026-03-02 18:45:35 +08:00
fzyzcjy 6980416149 Support non orthogonal parallel axes and explicit replication annotation in dump comparator (#19679) 2026-03-02 18:44:33 +08:00
fzyzcjy a70dd11011 Support flattened dims in dump comparator (#19678) 2026-03-02 18:43:01 +08:00
fzyzcjy 15e83eea61 Enhance replication check, matching pattern, logging in dump comparator (#19677) 2026-03-02 18:42:27 +08:00
fzyzcjy ec44bc82ab Support presets and arbitrary skipping keys in dump comparator (#19676) 2026-03-02 18:41:49 +08:00
fzyzcjy e64095c3c7 Support data parallel attention in dump comparator (#19602) 2026-03-01 10:51:21 +08:00
fzyzcjy ea6ff7b01f Support multi sharding group on the same dimension in dump comparator (#19601) 2026-03-01 10:36:48 +08:00
fzyzcjy 46960e65cf Add skip patterns, tee to file, tensor load warning in dump comparator (#19600) 2026-03-01 10:36:22 +08:00
fzyzcjy b0b26a7ef1 Support concat mode in token aligner in dump comparator (#19599) 2026-03-01 10:35:50 +08:00
fzyzcjy e78f1283f7 Support overriding and post-hoc providing metadata in dump comparator (#19598) 2026-03-01 10:35:06 +08:00
fzyzcjy e41164af1c Enhance replicated tensor checker in dump comparator (#19597) 2026-03-01 10:34:34 +08:00
fzyzcjy ec08240a6a Support data parallel in dump comparator (#19596) 2026-03-01 10:34:03 +08:00
fzyzcjy 003ad6daaa Support partial tensors waiting for reduction and pipeline parallel in dump comparator (#19595) 2026-03-01 10:33:39 +08:00
fzyzcjy 67810828cf Visualize per-token information in dump comparator (#19594) 2026-03-01 10:32:59 +08:00
fzyzcjy f5a10e04cd Support arbitrary filtering in dumper (#19593) 2026-03-01 10:31:21 +08:00
fzyzcjy 5705e02d28 Support singleton dimension squeezing in dump comparator (#19566) 2026-02-28 18:11:46 +08:00
fzyzcjy 80bbd30909 Visualize comparison detailed results in dump comparator (#19565) 2026-02-28 18:08:16 +08:00
fzyzcjy 40facdb28c Handle recompute and verify closeness in dumper (#19564) 2026-02-28 18:07:44 +08:00
fzyzcjy 63a4778542 Support non-intrusive arbitrary dumping in dumper and add e2e tests (#19563) 2026-02-28 18:06:55 +08:00
fzyzcjy ccbc47d6be Update layer id extraction, diffing, empty handling and error sentinel in dump comparator (#19562) 2026-02-28 18:06:26 +08:00
fzyzcjy 4097eb5ce9 Support patching source code (#19561) 2026-02-28 18:05:45 +08:00
fzyzcjy b73aa53d7e Enhance metrics in dump comparator (#19560) 2026-02-28 18:05:19 +08:00
fzyzcjy 706ab9296a Support method decorator for tagging and add minimalistic comparator in dumper (#19559) 2026-02-28 18:04:54 +08:00
fzyzcjy 9bf3638a25 Support handling arbitrary objects in dump comparator (#19558) 2026-02-28 18:04:13 +08:00
fzyzcjy 4add6ec0f6 Enhance displaying and debuggability in dump comparator (#19466) 2026-02-27 09:06:19 +08:00
fzyzcjy 23cbbd6d41 Integrate packed data context parallel in dump comparator (#19464) 2026-02-27 08:28:36 +08:00
fzyzcjy 8293a914a6 Support token align with packed CP data in dump comparator (#19463) 2026-02-27 08:12:54 +08:00
fzyzcjy 695e93b91f Make reorderer support packed format with CP in dump comparator (#19462) 2026-02-27 08:12:18 +08:00
fzyzcjy e3cdf6b1a3 Support CP packed format in unsharder in dump comparator (#19461) 2026-02-27 08:11:47 +08:00
fzyzcjy f2d1b7c4ad Support sequence parallel and trivial dims in dump comparator (#19460) 2026-02-27 08:11:15 +08:00
fzyzcjy eb2ada3804 Support non-packed format when aligning tokens in dump comparator (#19459) 2026-02-27 08:10:29 +08:00
fzyzcjy e1e0cfd856 Use named tensors in dump comparator (#19458) 2026-02-27 08:09:55 +08:00
fzyzcjy eb0e905fc3 Update token layout and cleanup printer in dump comparator (#19457) 2026-02-27 08:09:15 +08:00
fzyzcjy 8ac64e1487 Support unifying axis ordering in dump comparator (#19456) 2026-02-27 08:08:32 +08:00
fzyzcjy 425d333ee3 Support token dim in arbitrary location in dump comparator (#19455) 2026-02-27 08:07:38 +08:00
fzyzcjy 265eb56d44 Support multi-step alignment and pipeline integration in dump comparator (#19378) 2026-02-26 10:23:22 +08:00
fzyzcjy f9a2f0398f Support token aligner planning and execution in dump comparator (#19377) 2026-02-26 10:04:33 +08:00
fzyzcjy d34d5aca07 Support loading token aligner data in dump comparator (#19376) 2026-02-26 10:03:56 +08:00
fzyzcjy e8dd14519d Add aligner entrypoint and bundle handler in dump comparator (#19375) 2026-02-26 10:03:22 +08:00
fzyzcjy 2739d7df62 Reorganize modules and pipeline in dump comparator (#19374) 2026-02-26 10:00:13 +08:00
fzyzcjy 508b8e3387 Handle warnings via sink for structured output and add pair in dump comparator (#19373) 2026-02-26 09:59:15 +08:00
fzyzcjy 46321ee70e Support dumping rid for correlation across passes in dump comparator (#19372) 2026-02-26 09:57:57 +08:00
fzyzcjy b7af58b9af Support replication axis in dump comparator (#19282) 2026-02-25 09:48:43 +08:00
fzyzcjy 2e2b18e870 Support context parallel zigzag reordering in dump comparator (#19281) 2026-02-25 09:46:17 +08:00
fzyzcjy 0de1f4b07b Support multi axis unsharding in dump comparator (#19280) 2026-02-25 09:44:07 +08:00
fzyzcjy 4bb678f28a Full test coverage in dump comparator (#19279) 2026-02-25 09:43:29 +08:00
fzyzcjy 94ca2ac5d7 Support TP unification and enhance tests in dump comparator (#19278) 2026-02-25 09:42:56 +08:00
fzyzcjy 39ba9b5ab5 Support simple unsharding in dumper comparator (#19277) 2026-02-25 09:42:21 +08:00
fzyzcjy 02ca107b2c Support dims annotation and enhance dump loader in dumper (#19276) 2026-02-25 09:41:48 +08:00
fzyzcjy 8b1ab4aaf9 Support agent-friendly output formats in dump comparator (#19275) 2026-02-25 09:40:33 +08:00
fzyzcjy d7578ce279 Implement simplest dump comparator v2 (#19274) 2026-02-25 09:37:21 +08:00
fzyzcjy 1a1c768d44 Support kwargs and megatron core tensor parsing in dumper (#19138) 2026-02-22 16:24:33 +08:00
fzyzcjy 326b788ab4 Fix wrongly large dumped file and handle non intrusive hook reset in dumper (#19124) 2026-02-22 16:20:08 +08:00
fzyzcjy c1f497e20e Enhance reset, states, http in dumper (#19095) 2026-02-22 16:17:41 +08:00
fzyzcjy 4091b720c5 Support multi colocated dumper, named exp cleanup, argparse config (#19094) 2026-02-22 16:16:15 +08:00
fzyzcjy 31f0c11405 Configure and call dumper in main SGLang logic (#19093) 2026-02-22 16:14:27 +08:00
fzyzcjy cc63c99f11 Enhance hook mechanism in dumper (#19073) 2026-02-22 16:13:38 +08:00
fzyzcjy fdf80b5031 Extract framework plugins in dumper (#19072) 2026-02-22 16:10:43 +08:00
fzyzcjy e32b5364a2 Auto annotate context in dumper (#19071) 2026-02-22 16:08:48 +08:00
fzyzcjy 8bc0751376 Support enabling partial non intrusive dump in dumper (#19069) 2026-02-22 16:07:45 +08:00
fzyzcjy 0384c459a7 Support non-intrusive dumping in dumper (#19068) 2026-02-22 16:04:02 +08:00
fzyzcjy 5eccc3cff9 Refactor dumper and change on_forward_pass_start API (#19065) 2026-02-22 16:03:27 +08:00
fzyzcjy 0d20cf5a66 Fix lint on main (#19054) 2026-02-20 15:45:24 +08:00
fzyzcjy 046ef0aa35 Support using SGLang port in dumper (#19038) 2026-02-20 12:30:24 +08:00
fzyzcjyandYueming Yuan 2fecc2c075 Support resetting and enhance HTTP endpoints for dumper (#19046)
Co-authored-by: Yueming Yuan <112649537+yueming-yuan@users.noreply.github.com>
2026-02-20 12:29:09 +08:00
fzyzcjy 503bf3047a Enhance configure and env parsing in dumper (#19034) 2026-02-20 12:28:10 +08:00
fzyzcjy df995aab56 Support filtering labels in dumper (#19018) 2026-02-20 12:27:12 +08:00
fzyzcjy 261bca3c58 Support captured dump output and console output control in dumper (#19017) 2026-02-20 12:26:24 +08:00
fzyzcjy fc1500adc6 Hint users when wrongly execute it with partial ranks in dumper (#19014) 2026-02-20 12:25:54 +08:00
fzyzcjy b41d412c3d Support cleanup previous dumps in dumper (#19013) 2026-02-20 12:25:21 +08:00
fzyzcjyandYueming Yuan f554b3c27b Support dumping gradients, parameters, lazy values (#18881)
Co-authored-by: Yueming Yuan <112649537+yueming-yuan@users.noreply.github.com>
2026-02-16 13:34:06 +08:00
fzyzcjy 9a7d8d5eb0 Collect upper level metadata to dump output (#18880) 2026-02-16 13:31:19 +08:00
fzyzcjy 949792d0c6 Change dump output format to dict with value and metadata (#18879) 2026-02-16 13:30:47 +08:00
fzyzcjy 02816abc0d Flip dumper to disable by default and refactor environment handling (#18878) 2026-02-16 13:29:32 +08:00
fzyzcjy 90555a0228 Add missing dumper tests (#18859) 2026-02-15 18:42:57 +08:00
fzyzcjy 4c7f986c6b Extract dumper and prefill delayer tests common utils (#18857) 2026-02-15 18:33:23 +08:00
fzyzcjy 9c2530642c Change routing policy API to be async to support more policies (#17048) 2026-01-17 17:12:51 +08:00
fzyzcjy a7b5f75d88 Support integration tests with Redis binary (#17045) 2026-01-17 11:59:04 +08:00
fzyzcjy 305c1a575a Tiny remove unused code (#17047) 2026-01-17 11:58:43 +08:00
fzyzcjy c824ddd581 Fix imbalancedness for manual policy min group mode for requests without routing id (#17044) 2026-01-17 11:58:35 +08:00