Commit Graph
51 Commits
Author SHA1 Message Date
Xiaoyu ZhangandMick Qian 4d23a4fa6d [Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-07 15:13:59 +08:00
Alex NailsandAlison Shao 28262c20df [CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
2026-09-02 19:46:08 -07:00
Liangsheng Yin 7c90840bad [CI] Key scheduled CUDA suites by runner_config instead of hand-written jobs (#34186) 2026-08-09 16:44:53 -07:00
fzyzcjy 6ab7a65d94 Support grad injection and step override in the dumper's model dump (#30657) 2026-07-09 20:26:05 +08:00
Cheng Wan e703f9e566 [refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492) 2026-07-09 02:09:39 -07:00
Lianmin Zheng 9d00385b63 Cleanup: relocate temp_set_env and consolidate multi-device/CUDA helpers in common.py (#30180) 2026-07-05 18:47:26 -07:00
fzyzcjy 995e649190 Add parallel-rank dump filenames and pipeline-global layer remapping to dumper (#26850) 2026-06-08 14:49:22 +08:00
fzyzcjy 11b0e510aa Fix lint (#24520) 2026-05-06 18:26:41 +08:00
fzyzcjy a858fda708 Add e2e test with log snapshot in dumper grafter (#24513) 2026-05-06 17:00:13 +08:00
fzyzcjy 8527db0a91 Enhance diff and tensor-info logging in dumper grafter (#24512) 2026-05-06 16:58:08 +08:00
fzyzcjy 75943cfbcf Support per-call extras and dataclass transform input in dumper grafter (#24511) 2026-05-06 16:57:44 +08:00
fzyzcjy 833279eb2e Support multi-rank exchange via all_gather_object in dumper grafter (#24510) 2026-05-06 16:57:20 +08:00
fzyzcjy ebd64f5d40 Support user-supplied recv-side transform in dumper grafter (#24509) 2026-05-06 16:56:52 +08:00
fzyzcjy 9a65f0ac26 Support t2b direction and overlap protection in dumper grafter (#24508) 2026-05-06 16:56:24 +08:00
fzyzcjy 58487e68e5 Support cross-system tensor grafting in dumper (#24507) 2026-05-06 16:55:40 +08:00
fzyzcjy 61104d7d0a Add prefixed _log helper in dumper (#24506) 2026-05-06 16:54:20 +08:00
fzyzcjy e64095c3c7 Support data parallel attention in dump comparator (#19602) 2026-03-01 10:51:21 +08:00
fzyzcjy ea6ff7b01f Support multi sharding group on the same dimension in dump comparator (#19601) 2026-03-01 10:36:48 +08:00
fzyzcjy f5a10e04cd Support arbitrary filtering in dumper (#19593) 2026-03-01 10:31:21 +08:00
fzyzcjy 40facdb28c Handle recompute and verify closeness in dumper (#19564) 2026-02-28 18:07:44 +08:00
fzyzcjy 63a4778542 Support non-intrusive arbitrary dumping in dumper and add e2e tests (#19563) 2026-02-28 18:06:55 +08:00
fzyzcjy 706ab9296a Support method decorator for tagging and add minimalistic comparator in dumper (#19559) 2026-02-28 18:04:54 +08:00
fzyzcjy 265eb56d44 Support multi-step alignment and pipeline integration in dump comparator (#19378) 2026-02-26 10:23:22 +08:00
fzyzcjy 46321ee70e Support dumping rid for correlation across passes in dump comparator (#19372) 2026-02-26 09:57:57 +08:00
fzyzcjy 02ca107b2c Support dims annotation and enhance dump loader in dumper (#19276) 2026-02-25 09:41:48 +08:00
fzyzcjy 1a1c768d44 Support kwargs and megatron core tensor parsing in dumper (#19138) 2026-02-22 16:24:33 +08:00
fzyzcjy 326b788ab4 Fix wrongly large dumped file and handle non intrusive hook reset in dumper (#19124) 2026-02-22 16:20:08 +08:00
fzyzcjy c1f497e20e Enhance reset, states, http in dumper (#19095) 2026-02-22 16:17:41 +08:00
fzyzcjy 4091b720c5 Support multi colocated dumper, named exp cleanup, argparse config (#19094) 2026-02-22 16:16:15 +08:00
fzyzcjy 31f0c11405 Configure and call dumper in main SGLang logic (#19093) 2026-02-22 16:14:27 +08:00
fzyzcjy cc63c99f11 Enhance hook mechanism in dumper (#19073) 2026-02-22 16:13:38 +08:00
fzyzcjy fdf80b5031 Extract framework plugins in dumper (#19072) 2026-02-22 16:10:43 +08:00
fzyzcjy e32b5364a2 Auto annotate context in dumper (#19071) 2026-02-22 16:08:48 +08:00
fzyzcjy 8bc0751376 Support enabling partial non intrusive dump in dumper (#19069) 2026-02-22 16:07:45 +08:00
fzyzcjy 0384c459a7 Support non-intrusive dumping in dumper (#19068) 2026-02-22 16:04:02 +08:00
fzyzcjy 5eccc3cff9 Refactor dumper and change on_forward_pass_start API (#19065) 2026-02-22 16:03:27 +08:00
fzyzcjy 046ef0aa35 Support using SGLang port in dumper (#19038) 2026-02-20 12:30:24 +08:00
fzyzcjyandYueming Yuan 2fecc2c075 Support resetting and enhance HTTP endpoints for dumper (#19046)
Co-authored-by: Yueming Yuan <112649537+yueming-yuan@users.noreply.github.com>
2026-02-20 12:29:09 +08:00
fzyzcjy 503bf3047a Enhance configure and env parsing in dumper (#19034) 2026-02-20 12:28:10 +08:00
fzyzcjy df995aab56 Support filtering labels in dumper (#19018) 2026-02-20 12:27:12 +08:00
fzyzcjy 261bca3c58 Support captured dump output and console output control in dumper (#19017) 2026-02-20 12:26:24 +08:00
fzyzcjy fc1500adc6 Hint users when wrongly execute it with partial ranks in dumper (#19014) 2026-02-20 12:25:54 +08:00
fzyzcjy b41d412c3d Support cleanup previous dumps in dumper (#19013) 2026-02-20 12:25:21 +08:00
fzyzcjyandYueming Yuan f554b3c27b Support dumping gradients, parameters, lazy values (#18881)
Co-authored-by: Yueming Yuan <112649537+yueming-yuan@users.noreply.github.com>
2026-02-16 13:34:06 +08:00
fzyzcjy 9a7d8d5eb0 Collect upper level metadata to dump output (#18880) 2026-02-16 13:31:19 +08:00
fzyzcjy 949792d0c6 Change dump output format to dict with value and metadata (#18879) 2026-02-16 13:30:47 +08:00
fzyzcjy 02816abc0d Flip dumper to disable by default and refactor environment handling (#18878) 2026-02-16 13:29:32 +08:00
fzyzcjy 90555a0228 Add missing dumper tests (#18859) 2026-02-15 18:42:57 +08:00
fzyzcjy 4c7f986c6b Extract dumper and prefill delayer tests common utils (#18857) 2026-02-15 18:33:23 +08:00
Michael b025cff441 [AMD] Add AMD CI registration (1-gpu unit test) to nightly CI. (#16941) 2026-01-13 23:41:45 -08:00