Commit Graph
148 Commits
Author SHA1 Message Date
ANSHUMAN TRIPATHYandmingfeima 2adb2e8485 [XPU] Adapt device agnostic API usage (#32093)
Co-authored-by: mingfeima <mingfei.ma@intel.com>
2026-09-11 10:03:12 +08:00
Alex NailsandAlison Shao 28262c20df [CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
2026-09-02 19:46:08 -07:00
Cheng Wan 7e751153eb [Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086) 2026-08-30 02:18:33 -07:00
Cheng WanandClaude Opus 5 fd40a331bf config: a parallel size has one spelling; a patched scope declares its own (#36621)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 12:56:42 -07:00
Cheng Wan d2bc697396 spec: size the speculative buffers from the bags, not the startup record (#35024) 2026-08-17 16:16:56 -07:00
Cheng Wan 55b6769b0e config: read resolved config via namespace accessors (#33013) 2026-07-31 15:06:59 -07:00
Khoa Phamandkpham-sgl d310fce85f [Fix] Update PR #25015 revert for fused topk=1 draft postprocess (#31519)
Co-authored-by: kpham-sgl <kpham-sgl@users.noreply.github.com>
2026-07-16 21:51:16 -07:00
fzyzcjy e789ca24a7 Lightweight extract allocation logic from mem_cache/common.py to more clearly show nearly parallel variants (#29431) 2026-07-15 14:49:37 +08:00
ANSHUMAN TRIPATHY 23f2b77d82 Make UTs compatible for XPU (#27106) 2026-07-15 12:35:56 +08:00
78dc581518 [bug-fix] Stabilize GLM-5.2 MTP IndexShare across PD and CUDA graph replay (#30839)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-13 19:37:07 -07:00
fzyzcjy 6ab7a65d94 Support grad injection and step override in the dumper's model dump (#30657) 2026-07-09 20:26:05 +08:00
fzyzcjy 5b28465eb9 Cap diagnostic detail computation for failing tensors (#30656) 2026-07-09 20:19:51 +08:00
fzyzcjy 287291c232 Fix rel_diff being nan for bitwise-identical tensors (#30655) 2026-07-09 20:16:18 +08:00
fzyzcjy 0d7e8cfb85 Support per-regex diff-threshold predicates in the tensor comparator (#30654) 2026-07-09 20:15:36 +08:00
Cheng Wan 1f15308dca [refactor] Retire the legacy config accessor and the remaining process singletons (#30493) 2026-07-09 02:10:47 -07:00
Cheng Wan e703f9e566 [refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492) 2026-07-09 02:09:39 -07:00
Rain JiangandLianmin Zheng be1930133a Convert IPC dataclasses to msgspec.Struct with opt-in msgpack transport (#28688)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-06-26 12:04:03 -07:00
Lianmin Zheng 34dd9c28ca [Refactor] Introduce sock_send/sock_recv wrappers for zmq IPC (#29012) 2026-06-23 15:54:36 -07:00
Cheng Wan 97a0031799 [lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984) 2026-06-11 17:38:05 -07:00
2495c02c2c [Refactor] Cuda Graph Runner/Backend Refactor (#23906)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-06-09 21:36:57 -07:00
Liangsheng Yin 28c1a3cb45 [Spec] Deprecate Spec V1 (#25464) 2026-06-08 13:10:27 -07:00
fzyzcjy f5fdf9c5d8 Speed up dump comparator percentile computation using numpy (#26874) 2026-06-08 14:50:31 +08:00
fzyzcjy 995e649190 Add parallel-rank dump filenames and pipeline-global layer remapping to dumper (#26850) 2026-06-08 14:49:22 +08:00
Liangsheng Yin 5160f7914e Fix MLA EAGLE draft CUDA-graph kv_indices under-allocation for topk > 1 (#27460) 2026-06-06 16:28:34 -07:00
Liangsheng Yin 1c7acba579 [spec] Consolidate the per-decode KV alloc reserve into one helper (#27458) 2026-06-06 14:58:50 -07:00
Liangsheng Yin 84ca0ffb8c Spec v2 tree drafting (topk>1) with page_size>1 (#26972) 2026-06-06 12:00:27 -07:00
Liangsheng Yin aa5213abb1 [debug] Register #27338 EAGLE draft kv_indices revert in pr_fix_toggle (#27428) 2026-06-06 00:30:13 -07:00
Liangsheng Yin 26b9053dcc [Spec] Fix fa3 EAGLE draft-decode expand page_table scatter OOB for topk>1 + page_size>1 (#27360) 2026-06-06 00:24:34 -07:00
Liangsheng Yin 58a05d3dd2 [CI] Isolate CUDA coredump dir per run to fix tracker mis-attribution (#27344) 2026-06-05 21:31:22 -04:00
fzyzcjy 7f93952f79 Add a debug toggle for selectively reverting PR fixes (#26802) 2026-05-31 09:50:12 +08:00
Joel Schlosser 6989fede3c Purge usage of pytorch named tensors (#25911) 2026-05-26 14:58:57 -07:00
fzyzcjy a858fda708 Add e2e test with log snapshot in dumper grafter (#24513) 2026-05-06 17:00:13 +08:00
fzyzcjy 8527db0a91 Enhance diff and tensor-info logging in dumper grafter (#24512) 2026-05-06 16:58:08 +08:00
fzyzcjy 75943cfbcf Support per-call extras and dataclass transform input in dumper grafter (#24511) 2026-05-06 16:57:44 +08:00
fzyzcjy 833279eb2e Support multi-rank exchange via all_gather_object in dumper grafter (#24510) 2026-05-06 16:57:20 +08:00
fzyzcjy ebd64f5d40 Support user-supplied recv-side transform in dumper grafter (#24509) 2026-05-06 16:56:52 +08:00
fzyzcjy 9a65f0ac26 Support t2b direction and overlap protection in dumper grafter (#24508) 2026-05-06 16:56:24 +08:00
fzyzcjy 58487e68e5 Support cross-system tensor grafting in dumper (#24507) 2026-05-06 16:55:40 +08:00
fzyzcjy 61104d7d0a Add prefixed _log helper in dumper (#24506) 2026-05-06 16:54:20 +08:00
fzyzcjy 146700db68 Add e2e demo test in dump comparator (#21031) 2026-03-20 22:41:01 +08:00
fzyzcjy 6703cc4484 Enhance output formatting in dump comparator (#21029) 2026-03-20 22:04:50 +08:00
fzyzcjy fdbcb8156e Refactor dp_utils to use ParallelAxis enum in dump comparator (#21028) 2026-03-20 22:04:20 +08:00
fzyzcjy 154395ab7d Support s≡t dimension name equivalence in dump comparator (#21027) 2026-03-20 22:03:34 +08:00
fzyzcjy cc22601d28 Validate replicated axes orthogonality in dump comparator (#21026) 2026-03-20 22:02:40 +08:00
fzyzcjy 2f01950a0e Support jointly-determined axes inference in dump comparator (#21025) 2026-03-20 22:01:26 +08:00
fzyzcjy ecd7e40d20 Support dependent axis auto-resolution in dump comparator (#21024) 2026-03-20 21:56:39 +08:00
fzyzcjy 7579ab3f33 Enhance error resilience in dump comparator (#19685) 2026-03-02 19:08:35 +08:00
fzyzcjy e5ef845cad Support multiple verbosity in dump comparator (#19684) 2026-03-02 18:47:30 +08:00
fzyzcjy 3dd4649b42 Beautify text output in dump comparator (#19683) 2026-03-02 18:47:01 +08:00
fzyzcjy 5bf3deb4bc Trace execution information in dump comparator (#19682) 2026-03-02 18:46:27 +08:00